6 Commits

Author	SHA1	Message	Date
KN4CK3R	5159055278	Read expected buffer size (#17409) (#17430) ... Backport of #17409 * Read expected buffer size. * Changed name.	2021-10-25 17:46:56 +01:00
Lunny Xiao	9d99f6ab19	Refactor renders (#15175) ... * Refactor renders * Some performance optimization * Fix comment * Transform reader * Fix csv test * Fix test * Fix tests * Improve optimaziation * Fix test * Fix test * Detect file encoding with reader * Improve optimaziation * reduce memory usage * improve code * fix build * Fix test * Fix for go1.15 * Fix render * Fix comment * Fix lint * Fix test * Don't use NormalEOF when unnecessary * revert change on util.go * Apply suggestions from code review Co-authored-by: zeripath <art27@cantab.net> * rename function * Take NormalEOF back Co-authored-by: zeripath <art27@cantab.net>	2021-04-19 18:25:08 -04:00
zeripath	a1ad188326	Fix chardet test and add ordering option (#11621) ... * Fix chardet test and add ordering option Signed-off-by: Andrew Thornton <art27@cantab.net> * minor fixes Signed-off-by: Andrew Thornton <art27@cantab.net> * remove log Signed-off-by: Andrew Thornton <art27@cantab.net> * remove log2 Signed-off-by: Andrew Thornton <art27@cantab.net> * only iterate through top results Signed-off-by: Andrew Thornton <art27@cantab.net> * Update docs/content/doc/advanced/config-cheat-sheet.en-us.md * slight restructure of for loop Signed-off-by: Andrew Thornton <art27@cantab.net> Co-authored-by: techknowlogick <techknowlogick@gitea.io>	2020-06-02 19:20:19 -03:00
Antoine GIRARD	81a52442a1	deps: update and fix chardet import (#9351)	2019-12-14 02:15:48 +02:00
guillep2k	2628b15ee3	Fix utf8 tests (#8192) ... * Prevent compiler environment from making the tests fail * Remove unused function * Pass lint	2019-09-21 13:01:34 -04:00
guillep2k	5a44be627c	Convert files to utf-8 for indexing (#7814) ... * Convert files to utf-8 for indexing * Move utf8 functions to modules/base * Bump repoIndexerLatestVersion to 3 * Add tests for base/encoding.go * Changes to pass gosimple * Move UTF8 funcs into new modules/charset package	2019-08-15 20:07:28 +08:00