dan b651084713 Add tests to restore coverage of fts5_tokenizer.c. ...

FossilOrigin-Name: 8f9257361b05e368bf433e56d0698923b0f97d12e7c0ad7760aaab6746c0e467

2024-08-17 17:22:49 +00:00

..

CaseFolding.txt

Add an experimental tokenizer to fts4 - "unicode". This tokenizer works in the same way except that it understands unicode "simple case folding" and recognizes all characters not classified as "Letters" or "Numbers" by unicode as token separators.

2012-05-25 17:50:19 +00:00

mkunicode.tcl

Add tests to restore coverage of fts5_tokenizer.c.

2024-08-17 17:22:49 +00:00

parseunicode.tcl

Add the "remove_diacritics=2" option to the unicode61 tokenizer in both FTS5

2018-12-03 16:14:49 +00:00

UnicodeData.txt

Add an experimental tokenizer to fts4 - "unicode". This tokenizer works in the same way except that it understands unicode "simple case folding" and recognizes all characters not classified as "Letters" or "Numbers" by unicode as token separators.

2012-05-25 17:50:19 +00:00