dan b80bb6ce88 Add the "categories" option to the unicode61 tokenizer in fts5. ...

FossilOrigin-Name: 80d2b9e635e3100f90cffdcffa5b5038da6fbbfccc9f5777c59a4ae760d4cb62

2018-07-13 19:52:43 +00:00

..

CaseFolding.txt

Add an experimental tokenizer to fts4 - "unicode". This tokenizer works in the same way except that it understands unicode "simple case folding" and recognizes all characters not classified as "Letters" or "Numbers" by unicode as token separators.

2012-05-25 17:50:19 +00:00

mkunicode.tcl

Add the "categories" option to the unicode61 tokenizer in fts5.

2018-07-13 19:52:43 +00:00

parseunicode.tcl

Add the "categories" option to the unicode61 tokenizer in fts5.

2018-07-13 19:52:43 +00:00

UnicodeData.txt

Add an experimental tokenizer to fts4 - "unicode". This tokenizer works in the same way except that it understands unicode "simple case folding" and recognizes all characters not classified as "Letters" or "Numbers" by unicode as token separators.

2012-05-25 17:50:19 +00:00