2 Commits

Author	SHA1	Message	Date
dan	1c7016c9a5	Add special fast paths to sqlite3FtsUnicodeTolower() and Isalnum() for codepoints in the ASCII range. ... FossilOrigin-Name: cf7b25d47687635a04f4347d45f135c686b9d758	2012-05-25 19:50:12 +00:00
dan	3d403c71a8	Add an experimental tokenizer to fts4 - "unicode". This tokenizer works in the same way except that it understands unicode "simple case folding" and recognizes all characters not classified as "Letters" or "Numbers" by unicode as token separators. ... FossilOrigin-Name: 0c13570ec78c6887103dc99b81b470829fa28385	2012-05-25 17:50:19 +00:00