 dan
|
f400282bdf
|
Further minor optimizations to flushing fts5 data to disk.
FossilOrigin-Name: a07dcca9ef3821a6719ef9dbbc8ed861fa005035
|
2015-02-27 09:41:10 +00:00 |
|
|
dan
|
5db7e2ca83
|
Fix suffix and prefix compression of terms in top-level fts5 segments. And a crash that could follow an OOM condition.
FossilOrigin-Name: bb104b3646c6f07ed002be7360b08433ee7980d4
|
2015-02-27 07:23:26 +00:00 |
|
|
dan
|
dfdc4b4613
|
Optimize copying data from fts5 in-memory hash tables to top level segments.
FossilOrigin-Name: 8e3ca6323a2beab5f04250e24ae15b159d2aa0ac
|
2015-02-26 20:49:09 +00:00 |
|
|
dan
|
4a7e11c629
|
Fix an fts5 bug in large incremental merges.
FossilOrigin-Name: 208e3cb6b6dc8c7d824b64dec2034004c9fcbba5
|
2015-02-26 14:54:03 +00:00 |
|
|
dan
|
6d8f42ec81
|
Instead of the 4-byte fields, use regular varints for the poslist-size field in fts5_hash.c.
FossilOrigin-Name: 7eb022d7e5fdb180af823c82c47c938e4a7a355f
|
2015-02-25 19:24:37 +00:00 |
|
|
dan
|
57fec54b53
|
Fix some problems with building fts5 and fts3 together using the amalgamation.
FossilOrigin-Name: fb10bbb9f9c4481e6043d323a3018a4ec68eb0ff
|
2015-02-02 11:32:20 +00:00 |
|
|
dan
|
5082140311
|
Minor optimizations to fts5 writes.
FossilOrigin-Name: 1fffe51fa92f1784365140d5b163ab6c690981ae
|
2015-01-31 15:23:44 +00:00 |
|
|
dan
|
719b0f66e5
|
Fix some problems with transactions that both read and write an fts5 table.
FossilOrigin-Name: 0e225b15357765f132c3364b222f9931a608a5b2
|
2015-01-29 20:59:34 +00:00 |
|
|
dan
|
900f1922ac
|
Fix a problem with fts5 doclist-indexes that occured if the first rowid of the first non-term page of a doclist is zero.
FossilOrigin-Name: f704bc059e06b01f1d68fa7dad89e33eace6c389
|
2015-01-27 20:41:00 +00:00 |
|
|
dan
|
8ac3025419
|
Have fts5 store rowids in ascending order. Query speed is virtually the same regardless of rowid order, and ascending order makes some insert optimizations easier.
FossilOrigin-Name: 5206ca6005bfa9dfc7346d4b89430c9748d32c10
|
2015-01-24 19:57:03 +00:00 |
|
|
dan
|
641cb4360a
|
Fix compression of keys stored on internal segment b-tree nodes by fts5.
FossilOrigin-Name: 51444f67c0cc58a3023eb1cd78e7cf889da6c80f
|
2015-01-23 17:43:21 +00:00 |
|
|
dan
|
626d9e3062
|
Remove some redundant code from fts5.
FossilOrigin-Name: 939b7a5de25e064bdf08e03864c35ab718da6f6f
|
2015-01-23 06:50:33 +00:00 |
|
|
dan
|
0b520cc5f9
|
Add further tests and fixes for fts5.
FossilOrigin-Name: 5b295897153e9b26cd0d2e7ea112a4d461d0a665
|
2015-01-22 19:13:08 +00:00 |
|
|
dan
|
4c2871bead
|
Further tests and fixes for fts5.
FossilOrigin-Name: c020a291ed293a66d21c5885e50a7fee04aa6366
|
2015-01-21 20:30:14 +00:00 |
|
|
dan
|
dd8a501019
|
Fix an fts5 issue with loading doclist-indexes for a term that is the last thing on its leaf page.
FossilOrigin-Name: e0d614425f7f5ffe266fdc03642931b1ec19ad25
|
2015-01-21 18:23:25 +00:00 |
|
|
dan
|
b461380333
|
Add further tests for fts5 backend.
FossilOrigin-Name: 09dabb3b9e140eec6cfda83bcb86b6b9f5cf54b6
|
2015-01-21 16:10:59 +00:00 |
|
|
dan
|
997d798d92
|
Merge latest trunk changes with this branch.
FossilOrigin-Name: b3348b1e07e168b156636a29fc8c6d6afb3129c2
|
2015-01-21 06:36:07 +00:00 |
|
|
dan
|
fd0b436e10
|
Add extra fault injection tests to fts5.
FossilOrigin-Name: f45a0dc0a8911c8aac5a1028ac4f543a709656e7
|
2015-01-20 20:34:17 +00:00 |
|
|
dan
|
aa4d380a42
|
Handle the case where a tokenizer determines that there are zero tokens in an fts5 query term.
FossilOrigin-Name: 75f3d17f864072dfa2caee182b86cc4b9972d691
|
2015-01-19 11:15:36 +00:00 |
|
|
dan
|
d8736bc3b8
|
Ensure an up to date copy of the fts5 configuration has been loaded into memory before attempting to modify the same configuration.
FossilOrigin-Name: f30afd209aa4ce42766b1493750c4f5b5f1e9502
|
2015-01-17 20:01:52 +00:00 |
|
|
dan
|
2656167f6e
|
Improve the performance of the fts5 porter tokenizer implementation.
FossilOrigin-Name: 96ea600440de05ee663e71c3f0d0de2c64108bf9
|
2015-01-17 17:48:10 +00:00 |
|
|
dan
|
851ca6e715
|
Fix prefix indexes so that they work in characters, not bytes.
FossilOrigin-Name: af8d43a4a08528bbae25ee38fe25de8a86f8a21c
|
2015-01-13 17:25:08 +00:00 |
|
|
dan
|
73f7d6ed75
|
Optimize the unicode61 tokenizer so that it handles ascii text faster. Make it the default tokenizer. Change the name of the simple tokenizer to "ascii".
FossilOrigin-Name: f22dbccad9499624880ddd48df1b07fb42b1ad66
|
2015-01-12 17:58:04 +00:00 |
|
|
dan
|
27277c4e3c
|
Fix some documentation issues in fts5.
FossilOrigin-Name: 512e1bdb4093b59d1494dfc63391476eadd52aea
|
2015-01-10 20:34:27 +00:00 |
|
|
dan
|
d6b1c880d2
|
Add the fts5 'optimize' command.
FossilOrigin-Name: e749be563d8e738af113bd301770e2f22763ab77
|
2015-01-07 19:33:11 +00:00 |
|
|
dan
|
96a32bb51c
|
Add the 'rebuild' and 'delete-all' commands.
FossilOrigin-Name: 0cb2fed525778d96237b5b0943047665e1f636d1
|
2015-01-07 17:11:11 +00:00 |
|
|
dan
|
aacf3d1a3b
|
Remove the iPos parameter from the tokenizer callback. Fix the "tokenchars" and "separators" options on the simple tokenizer.
FossilOrigin-Name: 65f0262fb82dbfd9f80233ac7c3108e2f2716c0a
|
2015-01-06 19:08:26 +00:00 |
|
|
dan
|
2a28e507f7
|
Further fixes and test cases related to external content tables.
FossilOrigin-Name: ce6a899baff7265a60c880098a9a57ea352b5415
|
2015-01-06 14:38:34 +00:00 |
|
|
dan
|
ded4f41d1a
|
Tests and fixes for fts5 external content tables.
FossilOrigin-Name: 047aaf830d1e72f0fdad3832a0b617e769d66468
|
2015-01-05 20:41:39 +00:00 |
|
|
dan
|
0fbc269fef
|
Add support for external content tables to fts5.
FossilOrigin-Name: 17ef5b59f789e9fa35c4f053246d819987fd06f8
|
2015-01-03 20:44:58 +00:00 |
|
|
dan
|
ade921c3ad
|
Allow the rank column to be remapped on a per-query basis by including a term similar to "rank match 'bm25(10,2)'" in a where clause.
FossilOrigin-Name: 1cd15a1759004d5d321056905dbb6acff20dc7d9
|
2015-01-02 14:55:22 +00:00 |
|
|
dan
|
6024772ba2
|
Add a version of the unicode61 tokenizer to fts5.
FossilOrigin-Name: d09f7800cf14f73ea86d037107ef80295b2c173a
|
2015-01-01 16:46:10 +00:00 |
|
|
dan
|
e716aca24b
|
Move all fts5 test files to new directory "ext/fts5/test".
FossilOrigin-Name: 7f148edb30103c5f4fee20cd08e38537f9615bf2
|
2014-12-29 15:59:36 +00:00 |
|
|
dan
|
5fa3acabf4
|
Fixes to built-in tokenizers.
FossilOrigin-Name: b33fe0dd89f3180c209fa1f9e75d0a7acab12b8e
|
2014-12-29 11:24:46 +00:00 |
|
|
dan
|
2a615fa627
|
Fix the fts5 bm25() function so that it matches the documentation.
FossilOrigin-Name: 1ac7a8d0af9a71ddf6a1421033dcb9fa67c6120c
|
2014-12-23 19:18:34 +00:00 |
|
|
dan
|
005e10e39a
|
Fixes and simplifications for the snippet() and highlight() functions.
FossilOrigin-Name: ca5d44042aa7461dcc8b700b0763df4df9d4a891
|
2014-12-22 21:01:52 +00:00 |
|
|
dan
|
1616d55153
|
Remove the fts5_test() aux function. Test aux functions using the tcl interface instead.
FossilOrigin-Name: 67e3ffd950c5347d219a06b33ad51949cffa7d90
|
2014-12-19 20:53:51 +00:00 |
|
|
dan
|
2ae0f4c931
|
Fix a problem with prefix queries and the AND operator.
FossilOrigin-Name: 38b3c65e3ee95eb7afadb76e0110570fbbc41e1b
|
2014-12-18 20:01:15 +00:00 |
|
|
dan
|
e4bec37900
|
Fix various problems in fts5 revealed by fault-injection tests.
FossilOrigin-Name: e358c3de5c916f2c851ab9324ceaae4e4e7a0fbd
|
2014-12-18 18:25:48 +00:00 |
|
|
dan
|
845d0ab323
|
Begin testing fts5 OOM and IO error handling.
FossilOrigin-Name: 2037dba62fdd995ad15b642abe499a790f5ffe5c
|
2014-12-03 17:27:35 +00:00 |
|
|
dan
|
615a9ae5db
|
Add a configuration option to remap the "rank" column to an auxiliary fts5 function.
FossilOrigin-Name: b5f5971283b9b2f60c16f9675099855af95012cd
|
2014-12-02 20:18:11 +00:00 |
|
|
dan
|
89a89560d6
|
Add code to parse a rank() function specification. And a tcl interface to add auxiliary functions to fts5.
FossilOrigin-Name: 9c1697a2aa1f601e6eb11704abe63a73c8105447
|
2014-12-01 20:05:00 +00:00 |
|
|
dan
|
ca7fad3d2c
|
Add a cookie mechanism to ensure that the %_config table is re-read as required.
FossilOrigin-Name: bb4a37b53de60da9ec8b9317eec14afa99690828
|
2014-11-28 20:01:13 +00:00 |
|
|
dan
|
cb11e73fc2
|
Add a %_config table to fts5.
FossilOrigin-Name: 83491c56661ca78f96020ba68184bb3fb19e674f
|
2014-11-27 20:03:45 +00:00 |
|
|
dan
|
cb62aae034
|
Add the auxiliary highlight() function to fts5.
FossilOrigin-Name: 059092379f981eb919b500ce447006f9e645fc5a
|
2014-11-24 16:24:33 +00:00 |
|
|
dan
|
48d7014067
|
Fix the customization interfaces so that they match the documentation.
FossilOrigin-Name: fba0b5fc7eead07a4853e78e02d788e7c714f6cd
|
2014-11-15 20:07:31 +00:00 |
|
|
dan
|
4aee5dff83
|
Add documentation for tokenizer api to fts5.h. Also add a script to extract extension API docs and format them as html.
FossilOrigin-Name: e240d467e60b7755486aae5e8b0824f7c741f852
|
2014-08-25 19:58:54 +00:00 |
|
|
dan
|
6885bbc713
|
Add an "automerge=0" mode that disables auto-merging and falls back to fts4-style crisis merges.
FossilOrigin-Name: 2397404e152b908d838e6491294b263b05943b3f
|
2014-08-18 19:30:01 +00:00 |
|
|
dan
|
0bbd9c27c2
|
Cache the value of the "totals" record in memory during transactions.
FossilOrigin-Name: 05dfdad445b22f375b71abe0b1fa1bf7ca331be7
|
2014-08-12 16:07:35 +00:00 |
|
|
dan
|
e2fb318e34
|
Automatically resize the hash table used by fts5.
FossilOrigin-Name: f1cb48f412a5f200f1fe04f91072864f379db08f
|
2014-08-12 08:36:00 +00:00 |
|