Delayed Deltas and the Delta Index
In the TS documentation, they mention that you need to regularly run a full re-index even though you are using delta indexing. Is this also true if you are using FS Delayed Delta Indexing? (See the appropriate TS documentation paragraph below.) If so, which command should be used for the cron, fs:index or fs:rebuild? The TS and FS documentation is a little lacking in the area of delayed deltas. Neither really ex plain what is happening in the delayed job of the delayed delta indexing. Is it putting your changes into the delta index or is it merging those changes into the main index?
From the TS Docs:
"Turning on delta indexing does not remove the need for regularly
running a full re-index, as otherwise the delta index itself will
grow to become just as large as the core indexes, and this removes
the advantage of keeping it separate. It also slows down your
requests to your server that make changes to the model
records."
I think some clarification is needed in the docs. Any answers to these questions would be helpful.
Thanks,
-Kenny
Comments are currently closed for this discussion. You can start a new one.
Keyboard shortcuts
Generic
? | Show this help |
---|---|
ESC | Blurs the current field |
Comment Form
r | Focus the comment reply box |
---|---|
^ + ↩ | Submit the comment |
You can use Command ⌘
instead of Control ^
on Mac
Support Staff 1 Posted by Pat Allan on 30 Jun, 2011 12:18 AM
I agree, the documentation needs some improvement, and I'll work on that soon - but just to get an answer to you quickly:
fs:index
is all you need to run via cron. You only need to rebuild when changing your Sphinx configuration (adding/removing fields or attributes, adding/removing indices).And yes, you still need to regularly update your data fully even while using deltas (delayed or otherwise, FS-hosted or otherwise). If you don't, the delta index grows and grows in size, and thus becomes slower and slower to re-index.
Support Staff 2 Posted by Pat Allan on 30 Jun, 2011 12:19 AM
Also: delayed delta indexing doesn't merge the results into the core index (merging wasn't reliable when I tried it a couple of years ago - maybe it's better now, but realtime updates are on the horizon).
3 Posted by Kenny on 30 Jun, 2011 12:25 AM
Ok, thanks for the info and the fast response.
Pat Allan closed this discussion on 27 Oct, 2011 09:51 AM.