Home → Questions →

Delayed Deltas and the Delta Index

• Edit

Kenny

29 Jun, 2011 11:57 PM

In the TS documentation, they mention that you need to regularly run a full re-index even though you are using delta indexing. Is this also true if you are using FS Delayed Delta Indexing? (See the appropriate TS documentation paragraph below.) If so, which command should be used for the cron, fs:index or fs:rebuild? The TS and FS documentation is a little lacking in the area of delayed deltas. Neither really ex plain what is happening in the delayed job of the delayed delta indexing. Is it putting your changes into the delta index or is it merging those changes into the main index?

From the TS Docs:
"Turning on delta indexing does not remove the need for regularly running a full re-index, as otherwise the delta index itself will grow to become just as large as the core indexes, and this removes the advantage of keeping it separate. It also slows down your requests to your server that make changes to the model records."

I think some clarification is needed in the docs. Any answers to these questions would be helpful.

Thanks,
-Kenny

1. Support Staff 1 Posted by Pat Allan on 30 Jun, 2011 12:18 AM

   

   I agree, the documentation needs some improvement, and I'll work on that soon - but just to get an answer to you quickly: fs:index is all you need to run via cron. You only need to rebuild when changing your Sphinx configuration (adding/removing fields or attributes, adding/removing indices).

   And yes, you still need to regularly update your data fully even while using deltas (delayed or otherwise, FS-hosted or otherwise). If you don't, the delta index grows and grows in size, and thus becomes slower and slower to re-index.

   • Edit

2. Support Staff 2 Posted by Pat Allan on 30 Jun, 2011 12:19 AM

   

   Also: delayed delta indexing doesn't merge the results into the core index (merging wasn't reliable when I tried it a couple of years ago - maybe it's better now, but realtime updates are on the horizon).

   • Edit

3. 3 Posted by Kenny on 30 Jun, 2011 12:25 AM

   

   Ok, thanks for the info and the fast response.

   • Edit

4. Pat Allan closed this discussion on 27 Oct, 2011 09:51 AM.