Archive for November, 2011

Backing up RT indexes

Friday, November 18th, 2011

Things break, servers crash, software has bugs, water is wet, so to keep the sky blue and clear we need backups. While backing up a disk index in Sphinx is basically a matter of copying files around, properly backing up RT is a little bit more complicated. (But only a little bit.) Read on to find out how binlogs, periodic flushes, and two newly added 2.0.2-beta features (FLUSH RTINDEX and ATTACH INDEX) can all work together for backup/recovery.
(more…)

Sphinx memory consumption

Friday, November 11th, 2011

Let me step back from sphinx performance and highlight first how Sphinx uses memory.

There are two different ways to store data in Sphinx (we call it indexes): on-disk and Real-Time index. Lets start with good old on-disk indexes.

Basically Sphinx on-disk index is simply a set of files generated by indexer during indexing process. All of them, except .spd and .spp are kept in memory for performance reasons. (more…)