Indexing with Sphinx is pretty straightforward and a simple 3-line setup will normally work pretty well for you. But there always is room for improvement. So today, we have a collection of tips for you that cover a few dark corners in the indexing process that can be subject to such improvements: (better) ranged queries, throttling, data security when indexing over the network, and disk usage.
We will be speaking at the Seattle MySQL Meetup on the 5th of March 2012. If you are in the Seattle area and interest in learning about when or or more importantly why one should adopt a Sphinx, this is your opportunity!
Slides for my “How to offload MySQL server with Sphinx” FOSDEM‘s talk is available here along with the others. Also we’ve participated in Sphinx user stories (by SkySQL and Sphinx).
Thanks for everyone who organized and attend FOSDEM 2012! It was pleasure to speak there at MySQL & Friends track (special thanks to Frederic Descamps for organizing it)!
If you want us to speak on the conferences or in Sphinx meetup in your location – please feel free to ping me!
Sincerely yours, Vlad.
Things break, servers crash, software has bugs, water is wet, so to keep the sky blue and clear we need backups. While backing up a disk index in Sphinx is basically a matter of copying files around, properly backing up RT is a little bit more complicated. (But only a little bit.) Read on to find out how binlogs, periodic flushes, and two newly added 2.0.2-beta features (FLUSH RTINDEX and ATTACH INDEX) can all work together for backup/recovery.
One of the application of distributed indexes in Sphinx is parallelizing queries across many CPU cores even when running on a single server. There’s a well known trick to have an agent line (or three) pointing to the very same master searchd instance. Only problem with that approach is, every query entails a bunch of one-off TCP connections, extra forks, and other redundant internal work. Which is okay when you’re serving a few heavy queries but might spin over 50% of your CPU in system time doing those works when you’re doing many quick ones.
Now that’s a problem, but starting with 1.10-beta, there is a solution, called dist_threads directive. So if you’re still doing that agent=localhost trick, and suffering from TCP stack pressure and/or seeing way too much system time in top(1) or vmstat(8), do read on, you are eligible. (As a collateral, if you’re still on anything pre-2.0.1, you should seriously consider upgrading, too.)
As a result of positive response we received from our 2010 Sphinx Conference in Moscow, we decided to take the show on road! Thus the Sphinx Road Show scheduled for Europe in late November 2011.
Andrew Aksyonoff the founder of Sphinx is a featured speaker at Percona Live London, Oct. 24-25th 2011. In addition to his talk on Increasing Performance of MySQL Queries with Sphinx, we are considering a tutorial or training session on Sphinx. But before we commit to a tutorial at Percona Live London, we would like to gauge the interest in attending from YOU. Read more…
When it rains, it pours… Do expect a full-blown news entry with the new features overview and other nitty gritty details a little while later (when we add more binary packages, and figure out how to mention both the book and the new release), but a new version of Sphinx, tagged 2.0.1-beta, is just out, you can grab it now. If you’re running any of the previous ones, I strongly recommend to check this one out. For the purpose of reporting bugs and getting 2.0.2-release in a month, if nothing else. Oh, and the book actually documents 2.0.1-beta too. How’s that for a combo?
Vladimir Fedorkov, Director of Professional Services speaking about Sphinx at 4Develpers conference in Warsaw, Poland on April 4th.
If you are looking for on-site consulting for the Sphinx on Poland this week – please contact us!
It is that time of year again, winter is slowly (too slowly for some) releasing its grip on spring and that means one thing… of course, the annual MySQL User Conference and therefore Sphinx will be in the San Francisco Bay Area the week of April 11-15th.