PDA

View Full Version : Sphinx search BETA for vBulletin 4.0 speed issue


ivanp
04 Oct 2010, 11:23
Hi,

We've installed Sphinx search BETA for vBulletin 4.0:
http://www.vbulletin.com/forum/showthread.php?350427-Sphinx-search-BETA-for-vBulletin-4.0

main_norotate.sh took more than 12 hours for 15 million posts.

When started delta_norotate.sh, it brought forum to its knees. The reason is 'thread' table locking because it is MyISAM type. So we changed sql_range_step from 10000000 to 128 to avoid table locking. delta_norotate.sh still haven't finished after 16 hours, and it is supposed to run every 10 minutes :(

'thread' table is MyISAM because it has FULLTEXT index 'titles' used for similar threads generation. Is it safe to remove this index and convert it to InnoDB, if Sphinx search BETA for vBulletin 4.0 has this functionality built in?

Also I am worried about slow Sphinx indexing speed. Didn't have such problem using Orban's Sphinx implementation:
http://www.vbulletin.org/forum/showthread.php?t=127868

The complete indexing process took about 1 hour vs. 12 hours using the new one.

Please advise. Thanks.

coffee
20 Nov 2010, 00:20
Here is an update that may help (Reply No.4):

http://www.vbulletin.com/forum/showthread.php?350427-Sphinx-search-BETA-for-vBulletin-4.0&p=2075036&viewfull=1#post2075036