Register Members List Search Today's Posts Mark Forums Read

Reply
 
Thread Tools
  #16  
Old 02 Oct 2006, 09:50
orban orban is offline
 
Join Date: Jan 2005
Mind sharing the patch and maybe your implementation in vB? Or at least outlining it?

Would be nice...!

Last edited by orban; 02 Oct 2006 at 09:54.
Reply With Quote
  #17  
Old 02 Oct 2006, 16:32
mute mute is offline
 
Join Date: Dec 2002
orban, what kind of changes do i need to make to my search.php to have it search both the main and delta index?

Prior to setting up the delta index on my end, I noticed that I could search for words in post bodies and not return results, but if I look in my query.log I would see many many results.
Reply With Quote
  #18  
Old 02 Oct 2006, 16:38
orban orban is offline
 
Join Date: Jan 2005
mmmmm

you don't have to modify search.php, create a fake index that contains the two other indices.
Reply With Quote
  #19  
Old 02 Oct 2006, 16:40
mute mute is offline
 
Join Date: Dec 2002
hm ok, i think my config just might be a bit goofy. On my dev board, I created a new post after creating all 4 indexes. Anyway, my test post had a made up word in it, and after I posted I reran the delta updates, saw them pick up one doc, but I don't get any results returned if I use the "search" tool with sphinx.

I'm going to double check my config now.
Reply With Quote
  #20  
Old 02 Oct 2006, 17:07
orban orban is offline
 
Join Date: Jan 2005
weird....

make sure the indexes get created (check the data files)
Reply With Quote
  #21  
Old 02 Oct 2006, 17:59
ubuntu-geek ubuntu-geek is offline
 
Join Date: Oct 2004
Originally Posted by orban
I know this is a bit ugly right now, but:

http://forums.mtgsalvation.com/search.php

Also the "Search This Forum" is using Sphinx now.

"Search This Thread" and all queries using userids have to be done the old way for the moment until the new Sphinx version is released.

But I'm happy users can search our 1.4 million posts in <1sec again. Without crashing the server, locking any tables or anything.

When new version is out I'll finish the implementation and release it
New version of sphinx or vb? I really want to try this out.. searches are killing us.
Reply With Quote
  #22  
Old 02 Oct 2006, 18:03
orban orban is offline
 
Join Date: Jan 2005
sphinx
Reply With Quote
  #23  
Old 02 Oct 2006, 18:05
mute mute is offline
 
Join Date: Dec 2002
Hm. this is very strange. I have verified that my config is the same as yours (minus the names of the indexes), and have emptied my sphinx_counter table, nuked all my indexes, and rebuilt.

[root@db2 var]# /home/httpd/sphinx/bin/search -c /home/httpd/sphinx/etc/sphinx.conf purple
Sphinx 0.9.6
Copyright (c) 2001-2006, Andrew Aksyonoff

- loaded 591 stopwords from '/home/httpd/sphinx/etc/sphinx.stopwords'
index 'vbpostidx': query 'purple ': returned 0 matches of 0 total in 0.000 sec
- loaded 591 stopwords from '/home/httpd/sphinx/etc/sphinx.stopwords'
index 'vbpostdeltaidx': query 'purple ': returned 0 matches of 0 total in 0.000 sec
- loaded 591 stopwords from '/home/httpd/sphinx/etc/sphinx.stopwords'
index 'vbthreadidx': query 'purple ': returned 0 matches of 0 total in 0.000 sec
- loaded 591 stopwords from '/home/httpd/sphinx/etc/sphinx.stopwords'
index 'vbthreaddeltaidx': query 'purple ': returned 0 matches of 0 total in 0.000 sec

I broke something, but I don't know what

Ah, I found the problem I think.

For whatever reason, on my initial index, despite having used --rotate, it is leaving *new* index files in my var dir:

[root@db2 var]# ls -la *new*
-rw-r--r-- 1 root root 1356935444 Oct 2 13:39 vbpost.new.spd
-rw-r--r-- 1 root root 10644727 Oct 2 13:39 vbpost.new.spi
-rw-r--r-- 1 root root 54322284 Oct 2 13:42 vbthread.new.spd
-rw-r--r-- 1 root root 879893 Oct 2 13:42 vbthread.new.spi

Sphinx won't search against these, but I'm not sure why they didn't roll over.

Last edited by mute; 02 Oct 2006 at 18:11. Reason: Automerged Doublepost
Reply With Quote
  #24  
Old 02 Oct 2006, 18:30
orban orban is offline
 
Join Date: Jan 2005
Yeah I don't have .new. ones, just .old. ones.

Permissions?
Reply With Quote
  #25  
Old 02 Oct 2006, 19:07
mute mute is offline
 
Join Date: Dec 2002
It is what I believe a bug in sphinx. If you start searchd w/ no indexes preexisting, then index with --rotate, it won't rotate. The solution is to stop searchd, nuke everything, index, then start searchd.

It took me a while to figure it out, I'm not sure why it isn't smart enough to see that there aren't preexisting indexes when searchd tries to rotate.
Reply With Quote
  #26  
Old 02 Oct 2006, 19:11
orban orban is offline
 
Join Date: Jan 2005
Oh

Yeah I did the first index without searchd started.

Report it so it can be fixed
Reply With Quote
  #27  
Old 02 Oct 2006, 20:46
ubuntu-geek ubuntu-geek is offline
 
Join Date: Oct 2004
I was just curious is your search_sphinx.php posted a few threads back the most current one? or have you made more adjustments?
Reply With Quote
  #28  
Old 02 Oct 2006, 20:54
mute mute is offline
 
Join Date: Dec 2002
Just an FYI, make sure you limit access to that search on your dev boxes if you don't potentially want people searching for info in your private forums

I guess now we just get to wait patiently for 0.9.7 to come out...

Last edited by mute; 02 Oct 2006 at 20:56. Reason: Automerged Doublepost
Reply With Quote
  #29  
Old 02 Oct 2006, 20:59
orban orban is offline
 
Join Date: Jan 2005
What you mean? Other users with ssh access?

Yeah or kmike can share his patch http://www.vbulletin.org/forum/showp...2&postcount=21


Last edited by orban; 02 Oct 2006 at 21:02.
Reply With Quote
  #30  
Old 02 Oct 2006, 21:14
ubuntu-geek ubuntu-geek is offline
 
Join Date: Oct 2004
Originally Posted by mute
Just an FYI, make sure you limit access to that search on your dev boxes if you don't potentially want people searching for info in your private forums

I guess now we just get to wait patiently for 0.9.7 to come out...
Not sure what you mean. It seems the permission system works on private/non private when doing searches with sphinx.
Reply With Quote
Reply



Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off


New To Site? Need Help?

All times are GMT. The time now is 13:44.

Layout Options | Width: Wide Color: