Register Members List Search Today's Posts Mark Forums Read

Reply
 
Thread Tools
  #661  
Old 10 Mar 2009, 18:23
amcd amcd is offline
 
Join Date: Oct 2004
because it returns only 500 results?
__________________
eXBii.com - Indian community
no XB no fun know XB know fun !
Reply With Quote
  #662  
Old 11 Mar 2009, 13:03
Simetrical Simetrical is offline
 
Join Date: Nov 2006
So you're saying that if the number of results is limited, they won't be sorted by date before they're limited, but after? Is there any way to fix that? Alternatively, if I just increase max_matches to 2000 or something, that's probably not going to be a big problem, right?
Reply With Quote
  #663  
Old 11 Mar 2009, 15:09
amcd amcd is offline
 
Join Date: Oct 2004
I really don't know. I am just thinking aloud.
__________________
eXBii.com - Indian community
no XB no fun know XB know fun !
Reply With Quote
  #664  
Old 22 Mar 2009, 09:54
Spinball's Avatar
Spinball Spinball is offline
 
Join Date: Feb 2002
Just wanted to post a note here to thank the folks who pointed me to Floren Munteanu's Sphinx solution which is now installed at www.AVForums.com.
I was so impressed that I made a video at http://www.youtube.com/watch?v=zJkVHcqfEBQ (choose the HD version).
Thanks, guys.
__________________
AVForums.com the UK's largest audio visual home consumer electronics forums. Now using Xenforo because vB5 is not suitable for large forums and vB3 and vB4 are no longer being developed.

Last edited by Spinball; 22 Mar 2009 at 19:45.
Reply With Quote
  #665  
Old 22 Mar 2009, 14:07
mlx's Avatar
mlx mlx is offline
 
Join Date: Jan 2002
Originally Posted by Spinball View Post
I was so impressed that I made a video at http://www.youtube.com/watch?v=WIdsOA_hFpM (choose the HD version).
Thanks, guys.
LOL unless you are too stupid to setup a cronjob correctly it's plain and simple wrong that the search index only updates every day using the free solution.
Reply With Quote
  #666  
Old 22 Mar 2009, 16:58
Spinball's Avatar
Spinball Spinball is offline
 
Join Date: Feb 2002
Originally Posted by mlx View Post
LOL unless you are too stupid to setup a cronjob correctly it's plain and simple wrong that the search index only updates every day using the free solution.
Ok it was every day when I last used it. Have things changed since then? Apologies if so. Please let me know and I will change the video.
As I understand it, though the Sphinx reindex in the free solution was quite server intensive and took a while?
(By the way there is need to be offensively defensive about the free solution - we used it for ages and I'm not running down the efforts that people have put in for free).
__________________
AVForums.com the UK's largest audio visual home consumer electronics forums. Now using Xenforo because vB5 is not suitable for large forums and vB3 and vB4 are no longer being developed.
Reply With Quote
  #667  
Old 22 Mar 2009, 17:11
snakes1100 snakes1100 is offline
 
Join Date: Dec 2001
Real name: Anthony
You set the cron to run when you want it to run, it was never locked to 1 day that i was aware of and i've ran it since the first free release here.

Server "intensive", that would depend on your hardware.
Reply With Quote
  #668  
Old 22 Mar 2009, 17:17
mlx's Avatar
mlx mlx is offline
 
Join Date: Jan 2002
Originally Posted by Spinball View Post
Ok it was every day when I last used it. Have things changed since then? Apologies if so. Please let me know and I will change the video.
As I understand it, though the Sphinx reindex in the free solution was quite server intensive and took a while?
(By the way there is need to be offensively defensive about the free solution - we used it for ages and I'm not running down the efforts that people have put in for free).
Sure, re-indexing all configured indexes will take some time and might be quite server intense on a database with millions of posts. So are you saying that the paid solution is running "indexer --all --rotate" to re-index all configured indexes every 20 minutes in no time?

Or is it updating the delta indexes every 20 minutes pretty much as described here in 2007?
Reply With Quote
  #669  
Old 22 Mar 2009, 19:04
Spinball's Avatar
Spinball Spinball is offline
 
Join Date: Feb 2002
Originally Posted by mlx View Post
Sure, re-indexing all configured indexes will take some time and might be quite server intense on a database with millions of posts. So are you saying that the paid solution is running "indexer --all --rotate" to re-index all configured indexes every 20 minutes in no time?

Or is it updating the delta indexes every 20 minutes pretty much as described here in 2007?
Honestly I don't know. And that's the point, really. The wife and me own our forums and with the development, marketing and admin jobs I do, I plain don't have the time to understand the details of the search, either the free one here or the paid one. That's why I paid someone else to sort it all out for me.
All I know is that the indexes are updated every 10 minutes and the load on the servers is not significant.
In the free solution running on our forums, it was reindexing every day because that's how I set it up based on what information I could get out of this thread a few months ago. Maybe it wasn't set up as optimally as it could, but then that's because I found this thread to be a bit overwhelming and the instructions a bit complex. Least ways that's how I felt about it.
Most forum admin are not programmers or database experts, or particularly want to be, I would imagine. Or, in many instances, have the funds to pay someone else to do it.

That's why the free plugins released here which install with zero technical ability are so popular.
__________________
AVForums.com the UK's largest audio visual home consumer electronics forums. Now using Xenforo because vB5 is not suitable for large forums and vB3 and vB4 are no longer being developed.
Reply With Quote
  #670  
Old 22 Mar 2009, 19:17
mlx's Avatar
mlx mlx is offline
 
Join Date: Jan 2002
I see.

Still ... the point is that the free solution can be setup the same way. Our search index is updating every 5 minutes without any significant load too. Rebuilding all indexes is a totally different thing. That setup is totally based on the free information within this thread.

That's probably the reason for the slightly offensive post earlier today ... sorry for that
Reply With Quote
  #671  
Old 22 Mar 2009, 19:45
Spinball's Avatar
Spinball Spinball is offline
 
Join Date: Feb 2002
Originally Posted by mlx View Post
I see.

Still ... the point is that the free solution can be setup the same way. Our search index is updating every 5 minutes without any significant load too. Rebuilding all indexes is a totally different thing. That setup is totally based on the free information within this thread.

That's probably the reason for the slightly offensive post earlier today ... sorry for that
No problem . Still the search keyword suggestions are cool, don't you think? Some useful info there for marketing purposes also.
__________________
AVForums.com the UK's largest audio visual home consumer electronics forums. Now using Xenforo because vB5 is not suitable for large forums and vB3 and vB4 are no longer being developed.
Reply With Quote
  #672  
Old 23 Mar 2009, 13:38
Simetrical Simetrical is offline
 
Join Date: Nov 2006
Originally Posted by Spinball View Post
Just wanted to post a note here to thank the folks who pointed me to Floren Munteanu's Sphinx solution which is now installed at www.AVForums.com.
I was so impressed that I made a video at http://www.youtube.com/watch?v=zJkVHcqfEBQ (choose the HD version).
Thanks, guys.
I'm curious, did he suggest that you post here?
Originally Posted by Spinball View Post
Ok it was every day when I last used it. Have things changed since then? Apologies if so. Please let me know and I will change the video.
As I understand it, though the Sphinx reindex in the free solution was quite server intensive and took a while?
No. I run it every hour and don't even notice the load, either from indexing or from searching. I could probably run it every five minutes with no problem.
Originally Posted by Spinball View Post
(By the way there is need to be offensively defensive about the free solution - we used it for ages and I'm not running down the efforts that people have put in for free).
I think people are not so much defensive about the free solution as annoyed at TECK for continually advertising his paid solution for personal profit in a thread devoted to the free solution. He had a bunch of posts in this thread deleted some time ago for advertising, and since then you're the second or third person to bump the thread and e-mail everyone watching it to advertise his solution as well.

Nothing wrong with paid solutions for those who have trouble with the free ones, but I don't think this is the place to repeatedly advertise them, which is what's been happening in this thread over the past few months. It's off-topic, this thread is about the free hack. People can put this stuff in their signatures if they want to advertise it, or run Google ads, or mention it as an option when they're giving free help or otherwise posting on-topic.
Reply With Quote
  #673  
Old 23 Mar 2009, 14:15
Spinball's Avatar
Spinball Spinball is offline
 
Join Date: Feb 2002
Originally Posted by Simetrical View Post
I'm curious, did he suggest that you post here?

No. I run it every hour and don't even notice the load, either from indexing or from searching. I could probably run it every five minutes with no problem.

I think people are not so much defensive about the free solution as annoyed at TECK for continually advertising his paid solution for personal profit in a thread devoted to the free solution. He had a bunch of posts in this thread deleted some time ago for advertising, and since then you're the second or third person to bump the thread and e-mail everyone watching it to advertise his solution as well.

Nothing wrong with paid solutions for those who have trouble with the free ones, but I don't think this is the place to repeatedly advertise them, which is what's been happening in this thread over the past few months. It's off-topic, this thread is about the free hack. People can put this stuff in their signatures if they want to advertise it, or run Google ads, or mention it as an option when they're giving free help or otherwise posting on-topic.
Ok I understand your point completely and I want to stress that I made my own mind up to thank the people who directed me towards the other solution. I posted here merely cos I was so enthusiastic and maybe I let that get the better of me.
I understand also that you would get annoyed at someone pimping their solution and I don't want to be accused of being associated with that so I will not post in here any more about it.
If you could reindex every 5 minutes then I would suggest that you do. Seems to me that users will want their posts to appear in the search ASAP.
__________________
AVForums.com the UK's largest audio visual home consumer electronics forums. Now using Xenforo because vB5 is not suitable for large forums and vB3 and vB4 are no longer being developed.
Reply With Quote
  #674  
Old 23 Mar 2009, 14:26
Simetrical Simetrical is offline
 
Join Date: Nov 2006
Ah, it looks like it's actually every 20 minutes that I have the deltas built. No one's ever complained that it takes 10 minutes on average for their posts to appear in the index, so I'm fine with leaving it as it is.

It takes under 200 ms for rotate.sh to run, so actually I could probably run it every minute if I really felt like it.
Reply With Quote
  #675  
Old 24 Mar 2009, 11:24
TECK's Avatar
TECK TECK is offline
 
Join Date: Dec 2001
Real name: Floren Munteanu
Originally Posted by mlx View Post
Sure, re-indexing all configured indexes will take some time and might be quite server intense on a database with millions of posts. So are you saying that the paid solution is running "indexer --all --rotate" to re-index all configured indexes every 20 minutes in no time?

Or is it updating the delta indexes every 20 minutes pretty much as described here in 2007?
If you do an "indexer --all --rotate" every 20min, you will blow your servers. It takes in average 20-30min to rebuild the indexes from scratch on a 10GB database. In my product, the indexes are updated every 10min, regardless of the database size. It takes in average 30sec-1min to refresh the data, all the time with no "indexer --all --rotate" commands used ever. Of course, that includes the threads/posts that were deleted or edited. What is the point to store a deleted post into indexes. Not to mention that if you edit the contents of a post, the deleted keywords should not be available into search. When you rebuild the indexes, all "errors" are gone... but that occurs every 24hrs for the vB.org product.

Also, I don't know if you consider this advertising... because I don't. It is a logical explanation on how my system works. It is like talking about Community Server at vBulletin... yet I don't see anyone chasing the people who reply about an open asked question related to their product and replied by one of their reps.
__________________
Floren Munteanu
Axivo Inc.
Axivo Community - Visit the forums to find out more about us
Why Queued - My personal blog
Reply With Quote
Reply



Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off


New To Site? Need Help?

All times are GMT. The time now is 03:32.

Layout Options | Width: Wide Color: