I remember reading somewhere that for vB4, the engine search engine process and storage features were rewritten to work better with large forums. Unfortunately, I do not remember where I read this. I am curious to see if the new vB4 search is capable of working with larger forums (15 million+ posts) or if I have to look for another solution like I am currently using with 3.8.4?
vB4 Search Engine
Collapse
X
-
vB 4.0 is just the first step, I advice you to stick around and wait. Newer versions and updates will bring a better searching functionality and others.while(true){
if($someone->needsHelp() && $i->canHelp()) $post->help();
if($i->findBug()) $post->bug();
}
-
True... but that doesn't help me now if I want to upgrade from 3.8.4 to 4.0. If 4.0 can't do the searching, I'll have to hack together another way of doing it like I am doing now.Comment
-
Search was rewritten. The primary focus was getting search out of the content tables and into its own indexed tables. This allows you to switch your post and thread tables to a system like INNODB and remove the table level locks on them. Removing the locks also allows more writes to happen. Another change is that the search interface is completely modular so a new interface can be plugged into the system easier if need be. As Internet Brands converts their larger forums, I am sure additional refinements and features will be added.
This blog goes over some of the issues: http://www.vbulletin.com/forum/entry...nges-in-vB-4-0Translations provided by Google.
Wayne Luke
The Rabid Badger - a vBulletin Cloud demonstration site.
vBulletin 5 APIComment
-
Wayne,
I know you're hesitant to give out details, but there are a lot of big-boarders out there who are anxious to know what to do. 4.0 looks great, but counting on mysql to search just doesn't cut it. For example I just searched vb.com for 'sphinx' and the search took over 31 seconds. With 2,000 members online at once, I can't imagine how such searches would be useable on our board.
So, I guess the question is... should we get to work porting Sphinx over to 4.0, or should we wait for a future point release of VB? If VB has no intention of incorporating Sphinx or other workable search, we'd better get to work on our end. We've been with VBulletin for 10 years and are dying to upgrade to 4.0 - but since 2007 have completely relied on Sphinx to make VBulletin a usable product.Comment
-
Search was rewritten. The primary focus was getting search out of the content tables and into its own indexed tables. This allows you to switch your post and thread tables to a system like INNODB and remove the table level locks on them. Removing the locks also allows more writes to happen. Another change is that the search interface is completely modular so a new interface can be plugged into the system easier if need be. As Internet Brands converts their larger forums, I am sure additional refinements and features will be added.
This blog goes over some of the issues: http://www.vbulletin.com/forum/entry...nges-in-vB-4-0
Wayne,
I know you're hesitant to give out details, but there are a lot of big-boarders out there who are anxious to know what to do. 4.0 looks great, but counting on mysql to search just doesn't cut it. For example I just searched vb.com for 'sphinx' and the search took over 31 seconds. With 2,000 members online at once, I can't imagine how such searches would be useable on our board.
So, I guess the question is... should we get to work porting Sphinx over to 4.0, or should we wait for a future point release of VB? If VB has no intention of incorporating Sphinx or other workable search, we'd better get to work on our end. We've been with VBulletin for 10 years and are dying to upgrade to 4.0 - but since 2007 have completely relied on Sphinx to make VBulletin a usable product.Comment
-
Does 4.0.1 bring any new insights to what search can do for big forums?Comment
-
I found this very interesting. I have used my own search engine for years. So I would really like to see an easier way to use another search engine without having to make dozens of template edits. What would be nice is to be able to have a few entries in the Admin CP that would allow us to substitute custom url's for search items like theses:
1) Find all Posts by user
2) Find all Threads by user
3) Search Forum
4) Search Thread
Thank you.Comment
-
I'm as well dependent on either Sphinx for vb4 or a decent solution for search on big boards for vb4 in a future release.
Regarding Sphinx there was a promising statement made by Kevin Sour in a recent developer chat which seems to be overlooked so far:
We have a sphinx search working in house here at IB. Its not yet ready to release to the wild, but we do have plans to clean it up and get it out there in some form.
It would be very nice to get any update on this.Comment
-
According to this dev chat, you had a sphinx search plugin working in November, and now three months later it's still not cleaned up and released?
Do you not realize how critical fast searching is for a lot of us? It turns a forum that requires split db servers (to isolate slow search queries) into a forum that works well on a single server with modest hardware, because the search is blazing fast and doesn't slow down everything else.
The lack of sphinx search integration is the primary reason I haven't upgraded to vb4. I don't want to put effort into updating the existing sphinx hack only to have you release an officially supported vb4 sphinx solution soon after.
Please release the sphinx search module already.
Thanks.Comment
-
According to this dev chat, you had a sphinx search plugin working in November, and now three months later it's still not cleaned up and released?
Do you not realize how critical fast searching is for a lot of us? It turns a forum that requires split db servers (to isolate slow search queries) into a forum that works well on a single server with modest hardware, because the search is blazing fast and doesn't slow down everything else.
The lack of sphinx search integration is the primary reason I haven't upgraded to vb4. I don't want to put effort into updating the existing sphinx hack only to have you release an officially supported vb4 sphinx solution soon after.
Please release the sphinx search module already.
Thanks.Comment
-
I'm sorry, but after not even a 'boo' from any vb staff in reply to any of our queries I'm about to jump ship. Which is sad after 10 years with vb
Comment
-
I'm in the boat too... I purchased vB4 with the assumption that it would work for my needs. Sadly, it looks like I have been mistaken. Month old promises without any word on a real solution are doing nothing but pushing me to find another piece of software, especially since right now I have a license for a piece of software I can't use for anything more than a paperweight.Comment
-
For those that asked, the default vB4 search isn't acceptable for a "big board". We upgraded on Saturday and the process that goes through and reindexes old posts is still running (it's been running 5 days now).
Some of the simplest searches take a few minutes to run. Then on top of that, when those queries are running, it locks up the replication thread on the slave server doing the query (see this post/example). A search that causes the entier site to only be as up to date as when the search started (for all users) isn't really that good.
I wish someone would get Sphinx working with vB4 so I don't have to do it myself.Sphinx Search for vBulletin 4: https://marketplace.digitalpoint.com...tin-4.870/item
Someone send me a message on Twitter when this site is usable again. https://twitter.com/digitalpointComment
widgetinstance 262 (Related Topics) skipped due to lack of content & hide_module_if_empty option.
Comment