[Forum] Rebuilding search index

[Greeksgal]

Can I do this whilst my forum is online and people are posting etc? I should have done it after I upgraded but it was taking forever so I stopped it midway, now obviously search isn't working very well so it needs to be done but I have a large forum and anticipate it taking a very long time, i.e. an overnight job. I don't want the forum offline for that long so would I be ok leaving it online and rebuilding at the same time?

Thanks

[Lynne]

It kinda depends on your server hardware. I rebuilt mine on my test site while my live site was running (several hours and about 800K posts) and digitalpoint rebuilt his live site's search index while his site was live (took several days - over 13M posts I think?). I can't remember everyone else's stats, but I don't recall hearing of anyone keeping the site shut down while they rebuilt it.

[Greeksgal]

Thanks Lynne, I'll give it a go then

[digitalpoint]

You definitely can keep your site online/publicly accessible while rebuilding search indexes.

[Zachery]

I've done two in under an hour 200k posts and 750k posts.

[digitalpoint]

Not sure what sort of crazy DB setup you have, but definitely not that fast for me. Was ~7 days, 24 hours a day for 13.5M posts... drives all 15k rpm SCSI drives, etc. Forum *was* open to he public though, so I'm sure that slowed the indexing down.

All kind of moot now though... Sphinx can index all 13.5M posts in 9 minutes flat. 10,000+ minutes vs. 9.

[Riasat]

is there someway to do it so that the browser can be closed?

[digitalpoint]

is there someway to do it so that the browser can be closed?

Yes, if you download vBulletin 4, then use the searchshell.php script within the do_not_upload directory, you can run it from a shell and rebuild your vBulletin 3 search indexes. lol

That is not a typo btw... vBulletin 4 comes with a shell script to rebuild search indexes for vB3.

[Riasat]

Yes, if you download vBulletin 4, then use the searchshell.php script within the do_not_upload directory, you can run it from a shell and rebuild your vBulletin 3 search indexes. lol

That is not a typo btw... vBulletin 4 comes with a shell script to rebuild search indexes for vB3.

it can come with vB 1.5 search index rebuild script as long as it works

thanks for the info.

[digitalpoint]

it can come with vB 1.5 search index rebuild script as long as it works

thanks for the info.

Agreed... except it doesn't work unless you are running vB3.

[Riasat]

Agreed... except it doesn't work unless you are running vB3.

wth...


anyways, sphinx is still recommended?
if so, is there any guide about Sphinx on vB4.x?
(i cudn't find any)

[Zachery]

Not sure what sort of crazy DB setup you have, but definitely not that fast for me. Was ~7 days, 24 hours a day for 13.5M posts... drives all 15k rpm SCSI drives, etc. Forum *was* open to he public though, so I'm sure that slowed the indexing down.

All kind of moot now though... Sphinx can index all 13.5M posts in 9 minutes flat. 10,000+ minutes vs. 9.

Oldish hardware, 10k RPM SA-SCSI drive dedicated to just mysql though. Site wasn't overly loaded during rebuilding, im sure it would have taken longer if the site was busier.

[wynode]

Thought I'd post back here for those interested.

On a site with around 1.4Million posts, I tried the shell script but that didn't do much. It ran and finished in a couple of minutes which I thought was strange. So instead resorted to running it via the Web (Admincp -> Update Counters -> Rebuild Search Index).

This took around 8-9 hours to complete and when I returned the following error was up:

Database error in vBulletin 4.0.2:

Invalid SQL:
SELECT u.username, n.userid, a.contentid,
a.pagetext, i.title, n.publishdate, i.creationdate, i.html_title, n.nosearch
FROM cms_article a
LEFT JOIN cms_node n on n.contentid = a.contentid
LEFT JOIN cms_nodeinfo i on i.nodeid = n.nodeid
LEFT JOIN user u on u.userid = n.userid
WHERE a.contentid = 0 AND n.contenttypeid =;

MySQL Error : You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '' at line 7
Error Number : 1064
Request Date : Sunday, April 4th 2010 @ 07:41:13 PM
Error Date : Sunday, April 4th 2010 @ 07:41:14 PM
Script : http://www.mystie/forum/admincp/misc...0&indextypes=0
Referrer : http://www.mysite.com/forum/admincp/...0&indextypes=0
IP Address : myIP
Username : myusername
Classname : vB_Database
MySQL Version : xxxxx-community

The CMS is disabled however I've assumed that all the indexes were rebuild OK (?)

[George L]

could be same error as http://www.vbulletin.com/forum/showt....contenttypeid ?

might want to log the error in bug tracker

[wynode]

could be same error as http://www.vbulletin.com/forum/showt....contenttypeid ?

might want to log the error in bug tracker

Done. Thanks.