[Forum] rebuild search index

[chrishales]

we have a site with >1,000,000 posts

the rebuild search index never works properly, i let it run for 12 hours then it killed the cpu and I had to reboot.

Has anyone else had the same issue.

[Wynand]

Anyone can have this issue, this is a pretty heavy process (as your CPU found out as well). Make sure you are using an optimized mysql installation and do this off-peak. I've got a vB board with about a milion posts as well, but I'm not considering to rebuild the search index unless I'd have to. For what reason are you rebuilding it?

[Dody]

I rebuilt the search index for nearly a 2 mio posts and it worked fine (it tooks 7 hours)

[Wynand]

It really depens on your server configuration and optimalisation done on it (or not). Comparing the amount of hours it took is pretty much pointless.

[chrishales]

well the reason is simple after upgrading to 4.0 you have to.

Dody did you have the boards open while you rebuilt the search engine?

[Dody]

Dody did you have the boards open while you rebuilt the search engine?

It was on a test database, so almost as close (no activity at all). And yes it really depends on your server, as I have a dedicated server that can handle 4 times my current busy-forum.

[chrishales]

We are having an impossible time rebuilding the search index.

-the index is about 1,200,000 posts and it usually hangs around 400,000

-we have tried to restart it at index 400,000 and it will still hang the server

-we also closed the boards and tried but it eventually times out.

Please direct us as to what we are doing wrong?

Also can we run a sql query right from the server to avoid using http to rebuild the index?

[punchbowl]

Great! Another reason why I can't upgrade to vb4.

[meissen]

Yeah, we found out the hard way that once you upgrade to vb4 your search index is completely broken and won't find any of the pre-vb4 posts.

[MaurícioSB]

We are having an impossible time rebuilding the search index.

-the index is about 1,200,000 posts and it usually hangs around 400,000

-we have tried to restart it at index 400,000 and it will still hang the server

-we also closed the boards and tried but it eventually times out.

Please direct us as to what we are doing wrong?

Also can we run a sql query right from the server to avoid using http to rebuild the index?

I was wondering ...
Why not keep an exact copy of your forum off the web, and perform the task in the local copy?
Maybe you still have to close the forum for a few hours, but after making the reconstruction of the index locally, in total security, you could restore the database copy on the web and reopen the forum.
What do you think?

[chrishales]

well thanks for the tip Mauricio. the db backup takes 1-2 hours to about 4 gig then transfer to local server then restore the reindex then compress then upload to live server, it would literally take days

Does anyone know if we can run a query to reindex right from the server?

[ampersand]

any more news on this ?

[chrishales]

well we went to www.urljet.com which is the best vbulletin host ever, they helped us and got it reindexed and we are back on line

[syrus.xl]

I have a custom VPS with URLJet, and I even left my board open while doing the search reindexing - never had any issues, but my server configuration is highly tweaked. It depends highly on your hardware/server configuration.

[RaSa]

Did you try this?

http://www.vbulletin-germany.com/for...l=1#post294160