[Forum] re-indexing a big board and still processing after 36hrs, up to 50 million records indexed?

[sross]

Does this sound right? My db has doubled in size. My forum has 1.6 million posts. I am surprised it's still going and up to 50 million items, any idea how long this could go on a forum my size? Thanks

[Guest]

50 million words I think, so on average 30 words per post? Did you reindex through the command line? That is faster.

[sross]

I see.. I have it going via browser but it's run so long will just let it finish..

[Zachery]

For performance, sphinx would be better, and there are still third parties selling/licensing their sphinx search.

[sross]

Was running sphinx but have so much available server resource, and my members seem to like the way the vb search works better so I went back to vb search. It's still going, has indexed 110 million items so far, surely not much longer..

[Zachery]

Its the tradeoff. Sphinx is a million times better (efficiency wise) than vBulletin can ever be. Sphinx is a product build to provide search data.

Is there a how to for Sphinx?

[sross]

I'm now at 150 million items indexed, hope it's not stuck in some weird endless loop and will eventually stop indexing

[Mark.B]

Digital Point sells a low cost, very effective Sphinx search plugin. Obviously you need Sphinx installed on the server.

https://marketplace.digitalpoint.com...tin-4.870/item

Obviously, you use third party products at your own risk.

Woops, noticed now I'm in vB4 group. vb5 has the plugin already, correct?

[Wayne Luke]

I'm now at 150 million items indexed, hope it's not stuck in some weird endless loop and will eventually stop indexing

What are you counting as an index item?

[sross]

What are you counting as an index item?

I could be wrong on that being the meaning of what I'm seeing, just going by what the page says. it says "Building Search Index Null Type 152000000 :: 250" increments upwards every 0.01 seconds.

[Wayne Luke]

Doesn't seem right. I'd cancel it and try some searches. There isn't a null content type in the system.

[sross]

I have cancelled it. it went up to 178 million and kept going. Looking at my db dumps this endless loop did not seem to increase db size. Searches seem ok at this point.

[Guest]

Try to redo it through the command line!