Problem with vb search

[Wayne Luke]

If you manage your own server or Virtual Machine, you might want to look into using Sphinx Search. This is an alternative search engine for vBulletin and allows greater flexibilty without editing vBulletin's files. Then you can edit the stopword or common word list for it so keyword searches work better for you.

http://sphinxsearch.com/docs/current/conf-stopwords.html

[Actron]

Yes it's great for a normal forum.... but i am one of the 10%
The only thing is that i don't know which word are listet under common words... i will see it only after posting... so i have to rebuild the search index every time again... and it take a long time with over 31'000 topics and 44'000 posts (fast growing).
A cool option for vb5 are, when there is an option to switch on common words for indexing by search. It will fit to 100% to your english (and oder language) customers

[Wayne Luke]

Those are all common English words and typically provide no value if they are indexed. Your best bet is to add them to the word list. Maintaining a list of "bad words" for searching is a common practice. Search is often the most performance intensive function of a website and steps have to be put into place to control this. The word list probably works for 90% of our English customers, our largest customer base. The option is there if it doesn't work for you so you can add the words you need. It will hold 16 Million characters so you can probably add all the words you need.

[Actron]

Here are a small word list they will not be found on VB if i don't add it to "Words to include": next, your, with, all, first, take, off, something, name, see, ....

[Wayne Luke]

What words?

[Actron]

Ok thanks a lot. Finally the problem is fixed!
But i still don't know why some words not will be indexed from beginning? Where are this words listet? These words can't be listet in bad words... because after remove it from badwords i recreate the search index....

[Wayne Luke]

Yes. Every time you change the settings for the search, you have to rebuild the search engine. Otherwise, only new content will be indexed with the changes.

[Actron]

Thanks for your answer.
But when i add this word, it search for "next" but don't find something.... but i know there is a post with this word. Have i to recreate search index again?

*edit* New posts with the word next will be found... but not the old one... so i have to recreate seachindex... again

[Wayne Luke]

But you can simply add that word in the "Words to include" box within the AdminCP under Settings -> Options -> Message Searching Options.

You shouldn't edit the badwords.php file. We're just going to remove your changes the next time you upgrade. Then if you rebuild the search index, the changes will be overwritten.

[Actron]

Because we have something like a movie database. Some movie titels include this words.... so it's impossiple to find the movie "Next" in title on vb. Thats why i will add some words to the search index.

[Wayne Luke]

Ok i rebuild the search index after remove all word in "badwords.php". Now most words will be found..... but i have some words thei will not show up in database (query) and when i search in vb.... here are a cupple of words i can't find in vb search: next, your, youre, with, all
Where are this words listet?? How can i add this words??

Why would you want to? youre isn't a valid word. None of the words in the badwords.php file add value to a search. The system does not do natural language searches.

[Actron]

Ok i rebuild the search index after remove all word in "badwords.php". Now most words will be found..... but i have some words thei will not show up in database (query) and when i search in vb.... here are a cupple of words i can't find in vb search: next, your, youre, with, all
Where are this words listet?? How can i add this words??

*edit* I change word "spieß" to "spies" in database... now de word will be found.

[Wayne Luke]

*edit* I remove "the" from the badword list. Try to search this word in forum... but no match.

You would have to rebuild the searchindex after every edit to this file.

[Actron]

It don't work... same problem after rebuild search index. Only Word ID has change after i do a query to "spies". Is it possible to add it manual? Or is there another solution?

*edit* I remove "the" from the badword list. Try to search this word in forum... but no match.

[delicjous]

This seems to be not a problem with special characters because there aren't any of it in your search-words bad or spies. Try to change local in your german language to de_DE.utf-8, rebuild your search-index and try to search again.
There is a problem with rebuild search-index with special characters and non utf-8 locals. de_DE is using iso in common and the local is not set as utf-8 in some cases.


You should use the sql:

select * from words where word = 'spies'

because 'like' perhaps a problem if special characters in your table.