The file looks similar to this:
<?xml version="1.0" encoding="ISO-8859-1"?> <searchspiders> <spider ident="https://www.almaden.ibm.com/cs/crawler"> <name>Almaden Crawler</name> <info>https://www.almaden.ibm.com/cs/crawler/</info> <email>[email protected]</email> </spider> <spider ident="Ask Jeeves"> <name>AskJeeves</name> </spider> <spider ident="Googlebot"> <name>Google</name> </spider> <spider ident="Mediapartners-Google"> <name>Google AdSense</name> <info>https://www.google.com/adsense/faq</info> <email>[email protected]</email> </spider> Place additional spiders here! </searchspiders>
At the minimum, you should provide the ident attribute and the name tag. Other tags are simply for your information and not used. The ident attribute is used to distinguish a regular guest from a spider. The value of this attribute is looked up in the browsing user's user agent (what the user's browser identifies him/her as). If a match is found, the value of the name tag is displayed on Who's Online.