inktomisearch.com

[Hendy]

What do I have to do to stop them from searching through my board, was told to alter the robot txt but have no idea how to do it can anyone help?

Many thanks

[Aaow AnD wHiTe]

What is that? We had like 30 guests from there on our site :-S

[skytho]

Hello,

on vbulletin-germany.com, there was
the same topic at the moment, and they
posted the following description :

http://www.kloth.net/internet/bottrap

I hope, that is the information u requested

C u
thorsten

[Hendy]

Hello,

on vbulletin-germany.com, there was
the same topic at the moment, and they
posted the following description :

http://www.kloth.net/internet/bottrap

I hope, that is the information u requested

C u
thorsten

Getting to the point now where I will just have to close the board down, the cost at the end of the month would just be too high.

Does anyone know of a service people offer where I could pay them to stop them coming on my board, sadly not clever enough to do the above. thank u

[Floris]

Just make a .htaccess file to deny their hosts. They might show up on the whois online, but they won't get far nor make any data traffic by it.

[Joe]

Feel free to forward all inktomi bot's to my site, when Yahoo goes to Yatomi this fall you will be kicking yourself from letting them spider your site.

[Zenith]

Getting to the point now where I will just have to close the board down, the cost at the end of the month would just be too high.

Does anyone know of a service people offer where I could pay them to stop them coming on my board, sadly not clever enough to do the above. thank u

It's really quite simple to stop. Just put a text file in your html root called robots.txt and put in it...

User-agent: *
Disallow: /

But if you do don't expect your site to to be listed on search engines.

[Hendy]

It's really quite simple to stop. Just put a text file in your html root called robots.txt and put in it...

User-agent: *
Disallow: /

But if you do don't expect your site to to be listed on search engines.

How long do they stay on the board? not so bad if it's just a couple of days.

Thnak You

[Novadream]

Shouldn't you be happy that those robots are on your site making it popular? I would be more than happy to know HOW to get them on my site forever.

[Hendy]

Shouldn't you be happy that those robots are on your site making it popular? I would be more than happy to know HOW to get them on my site forever.

I have gone over my Bandwidth already as the site is mentioned on TV everyday and in the end you have to think is it worth the extra expense every month and even worse not knowing how much it is going to be.

[Novadream]

I have gone over my Bandwidth already as the site is mentioned on TV everyday and in the end you have to think is it worth the extra expense every month and even worse not knowing how much it is going to be.

You cant afford the bandwidth for 30 users on your site which would be a few pennies at the most....But you have no problem spending real cash advertising on TV?

None of that makes sense...

[Hendy]

You cant afford the bandwidth for 30 users on your site which would be a few pennies at the most....But you have no problem spending real cash advertising on TV?

None of that makes sense...

No it's just a small Fan site, it just hets mentioned each week on Telly, the if they continue all month then it would be loads more to pay out thats all.

Anyway I will leave it there thanks to eveyone who helped.

[svoec]

well inktomisearch.com has been crawling my site for over a week.

Luckily, They haven't caused any bandwith issues (yet)

I was about to ask if anyone knew what this bot was ... I know most of them, and this one didn't sound too familiar..

thanks

[I, Brian]

shoppingtelly -

I believe that this is the information you're looking for.

[aldamon]

shoppingtelly -

I believe that this is the information you're looking for.

I've created a robots.txt file, but inktomi is still trying to use the files I've blocked. Here is my robots.txt file:

User-agent: *
Disallow: /vbulletin/attachment.php
Disallow: /vbulletin/avatar.php
Disallow: /vbulletin/calendar.php
Disallow: /vbulletin/editpost.php
Disallow: /vbulletin/member.php
Disallow: /vbulletin/member2.php
Disallow: /vbulletin/memberlist.php
Disallow: /vbulletin/misc.php
Disallow: /vbulletin/moderator.php
Disallow: /vbulletin/newreply.php
Disallow: /vbulletin/newthread.php
Disallow: /vbulletin/online.php
Disallow: /vbulletin/poll.php
Disallow: /vbulletin/postings.php
Disallow: /vbulletin/printthread.php
Disallow: /vbulletin/private.php
Disallow: /vbulletin/private2.php
Disallow: /vbulletin/register.php
Disallow: /vbulletin/report.php
Disallow: /vbulletin/search.php
Disallow: /vbulletin/sendtofriend.php
Disallow: /vbulletin/threadrate.php
Disallow: /vbulletin/usercp.php
Disallow: /vbulletin/admin/
Disallow: /vbulletin/images/
Disallow: /vbulletin/mod/


GuestViewing Profile of a Forum Member08:57 AM 66.196.72.61GuestEditing Post08:56 AM 66.196.72.43GuestViewing FAQ08:49 AM 66.196.72.48GuestViewing Calendar day 2003-7-2308:48 AM 66.196.72.92GuestViewing Memberlist08:47 AM 66.196.72.62GuestViewing Thread in-vivo/in-vitro correlation08:57 AM 134.2.68.160GuestQuoting Post in Thread Dissolution Calculations08:56 AM 66.196.72.85GuestViewing Profile of a Forum Member08:56 AM 66.196.72.52GuestReporting a Post08:49 AM 66.196.72.41GuestReplying to Thread Dissolution Calculations


?????