inktomi spider

[jacobi]

if you want to ban IP's completely from your forum and you use apache.

Edit your current .htaccess or create one and place the following in it.

Deny from 1.2.3.4

Just had a bot myself -- 49 guests at once -- couldn't tell where it's from. [b]But, I have a question: can I ban "66.196.72" to ban all of the below through the .htaccess, similar to how the admin cp will let me ban registrations from truncated IP addresses?

66.196.72.47
66.196.72.51
66.196.72.73
66.196.72.66
66.196.72.49
66.196.72.67
66.196.72.43
66.196.72.100
66.196.72.35
66.196.72.44
66.196.72.86
64.140.49.68
66.196.72.39
66.196.72.51
66.196.72.48
66.196.72.61
66.196.72.41
66.196.72.59
66.196.72.33
66.196.72.71
66.196.72.37
66.196.72.72
66.196.72.58
66.196.72.32
66.196.72.42

[Kings]

That's Inktomi, better not ban that!

[jacobi]

Umm...

[Kings]

Inktomi is a search-engine spider, and it's a good bot.

[jacobi]

I'll take your word for it. I just hope it doesn't add too many queries... we're a small site for school teachers and students, mostly within one state, to visit. We really don't need to be searched so intensively.

[filburt1]

http://www.vbulletin.org/forum/showt...threadid=55092

[jaycob]

wow just done a search on google and found this thread.

it just so happens that a guest is using a program through Inktomi Spider
to try and overload the server. had to put the cookie level on 60 seconds until
this idiot goes away.

[Steve Machol]

That's a search engine bot. It's normal. If you don't want search engines indexing your set, then use robots.txt to stop them.

[jaycob]

i know for a fact this hacker is using this program to try and overload the server, he has been going for the last 16 hours.
im unsure what text to write or where to put it to stop the Inktomi Spider

[JakeS]

i know for a fact this hacker is using this program to try and overload the server, he has been going for the last 16 hours.
im unsure what text to write or where to put it to stop the Inktomi Spider

You could temporally block all spiders...

create robots.txt and add:

User-agent: *
Disallow: /

[jaycob]

You could temporally block all spiders...

create robots.txt and add:

User-agent: *
Disallow: /

hey man thanks.

just is there away to stop Inktomi Spider from my site?

like i know i have to make a text file and upload to my forum root?

but im unsure of the spot on code?

is that it? User-agent: *
Disallow: /
i put the above in a text file and upload?
thats it?
thx

[JakeS]

I'm 99% sure inktomi spider is slurp. so.

to block inktomi alone use:

User-agent: Slurp
Disallow: /

However. He may try other spiders I don't know.

[jaycob]

thanks man cheers.

[Dean C]

He can fake the user-agent but he can't fake the IP. I fail to see how you cuold know it's a hacker. I once had 127 inktomi spider instances on my forums last year. I've heard stories of far higher too.

[Wayne Luke]

He can fake the user-agent but he can't fake the IP. I fail to see how you cuold know it's a hacker. I once had 127 inktomi spider instances on my forums last year. I've heard stories of far higher too.

Well since Inktomi was purchased by Yahoo! and all the spiders were renamed, Yahoo! Slurp. You shouldn't be seeing Inktomi spiders anymore.