Allow specific bots

ISAPI_Rewrite is Apache mod_rewrite compatible URL rewriter for Microsoft IIS
User avatar
Posts: 2
Joined: 17 Nov 2012, 20:24

Allow specific bots

15 Mar 2016, 13:05

This might be very stupid question, but I have not been able to figure this out.
I've seen several examples in this forum on how to block bad bots.
My question is that, how to do the reverse? Allow only specific bots?

So, instead of blocking bots "A" to "Z", I just want to allow, for example: google-bot, bing-bot, and yahoo-slurp.

Any example would be greatly appreciated.

Return to ISAPI_Rewrite 3.0

Who is online

Users browsing this forum: No registered users and 14 guests