Allow specific bots
1 post
• Page 1 of 1
Allow specific bots
This might be very stupid question, but I have not been able to figure this out.
I've seen several examples in this forum on how to block bad bots.
My question is that, how to do the reverse? Allow only specific bots?
So, instead of blocking bots "A" to "Z", I just want to allow, for example: google-bot, bing-bot, and yahoo-slurp.
Any example would be greatly appreciated.
I've seen several examples in this forum on how to block bad bots.
My question is that, how to do the reverse? Allow only specific bots?
So, instead of blocking bots "A" to "Z", I just want to allow, for example: google-bot, bing-bot, and yahoo-slurp.
Any example would be greatly appreciated.
1 post
• Page 1 of 1
Who is online
Users browsing this forum: No registered users and 17 guests