Keef
Well-Known Member
Hi,
Is there a list of DMOZ/ODP site crawlers or bots?
I ask because I am keen to avoid accidentally blocking them in my .htaccess
Many thanks,
Keef
PS. I hope I'm asking this in the right place - apologies if I'm not.
Is there a list of DMOZ/ODP site crawlers or bots?
I ask because I am keen to avoid accidentally blocking them in my .htaccess
Many thanks,
Keef
PS. I hope I'm asking this in the right place - apologies if I'm not.