Note to Webmaster...
I noticed when I go to Who's Online there seems to be about 130 Yahoo Slurp spiders on this forum. I know this to be a common performance issue with vBulletin, not to mention the fact that it can consume all of your SQL database connections, rendering it difficult for other members to gain access to the forums at peak times. We had this problem at one time with our vBulletin site.
I was wondering if was ever a problem on this site, as I have noticed a recent slowdown while navigating the forums. Have you ever considered limiting the Yahoo Slurp spiders? It would give the site a performance boost.
FIX:
Add this line to your robots.txt file:
User-agent: Slurp Crawl-delay: 10
I noticed when I go to Who's Online there seems to be about 130 Yahoo Slurp spiders on this forum. I know this to be a common performance issue with vBulletin, not to mention the fact that it can consume all of your SQL database connections, rendering it difficult for other members to gain access to the forums at peak times. We had this problem at one time with our vBulletin site.
I was wondering if was ever a problem on this site, as I have noticed a recent slowdown while navigating the forums. Have you ever considered limiting the Yahoo Slurp spiders? It would give the site a performance boost.
FIX:
Add this line to your robots.txt file:
User-agent: Slurp Crawl-delay: 10