Tag Archives: spiders

How to Manage the “Spiders/Bots” that Come to Your phpBB Forums

Hello everyone, Today we are going to discuss how to manage all of the bots/spiders that come to your forums. So what are bot/spiders you ask? Well it’s really quite …

Tags: , , , , , , , , , , , , , , , , | Posted under phpBB | Leave a comment

Block Malicious Bots and Spiders in web.config

Search engines bots, crawlers and spiders helps your site getting discovered by users. However, some search engines are very aggressive and consume a lot of server bandwidth. And sometimes, bots …

Tags: , , , , , , , , , , , , , , , | Posted under DotNet/Windows Hosting, WebsitePanel Tutorials | Leave a comment

Prevent Malicious Bots/Spiders From Accessing Your Site Using .htaccess

There are various types of bots and spiders that transverse sites for different reasons. Among them activities such as email harvesting and other malicious activity. By using a .htaccess file, …

Tags: , , , , , , , | Posted under Programming/Coding | 3 Comments