Tag Archives: spiders

Block Malicious Bots and Spiders in web.config

Search engines bots, crawlers and spiders helps your site getting discovered by users. However, some search engines are very aggressive and consume a lot of server bandwidth. And sometimes, bots …

Tags: , , , , , , , , , , , , , , , | Posted under DotNet/Windows Hosting, WebsitePanel Tutorials | Leave a comment

Prevent Malicious Bots/Spiders From Accessing Your Site Using .htaccess

There are various types of bots and spiders that transverse sites for different reasons. Among them activities such as email harvesting and other malicious activity. By using a .htaccess file, …

Tags: , , , , , , , | Posted under Programming/Coding | 3 Comments