Download Robots Txt Generator Freeware Free Software

Most Popular
Newest Freeware

Download free program Robots Txt Generator for free

Robots Txt Generator

The spiders that visit your site consumes much of your bandwidth? If you want to control the robots or spiders

Last update; 24 April 2009:

The spiders that visit your site consumes much of your bandwidth?

If you want to control the robots or spiders that visit your site, robots-txt generator is the solution. It is very common that the webmaster of each site spends a lot of money paying for bandwidth and it is unfair that a significant portion of that bandwidth is consumed spiders. Robots txt generator, you can stop or control the bots.

Some robots or spiders saturate your server making countless queries per minute?

With Robots txt generator, you can limit how many requests can make any robot or spider per hour or per minute. In addition, the program has a database of more than 300 bots, allowing you to search on the database the source and owner of any bot you have found in your logs. You can even specify different restrictions for different bots. Per example, you can allow google bot, but disallow google-image-bot. You can specify a different restriction level for each one of the 300 bots in the database or can specify some restrition to the “general” bots, plus some specific for some specifi bots. Like giving a ban to some specific bot. Best of all, is that the software is free!

Robots Txt Generator
Category: Web-Development - Website-Management
Publisher: Publisher
OS: Windows
Size: 80 KB
View: 9,737 view
Bookmark and Share

Free PDF Eraser 1.8 (Size: 27.78 MB)
PDF Eraser is a free Windows application that deletes and erases text, images, logos ...
Category: Utilities - Pdf-Readers-Tools    View: 109,597 view    Download
Decrypt CSS and Region Code Protections Commonly purchased DVD (Movie, TV show, tutorial, etc.) ...
Category: Audio-Video - Dvd-Tools    View: 94,765 view    Download
Free HD Video Converter Factory is a powerful but easy-to-use HD video conversion software. ...
Category: Audio-Video - Video-Converters    View: 92,247 view    Download
5KPlayer for Mac 3.0 (Size: 36.50 MB)
5KPlayer is a new-style free media player for Mac OS as all-in-one HD video/music/DVD ...
Category: Audio-Video - Video-Players-Editors    View: 178,991 view    Download
Do Your Data Recovery for iPhone Free ( Mac version) lets Apple users recover ...
Category: Utilities - File-Disk    View: 96,315 view    Download
Do Your Data Recovery for iPhone Free provides safe data recovery solution for iPhone ...
Category: Utilities - File-Disk    View: 95,514 view    Download
Do Your Data Recovery for Mac Free provides reliable data recovery solution for Mac ...
Category: Utilities - File-Disk    View: 95,269 view    Download
Accidently deleted your files, formatted your hard drive? Don't worry! Do Your Data Recovery ...
Category: Utilities - File-Disk    View: 95,984 view    Download
5KPlayer 2.1 (Size: 31.06 MB)
5KPlayer is an all-in-one free media player for Windows (10) that works as HD ...
Category: Audio-Video - Video-Players-Editors    View: 96,715 view    Download
IP Camera Viewer 3.0 (Size: 6.06 MB)
Set up a FREE IP camera monitoring system within minutes! IP Camera Viewer is ...
Category: Communications - Web-Video-Cams    View: 99,322 view    Download
Privacy Eraser Portable 3.7 (Size: 5.29 MB)
Privacy Eraser is an all-in-one privacy suite that protects your privacy by cleaning up ...
Category: Security - Security-Tools    View: 96,708 view    Download
Desktop Calendar (Size: 3.17 MB)
Record anything by double-click on desktop. It's very convenient and useful. Desktop Calendar help ...
Category: Organize - Calendars    View: 97,558 view    Download
Abelssoft Undeleter 2015h (Size: 4.05 MB)
Rescues lost files Oh no! That happens really fast: Accidentally, you deleted an important ...
Category: Utilities - File-Disk    View: 96,272 view    Download
Colored Physics 1.1 (Size: 24.65 MB)
In this hand-drawn game you have to overcome many obstacles in this unique world. ...
Category: Games - Puzzle    View: 96,458 view    Download
Cute Puppy Clock 1.2.9 (Size: 1.78 MB)
A cute puppy clock that displays time, it lets you choose a puppy from ...
Category: Desktop - Clocks-Reminders    View: 96,371 view    Download
Easy-to-use tool allows you create cool glitter frame gif images with your own photos. ...
Category: Graphics - Editors    View: 96,240 view    Download
Amazing Frame Show 1.3.2 (Size: 3.60 MB)
Amazing Frame Show is a photo utility designed to decorate your photos with stylish ...
Category: Graphics - Viewers    View: 95,712 view    Download
Macgo iPhone Cleaner for Mac is an excellent iOS cleaner tool run on Mac ...
Category: Utilities - System    View: 95,892 view    Download
Macgo Free iPhone Explorer for Mac is a free iOS file explore software, it ...
Category: Utilities - System    View: 96,210 view    Download
MacX Free MP4 Video Converter is the best free MP4 video converter designed for ...
Category: Audio-Video - Video-Converters    View: 93,009 view    Download
Wise Password Manager Free is free password manager software designed to help manage your ...
Category: Utilities - Password-Managers    View: 6,835 view    Download
AidAim SQLMemTable 8.00 (Size: 9.93 MB)
SQLMemTable is a fast and easy-to-use in-memory table and query components library for Delphi ...
Category: Programming - Delphi-Editors    View: 8,431 view    Download
SysPlayer (Size: 0.81 MB)
SysPlayer is an extremely lightweight FREE Media Player with built-in codecs, which supports most ...
Category: Audio-Video - Video-Players-Editors    View: 5,470 view    Download
iSafe Virus Removal 2.7.25 (Size: 0.605 MB)
iSafe Virus Removal is a all-in-one FREE professional tool to keep your PC safe, ...
Category: Utilities - Antivirus    View: 11,837 view    Download
Free Mouse Monitor 4.3 (Size: 0.10 MB)
Mouse Monitor shows statistics on the use of the mouse. This gadget is for ...
Category: Utilities - System    View: 3,022 view    Download
Anvi Smart Defender RC2 (Size: 31.20 MB)
Anvi Smart defender delivers smart and powerful protection against malicious software, such as virus, ...
Category: Utilities - Antivirus    View: 9,715 view    Download
Free Audio Convert Wizard is a powerful audio converting program, meanwhile, a video to ...
Category: Utilities - Converters    View: 29,054 view    Download

Please vote us if you find this useful.