Download Robots Txt Generator Freeware Free Software

Most Popular
Newest Freeware
Special

Download free program Robots Txt Generator for free

Robots Txt Generator

The spiders that visit your site consumes much of your bandwidth? If you want to control the robots or spiders

Last update; 24 April 2009:

The spiders that visit your site consumes much of your bandwidth?

If you want to control the robots or spiders that visit your site, robots-txt generator is the solution. It is very common that the webmaster of each site spends a lot of money paying for bandwidth and it is unfair that a significant portion of that bandwidth is consumed spiders. Robots txt generator, you can stop or control the bots.

Some robots or spiders saturate your server making countless queries per minute?

With Robots txt generator, you can limit how many requests can make any robot or spider per hour or per minute. In addition, the program has a database of more than 300 bots, allowing you to search on the database the source and owner of any bot you have found in your logs. You can even specify different restrictions for different bots. Per example, you can allow google bot, but disallow google-image-bot. You can specify a different restriction level for each one of the 300 bots in the database or can specify some restrition to the “general” bots, plus some specific for some specifi bots. Like giving a ban to some specific bot. Best of all, is that the software is free!

Robots Txt Generator
Category: Web-Development - Website-Management
Publisher: Publisher
OS: Windows
Size: 80 KB
View: 10,462 view
Bookmark and Share

Freeware
Free HD Video Converter Factory is a powerful but easy-to-use HD video conversion software. ...
Category: Audio-Video - Video-Converters    View: 184,935 view    Download
Freeware
Decrypt CSS and Region Code Protections Commonly purchased DVD (Movie, TV show, tutorial, etc.) ...
Category: Audio-Video - Dvd-Tools    View: 184,372 view    Download
Freeware
If you are looking for tools to export Zimbra mailboxes to MS Outlook PST ...
Category: Internet - Email    View: 612 view    Download
Freeware
Your phone might meet many kinds of disasters, such as water damage, screen smashed, ...
Category: Utilities - Backup-And-Recovery    View: 821 view    Download
Freeware
If you have a funny video and want to convert it to GIF, this ...
Category: Audio-Video - Video-Converters    View: 853 view    Download
Google Selection Search 1.0 (Size: 0.81 MB)
Freeware
Selection Search this Text Automation Tool is a Handy Search Launcher for Windows Systems ...
Category: Internet - Browsers-Addons    View: 623 view    Download
Freeware
With Apeaksoft Free HEIC Converter, you can convert all your HEIC (.heif) photos to ...
Category: Graphics - Editors    View: 491 view    Download
Freeware
This program allows you to convert PDF to Word easily and quickly. Many users ...
Category: Utilities - Pdf-Readers-Tools    View: 710 view    Download
Freeware
MSG Files Without Email Client Installation allows users to view email content with the ...
Category: Internet - Email    View: 516 view    Download
DriverHub 1.1.2 (Size: 20.68 MB)
Freeware
DriverHub is a useful tool to check for outdated drivers and easily update them ...
Category: Utilities - Driver    View: 707 view    Download
MSG Viewer Freeware 4.0 (Size: 19.20 MB)
Freeware
MSG Viewer Freeware Softwre allows users to view email content with the proper formatting. ...
Category: Internet - Email    View: 657 view    Download
Freeware
Read PST File Opener Free Download to View PST File without Microsoft Outlook environment ...
Category: Internet - Email    View: 459 view    Download
Freeware
Free Download EML File Reader is completely free of cost program, user don’t have ...
Category: Internet - Email    View: 467 view    Download
Freeware
Easy Photo Studio is a free photo viewer, resizer, batch image converter and editor ...
Category: Graphics - Editors    View: 723 view    Download
Freeware
Easy Photo Studio Free is an efficient image viewer, browser, Resizer, editor and converter ...
Category: Graphics - Editors    View: 443 view    Download
Freeware
PST File Reader Without Outlook Tool enables user to view all Outlook emails and ...
Category: Internet - Email    View: 462 view    Download
Freeware
Download EML Viewer Freeware tool provides an instant preview of all Thunderbrid, Windows Live ...
Category: Internet - Email    View: 433 view    Download
DVDFab File Transfer 11.0.5.1 (Size: 160.96 MB)
Freeware
DVDFab File Transfer is a handy and easy to use tool for you to ...
Category: Audio-Video - Dvd-Tools    View: 564 view    Download
DVDFab HD Decrypter 11.0.5.1 (Size: 160.96 MB)
Freeware
All in all, DVDFab HD Decrypter offers a simple solution for copying DVD and ...
Category: Audio-Video - Dvd-Tools    View: 509 view    Download
Palette Tune Lite 1.7 (Size: 2.03 MB)
Freeware
Palette Tune - solution for separate color correction of image fragments. It is a ...
Category: Graphics - Editors    View: 1,185 view    Download
Security Guru Free 2.8.7 (Size: 128.12 MB)
Freeware
Is your computer chugging along with a much reduced speed and getting very difficult ...
Category: Security - Anti-Spam-Anti-Spy-Tools    View: 8,602 view    Download
FTP Manager Lite 1.1 (Size: 10.19 MB)
Freeware
Free fast FTP client supports secure transfers and multiple connections. The file manager interface ...
Category: Internet - Ftp-Manager    View: 10,102 view    Download
Free Script Processor 4.8 (Size: 3.99 MB)
Freeware
Falco Script Processor is a useful program for education which allows calculate entered meanings ...
Category: Programming - Other-Programming    View: 10,248 view    Download
Direct PHP Framework 0.3.4 (Size: 0.50 MB)
Freeware
Direct PHP Framework is designed to provide modern and rapid development of websites, web ...
Category: Web-Development - Asp-Php    View: 5,632 view    Download
Freeware
The easiest way to mix and manipulate your photos. FotoMix is a versatile program ...
Category: Graphics - Editors    View: 96,081 view    Download
Free SNMP Explorer 1.1 (Size: 3.09 MB)
Freeware
SNMP Explorer (SE) is a tool that enables you to easily browse the Management ...
Category: Network - Network-Monitoring    View: 9,139 view    Download
FBScheduler 1.0 (Size: 1.97 MB)
Freeware
FBScheduler adds to Firebird SQL server the new functionality - execution of SQL commands ...
Category: Organize - Database-Management    View: 6,384 view    Download

Please vote us if you find this useful.