PHP Classes

File: www/robots.txt

Recommend this page to a friend!
  Classes of Fernando Val  >  Springy  >  www/robots.txt  >  Download  
File: www/robots.txt
Role: Documentation
Content type: text/plain
Description: Documentation
Class: Springy
Microframework for Web application development
Author: By
Last change:
Date: 3 years ago
Size: 147 bytes



Class file image Download
User-agent: *

#Request-rate: 10/5         # maximum rate is 10 pages every 5 seconds
#Crawl-delay: 0.1           # 100ms entre uma pagina e outra