Login   Register  
PHP Classes
elePHPant
Icontem

File: Robots.txt.class.php

Recommend this page to a friend!
Stumble It! Stumble It! Bookmark in del.icio.us Bookmark in del.icio.us
  Classes of Andy Pieters  >  Robots_txt  >  Robots.txt.class.php  
File: Robots.txt.class.php
Role: Class source
Content type: text/plain
Description: Core file
Class: Robots_txt
Test if a URL may be crawled looking at robots.txt
Author: By
Last change: Bug fix for regexp problem
Date: 6 years ago
Size: 12,447 bytes

You need to be a registered user and login to get this file.

1,301,956 PHP developers registered to the PHP Classes site.
Be One of Us!

Login Immediately with your account on:

Facebook ConnectGmail or other Google AccountHotmail or Microsoft Windows LiveStackOverflowGitHubYahoo