PHP Classes
elePHPant
Icontem

Spider Class: Crawl a site following and retrieving linked pages

Recommend this page to a friend!
Stumble It! Stumble It! Bookmark in del.icio.us Bookmark in del.icio.us
  Info   View files View files (3)   DownloadInstall with Composer Download .zip   Reputation   Support forum (3)   Blog    
Last Updated Ratings Unique User Downloads Download Rankings  
2005-11-01 (9 years ago) RSS 2.0 feedStarStarStar 50%Total: 6,084 All time: 345 This week: 1,067Down
Version License Categories  
spiderclass 1.0GNU General Publi...HTML, PHP 5, Searching
Description Author  

This class can retrieve Web pages and parse them to extract the list of their links to continue crawling all linked pages.

The pages may be retrieved iteratively until it is reached a given limit of pages or link depth.

It is possible to set regular expressions for both link definitions and content matches, changeable at every depth.

Picture of greg jackson
Name: greg jackson <contact>
Classes: 1 package by
Country: United Kingdom United Kingdom
Age: ???
All time rank: 43020 in United Kingdom United Kingdom
Week rank: 1490 Down71 in United Kingdom United Kingdom Down

  Files folder image Files  
File Role Description
Accessible without login Plain text file overview.txt Doc. Overview for spiderClass.php
Plain text file spiderClass.php Class spiderClass source file
Accessible without login Plain text file spiderExamp.php Example Example usage - NOTE: BE KIND TO THE BBC AND DO NOT RUN THIS WITHOUT CHANGING THE PARAMETERS

 Version Control Unique User Downloads Download Rankings  
 0%Total:6,084All time:345
 This week:0This week:1,067Down
User Ratings User Comments (1)  
 All time
Utility:66%StarStarStarStar
Consistency:75%StarStarStarStar
Documentation:50%StarStarStar
Examples:45%StarStarStar
Tests:-
Videos:-
Overall:50%StarStarStar
Rank:1673