Login   Register  
PHP Classes
elePHPant
Icontem

Web Crawler using MySQL DB: Retrieve Web pages and store links in a database

Recommend this page to a friend!
Stumble It! Stumble It! Bookmark in del.icio.us Bookmark in del.icio.us

  Author Author  
Picture of vivek
Name: vivek <e-mail contact>
Packages: 1 Browse all classes by vivek Browse all classes by
Country: India India - PHP jobs in India
Age: ???
All time rank: 98249 in India India
Week rank: 985 Down79 in India India Down


  Detailed description   Download Download .zip .tar.gz   Install with Composer Install with Composer  
This class can be used to retrieve Web pages and store the URLs links in a MySQL database.

It retrieves a given Web page and parses its HTML content to extract the URLs of links and frames.

The URLs that are crawled are stored in a MySQL database table if the URL was not yet stored previously.

The class can also display in a Web page the list of URLs already stored from a given domain.

  Classes of vivek  >  Web Crawler using MySQL DB  >  Download Download .zip .tar.gz  >  Support forum Support forum (2)  >  Blog Blog  >  RSS 1.0 feed RSS 2.0 feed Latest changes  
Name: Web Crawler using MySQL DB
Base name: dbcrawler
Description: Retrieve Web pages and store links in a database
Version: 1.0.0
PHP version: 4.0
Licenses: BSD License
GNU Free Documentation License (FDL)
Free For Educational Use
GNU General Public License (GPL)
All time users: 2873 users
All time rank: 1187
Week users: 2 users
Week rank: 1191 Down
 
  Groups   Rate classes User ratings   Applications   Files Files  

  Groups  
Group folder image HTML HTML generation and processing View top rated classes
Group folder image Databases Database management, accessing and searching View top rated classes
Group folder image Searching Search engines, crawling and indexing View top rated classes


  User ratings  
RatingsUtility Consistency Documentation Examples Tests Videos Overall Rank
All time: Good (81.2%) Good (81.2%) - Good (81.2%) - - Not sure (56.9%) 1079
Month: Not yet rated by the users

  Applications that use this class  
No application links were specified for this class.
Add link image If you know an application of this package, send a message to the author to add a link here.
  Files folder image Files  
File Role Description
Plain text file spider_advanced.class.php Class advanced spider
Plain text file spider_advanced_example.php Example advanced class example file
Accessible without login Plain text file spider_simple.class.php Class DBCrawler
Plain text file spider_simple_example.php Example example

Install with Composer Install with Composer - Download Download all files: dbcrawler.tar.gz dbcrawler.zip
NOTICE: if you are using a download manager program like 'GetRight', please Login before trying to download this archive.