Login   Register  
PHP Classes
elePHPant
Icontem

Class: Web Crawler using MySQL DB

Recommend this page to a friend!
Stumble It! Stumble It! Bookmark in del.icio.us Bookmark in del.icio.us
  Classes of vivek  >  Web Crawler using MySQL DB  >  Download .tar.gz .zip  >  Support forum Support forum (2)  >  Blog Blog  >  RSS 1.0 feed RSS 2.0 feed Latest changes  
Name: Web Crawler using MySQL DB
Support forum Support forum
Base name: dbcrawler
Description: Retrieve Web pages and store links in a database
Related classes: , , , , , , ,
Version: -
PHP version: 4.0
Licenses: BSD License
GNU Free Documentation License (FDL)
Free For Educational Use
GNU General Public License (GPL)
All time users: 2456 users
All time rank: 1287
Week users: 6 users
Week rank: 596
Picture of vivek
Author: vivek <e-mail contact>
Packages: 1 Browse this author's classes Browse this author's classes
Country: India India - PHP jobs in India
Age: ???
All time rank: 98945 in India India
Week rank: 601 Up37 in India India Up


  Detailed description  
This class can be used to retrieve Web pages and store the URLs links in a MySQL database.

It retrieves a given Web page and parses its HTML content to extract the URLs of links and frames.

The URLs that are crawled are stored in a MySQL database table if the URL was not yet stored previously.

The class can also display in a Web page the list of URLs already stored from a given domain.

 

  Groups  
Group folder image HTML HTML generation and processing View top rated classes
Group folder image Databases Database management, accessing and searching View top rated classes
Group folder image Searching Search engines, crawling and indexing View top rated classes

  Rate classes User ratings   Applications   Files Files  

  User ratings  
Ratings
Utility
Consistency
Documentation
Examples
Tests
Videos
Overall
Rank
All time:
Good (83.3%)
Sufficient (75.0%)
-
Good (83.3%)
-
-
Not sure (57.5%)
989
Month:
Not yet rated by the users

  Applications that use this class  
No application links were specified for this class.
Add link image If you know an application of this package, send a message to the author to add a link here.
  Files folder image Files  
File Role Description
Plain text file spider_advanced.class.php Class advanced spider
Plain text file spider_advanced_example.php Example advanced class example file
Accessible without login Plain text file spider_simple.class.php Class DBCrawler
Plain text file spider_simple_example.php Example example

Download all files: dbcrawler.tar.gz dbcrawler.zip
NOTICE: if you are using a download manager program like 'GetRight', please Login before trying to download this archive.