Login   Register  
PHP Classes
elePHPant
Icontem

Web Crawler using MySQL DB

Recommend this page to a friend!
Stumble It! Stumble It! Bookmark in del.icio.us Bookmark in del.icio.us

  Author  
Picture of vivek
Name: vivek <e-mail contact>
Packages: 1 Browse all classes by vivek Browse all classes by
Country: India India - PHP jobs in India
Age: ???
All time rank: 98048 in India India
Week rank: 1400 Down105 in India India Down


  Detailed description   Download .zip .tar.gz  
This class can be used to retrieve Web pages and store the URLs links in a MySQL database.

It retrieves a given Web page and parses its HTML content to extract the URLs of links and frames.

The URLs that are crawled are stored in a MySQL database table if the URL was not yet stored previously.

The class can also display in a Web page the list of URLs already stored from a given domain.

  Classes of vivek  >  Web Crawler using MySQL DB  >  Download .zip .tar.gz  >  Support forum Support forum (2)  >  Blog Blog  >  RSS 1.0 feed RSS 2.0 feed Latest changes  
Name: Web Crawler using MySQL DB
Base name: dbcrawler
Description: Retrieve Web pages and store links in a database
Version: -
PHP version: 4.0
Licenses: BSD License
GNU Free Documentation License (FDL)
Free For Educational Use
GNU General Public License (GPL)
All time users: 2723 users
All time rank: 1224
Week users: 1 user
Week rank: 2020 Down
 
  Groups   Rate classes User ratings   Applications   Files Files  

  Groups  
Group folder image HTML HTML generation and processing View top rated classes
Group folder image Databases Database management, accessing and searching View top rated classes
Group folder image Searching Search engines, crawling and indexing View top rated classes


  User ratings  
Ratings
Utility
Consistency
Documentation
Examples
Tests
Videos
Overall
Rank
All time:
Good (81.2%)
Good (81.2%)
-
Good (81.2%)
-
-
Not sure (56.9%)
1045
Month:
There are not enough user ratings to display for this class.

  Applications that use this class  
No application links were specified for this class.
Add link image If you know an application of this package, send a message to the author to add a link here.
  Files folder image Files  
File Role Description
Plain text file spider_advanced.class.php Class advanced spider
Plain text file spider_advanced_example.php Example advanced class example file
Accessible without login Plain text file spider_simple.class.php Class DBCrawler
Plain text file spider_simple_example.php Example example

Download all files: dbcrawler.tar.gz dbcrawler.zip
NOTICE: if you are using a download manager program like 'GetRight', please Login before trying to download this archive.