Web Crawler using MySQL DB
| Recommend this page to a friend! |  Stumble It! |
 Bookmark in del.icio.us |
| Classes of vivek | > | Web Crawler using MySQL DB | > | Download .tar.gz .zip | > |  Support forum (2) |
> |  Blog |
> |   Latest changes |
||
|
|||||||||||||||||||||||||
| Author | ||
 |
|
|||||||||||||||||||
This class can be used to retrieve Web pages and store the URLs links in a MySQL database.
It retrieves a given Web page and parses its HTML content to extract the URLs of links and frames.
The URLs that are crawled are stored in a MySQL database table if the URL was not yet stored previously.
The class can also display in a Web page the list of URLs already stored from a given domain.
It retrieves a given Web page and parses its HTML content to extract the URLs of links and frames.
The URLs that are crawled are stored in a MySQL database table if the URL was not yet stored previously.
The class can also display in a Web page the list of URLs already stored from a given domain.
| Groups |  User ratings |
Applications |  Files |
|||||
| Groups | ||
 |
HTML | HTML generation and processing | View top rated classes |
|
Databases | Database management, accessing and searching | View top rated classes |
|
Searching | Search engines, crawling and indexing | View top rated classes |
| User ratings | ||
| Ratings | ||||||||
|---|---|---|---|---|---|---|---|---|
| All time: | ||||||||
| Month: | ||||||||
| Applications that use this class | ||
No application links were specified for this class.
If you know an application of this package, send a message to the author to add a link here.| Files |
||
| File | Role | Description |
|---|---|---|
| spider_advanced.class.php |
Class | advanced spider |
| spider_advanced_example.php |
Example | advanced class example file |
 spider_simple.class.php |
Class | DBCrawler |
| spider_simple_example.php |
Example | example |
| Download all files: dbcrawler.tar.gz dbcrawler.zip |
For more information send a message to info at phpclasses dot org.
Copyright (c) Icontem 1999-2012