| Recommend this page to a friend! |
| Classes of Marcin Sznyra | > | MegaSpider | > | Download .tar.gz .zip | > | > | > | |||||
|
| |||||||||||||||||||||||||||||||||||||||||||
| Detailed description | ||
| This class can crawl the pages of Web site recursively to retrieve the URLs of links and e-mail addresses that are found in the pages. It uses regular expressions to retrieve the links found in each page and follows the links URLs and until all linked pages are visited. |
| Groups | ||
| Searching | Search engines, crawling and indexing | View top rated classes |
| Applications | ||||||||
No application links were specified for this class.
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||