Crawler: Extract links and images from remote Web pages
| Recommend this page to a friend! |
 Author |
 |
|
Innovation award Nominee: 1x | |||||||||||||||||||
This class can be used to extract links and images from remote Web pages.
It can access Web pages, parse the pages HTML and extract the URLs of the links and the images.
If necessary, the class may access a login page and emulate the submission of a login form to subsequent accesses can be done on behalf of the logged user.
It can access Web pages, parse the pages HTML and extract the URLs of the links and the images.
If necessary, the class may access a login page and emulate the submission of a login form to subsequent accesses can be done on behalf of the logged user.
| Classes of Md. Shaiful islam | > | Crawler | > |  Download .zip .tar.gz |
> |  Support forum (7) |
> |  Blog |
> |   Latest changes |
|
|||||||||||||||||||||||
| Groups |  User ratings |
Trackback | Applications |  Files |
| Groups |
 HTML |
HTML generation and processing | View top rated classes |
| Web services |
Web data clipping, SOAP or XML-RPC clients and servers | View top rated classes |
| Innovation Award |
 March 2008 Number 7 Prize: One copy of Delphi for PHP |
Retrieving Web pages from remote sites is a relatively easy task in PHP. If you want to crawl a site to search for something in its pages, you only need to retrieve the site pages, use some regular expressions to extract the site links, and retrieve the linked pages until all pages were followed. However, if some pages can only be accessed by authenticated users, the problem is no longer so simple. This package provides a more complete solution to the problem of crawling site pages by automatically authenticating, so it can access all pages restricted to logged users. Manuel Lemos |
| User ratings |
| Ratings | Utility | Consistency | Documentation | Examples | Tests | Videos | Overall | Rank |
|---|---|---|---|---|---|---|---|---|
| All time: | Sufficient (77%) | Sufficient (70%) | - | Sufficient (79%) | - | - | Not sure (53%) | 2046 |
| Month: | Not yet rated by the users | |||||||
| Pages that reference this package |
| Classe Crawler para PHP - Pegar links e imagem com PHP Hoje vou postar uma classe para identificar links e imagens em sites... |
| SEO Tool: Search Engine position checker I’ve just finished developing a stable release of quite an advanced SEO tool, I called it “position checker”... |
Latest pages that reference packages
| Applications that use this package |
No pages of applications that use this class were specified.
If you know an application of this package, send a message to the author to add a link here.
| Files |
| File | Role | Description |
|---|---|---|
| Crawler.php |
Class | The Class |
 ExampleCrawlImage.php |
Example | Crawl Image form http://www.phpclasses.org/ site |
| ExampleCrawlLink.php |
Example | Crawl links form http://www.phpclasses.org/ site |
| ExampleLoginCrawlLink.php |
Example | Login and CrawlLink from a site |
 Install with Composer - Download all files: crawler.tar.gz crawler.zipNOTICE: if you are using a download manager program like 'GetRight', please Login before trying to download this archive.
|
