PHP Classes
Icontem

Class: Crawler


  Search   All class groups All class groups   Latest entries Latest entries   Top 10 charts Top 10 charts   Newsletter Newsletter   Blog Blog   Forums Forums   Help FAQ Help FAQ  
  Login   Register  
Recommend this page to a friend! ReTweet ReTweet Stumble It! Stumble It! Bookmark in del.icio.us Bookmark in del.icio.us
  Classes of Md. Shaiful islam  >  Crawler  >  Download  >  Support forum Support forum (3)  >  Blog Blog  >  RSS 1.0 feed RSS 2.0 feed Latest changes  
Name: Crawler Support forum
Base name: crawler
Description: Extract links and images from remote Web pages
Related top rated classes: ,
Version: 1.1
Required PHP version: 4.0
License: Freely Distributable
All time users: 2405 users
All time rank: 973
Week users: 32 users
Week rank: 142
 
  Author   Group folder image Groups   Detailed description  
  Rate classes User ratings   Trackback   Applications   Files Files  

Author

Picture of Md. Shaiful islam
Name: Md. Shaiful islam is available for providing paid consulting. Contact Md. Shaiful islam .
Published packages: 1 Browse this author's classes Browse this author's classes
Country: Bangladesh Bangladesh - PHP jobs in Bangladesh
Home page: http://www.shaifulonline.com/
Age: 26
All time rank: 795
Week rank: 205

Innovation Award

PHP Programming Innovation award nominee
March 2008
Number 7
Retrieving Web pages from remote sites is a relatively easy task in PHP.

If you want to crawl a site to search for something in its pages, you only need to retrieve the site pages, use some regular expressions to extract the site links, and retrieve the linked pages until all pages were followed.

However, if some pages can only be accessed by authenticated users, the problem is no longer so simple.

This package provides a more complete solution to the problem of crawling site pages by automatically authenticating, so it can access all pages restricted to logged users.

Manuel Lemos

Groups

Group folder image HTML HTML generation and processing View top rated classes
Group folder image Web services Web data clipping, SOAP or XML-RPC clients and servers View top rated classes

Detailed description

This class can be used to extract links and images from remote Web pages.

It can access Web pages, parse the pages HTML and extract the URLs of the links and the images.

If necessary, the class may access a login page and emulate the submission of a login form to subsequent accesses can be done on behalf of the logged user.

User ratings

Ratings
Utility
Consistency
Documentation
Examples
Tests
Videos
Overall
Rank
All time:
Sufficient (75.0%)
Sufficient (66.7%)
-
Sufficient (79.2%)
-
-
Not sure (52.1%)
1115
Month:
Not yet rated by the users

Trackback links

Link Description
Classe Crawler para PHP - Pegar links e imagem com PHP Hoje vou postar uma classe para identificar links e imagens em sites...
SEO Tool: Search Engine position checker I’ve just finished developing a stable release of quite an advanced SEO tool, I called it “position checker”...

Applications that use this class

No application links were specified for this class.
Add link image If you know an application of this package, send a message to the author to add a link here.

Files

File Role Description
Plain text file Crawler.php Class The Class
Plain text file ExampleCrawlImage.php Example Crawl Image form http://www.phpclasses.org/ site
Plain text file ExampleCrawlLink.php Example Crawl links form http://www.phpclasses.org/ site
Plain text file ExampleLoginCrawlLink.php Example Login and CrawlLink from a site
Download all files: crawler.tar.gz crawler.zip
NOTICE: if you are using a download manager program like 'GetRight', please Login before trying to download this archive.

 
  Advertise on this site Advertise on this site   Site map Site map   Statistics Statistics   Site tips Site tips   Privacy policy Privacy policy   Contact Contact  

For more information send a message to :
info at phpclasses dot org.
Copyright (c) Icontem 1999-2009 PHP Classes - PHP Class Scripts
  PHP Book Reviews - Reviews of books and other products