Login   Register  
PHP Classes
elePHPant
Icontem

GoogleCrawler: Perform searches and retrieve results from Google

Recommend this page to a friend!
Stumble It! Stumble It! Bookmark in del.icio.us Bookmark in del.icio.us

  Author Author  
Picture of Jonathan Schmidt-Dominé
Name: Jonathan Schmidt-Dominé <contact>
Classes: 1 package by
Country: Germany Germany
Age: ???
All time rank: 2101136 in Germany Germany
Week rank: 1722 Up94 in Germany Germany Up


  Detailed description   Download Download .zip .tar.gz  
This class can be used to perform searches and retrieve results from Google.

It can send HTTP requests to the Google search pages to perform searches for given keywords.

The class can parse the retrieved search result pages and extract the result URLs, titles, description snippet and cache-urls. You will also get the number of results, that's it, I think, that is everything you want to have from Google. ;)

It retrieves a single page of results. The number of pages and the number of results per page can be configured.

The class uses randomly selected proxy-servers such that Google certainly won't black-list you, decrease your pagerank or whatever and the searches get better anonymization.

Usecases:
-Integrate it into your website (use &#8220;site: blablabla.com&#8221; in the query).
-Playing around with Google-results, you want to analyze, compare, check Google's results? Create a script using the results provided by this class.
-Install it locally or on your webspace to get a nice Google-interface with more anonymity.

  Classes of Jonathan Schmidt-Dominé  >  GoogleCrawler  >  Download Download .zip .tar.gz  >  Support forum Support forum (7)  >  Blog Blog  >  RSS 1.0 feed RSS 2.0 feed Latest changes  
Name: GoogleCrawler
Base name: gcrawl
Description: Perform searches and retrieve results from Google
Version: -
PHP version: 5
License: GNU General Public License (GPL)
All time users: 1017 users
All time rank: 3319
Week users: 0 users
Week rank: 1372 Equal
 
  Groups   Screenshots Screenshots   Rate classes User ratings  
  Trackback   Applications   Related pages   Files Files  

  Groups  
Group folder image PHP 5 Classes using PHP 5 specific features View top rated classes
Group folder image Searching Search engines, crawling and indexing View top rated classes
Group folder image Web services Web data clipping, SOAP or XML-RPC clients and servers View top rated classes

  Files folder image Screenshots  
GCrawler.png
File Role Description
Accessible without login Image file GCrawler.png Screen Search-Example


  User ratings  
Not enough user ratings

  Pages that reference this package  
Are you still using Google?
If you are still using Google, you may have noticed it...
Google learned how to write HTML
This morning I noticed that my Google crawler did not work, Scroogle failed, too...

Latest pages that reference packages Latest pages that reference packages


  Applications that use this package  
No pages of applications that use this class were specified.
Add link image If you know an application of this package, send a message to the author to add a link here.

  Related pages  
Example in action
Search-page demonstrating the functionality

  Files folder image Files  
File Role Description
Accessible without login Plain text file GoogleCrawler.class.php Class GoogleCrawler-Class
Accessible without login Plain text file SearchEngine.php Example Example-Search-Engine with thumbshots
Plain text file COPYING.txt Lic. GPLv3

Download Download all files: gcrawl.tar.gz gcrawl.zip
NOTICE: if you are using a download manager program like 'GetRight', please Login before trying to download this archive.