Login   Register  
PHP Classes

Curl multi sitemap: Generate multiple sitemaps crawling sites

Recommend this page to a friend!
Stumble It! Stumble It! Bookmark in del.icio.us Bookmark in del.icio.us

  Author Author  
Picture of Arturs Sosins
Name: Arturs Sosins <contact>
Classes: 22 packages by
Country: Latvia Latvia
Age: 26
All time rank: 861 in Latvia Latvia
Week rank: 18 Up1 in Latvia Latvia Equal
Innovation award
Innovation award
Nominee: 13x

Winner: 2x

  Detailed description   Download Download .zip .tar.gz  
This class can be used to generate multiple sitemaps crawling sites.

It can crawl one or more sites to retrieve its pages and follow links recursively and determine the addresses of all pages to include in a XML sitemap.

It can ignore given URLs to avoid crawling and including in the sitemap.

The class uses the Curl extension multi-request support to retrieve multiple site pages at the same time.

You can also notify such services as Google, Yahoo, Bing, Ask and Moreover about your sitemap update.

The class may also notify Google, Bing, Yahoo, Ask and Weblogs when the sitemap is updated.

  Classes of Arturs Sosins  >  Curl multi sitemap  >  Download Download .zip .tar.gz  >  Support forum Support forum (5)  >  Blog Blog  >  RSS 1.0 feed RSS 2.0 feed Latest changes  
Name: Curl multi sitemap
Base name: curl-multi-sitemap
Description: Generate multiple sitemaps crawling sites
Version: -
PHP version: 5.0
License: GNU General Public License (GPL)
All time users: 2312 users
All time rank: 1555
Week users: 5 users
Week rank: 329 Up
  Groups   Rate classes User ratings   Applications   Related pages   Files Files  

Group folder image PHP 5 Classes using PHP 5 specific features View top rated classes
Group folder image Searching Search engines, crawling and indexing View top rated classes
Group folder image SEO Search engine optimization tools View top rated classes

  Innovation Award  
PHP Programming Innovation award nominee
August 2010
Number 5

Prize: One copy of VS.PHP
Sitemaps are important to tell Google and other search engines about the pages of your sites that you would like to be crawled and indexed.

One way to build a sitemap is to crawl the site pages and collect all the followed links. That may take a long time.

This class provides a more efficient way to crawl a site by using Curl extension multiple request support.

Instead of crawling just one page at a time it can crawl multiple pages in parallel, thus taking less time to finish.

Manuel Lemos

  User ratings  
RatingsUtility Consistency Documentation Examples Tests Videos Overall Rank
All time: Good (91%) Perfect (100%) - Perfect (100%) - - Sufficient (65%) 440
Month: Not yet rated by the users

  Applications that use this package  
Sitemap Generator
Generates site map using this class
Add link image If you know an application of this package, send a message to the author to add a link here.

  Related pages  
Curl multi sitemap documentation
Documentation and example scripts in action
Curl multi handler usage
Showing difference in performance between file_get_contents, curl and curl multi HTTP handler

  Files folder image Files  
File Role Description
Accessible without login Plain text file example.php Example Example usage of class methods
Plain text file sitemap.class.php Class Main class file

Download Download all files: curl-multi-sitemap.tar.gz curl-multi-sitemap.zip
NOTICE: if you are using a download manager program like 'GetRight', please Login before trying to download this archive.