Login   Register  
PHP Classes
elePHPant
Icontem

batch processing

Recommend this page to a friend!
Stumble It! Stumble It! Bookmark in del.icio.us Bookmark in del.icio.us

      PHP Classes blog  >  Accelerate scripts ru...  >  All threads  >  batch processing  >  (Un) Subscribe thread alerts  
Subject:batch processing
Summary:Curl has multi-fetch support
Messages:2
Author:Joe Fox
Date:2010-10-29 08:28:36
Update:2010-10-29 22:12:29
 

  1. batch processing   Reply  
Picture of Joe Fox
Joe Fox
2010-10-29 16:10:29
Whenever I've needed a quick and easy solution for parallel batch processing, particularly where I need to pull a lot of data through external APIs ( like REST or SOAP for instance ), I've found php Curl extension's ability to run multiple http queries in parallel via curl_multi_select invaluable.

http://uk.php.net/manual/en/function.curl-multi-exec.php

While not fully asynchronous, data IS processed as it becomes available within the scope of any multi fetch query.

  2. Re: batch processing   Reply  
Picture of Jaimie Sirovich
Jaimie Sirovich
2010-10-29 22:12:29 - In reply to message 1 from Joe Fox
Could this be combined with libevent? Or are they not filehandles?