1.- if some result is distint from 200 no add more request.

2.- $options[CURLOPT_URL] = $urls[$i++]; When do you check that there is no more elements in array?, o my god.

I’ve seen many times implementations of curl multi that are based on just a copy&paste of some php.net example code and that completely misses the point of being able to pipe requests through the multi processor. Thanks for writing this!

just pass it along….

function rolling_curl($urls, $callback, $additional_callback_variables = [], $custom_options = null) {

// make sure the rolling window isn’t greater than the # of urls

$rolling_window = min([5, count($urls)]);

$rolling_window = (sizeof($urls) < $rolling_window) ? sizeof($urls) : $rolling_window;

$master = curl_multi_init();

$curl_arr = array();

// add additional curl options here

$std_options = array(CURLOPT_RETURNTRANSFER => true,

CURLOPT_FOLLOWLOCATION => true,

CURLOPT_MAXREDIRS => 5);

$options = ($custom_options) ? ($std_options + $custom_options) : $std_options;

// start the first batch of requests

for ($i = 0; $i < $rolling_window; $i++) {

$ch = curl_init();

$options[CURLOPT_URL] = $urls[$i];

curl_setopt_array($ch,$options);

curl_multi_add_handle($master, $ch);

}

do {

while(($execrun = curl_multi_exec($master, $running)) == CURLM_CALL_MULTI_PERFORM);

if($execrun != CURLM_OK)

break;

// a request was just completed — find out which one

while($done = curl_multi_info_read($master)) {

$info = curl_getinfo($done[‘handle’]);

if ($info[‘http_code’] == 200) {

$output = curl_multi_getcontent($done[‘handle’]);

// request successful. process output using the callback function.

$callback($output, $additional_callback_variables);

// start a new request (it’s important to do this before removing the old one)

$ch = curl_init();

$options[CURLOPT_URL] = $urls[$i++]; // increment i

curl_setopt_array($ch,$options);

curl_multi_add_handle($master, $ch);

// remove the curl handle that just completed

curl_multi_remove_handle($master, $done[‘handle’]);

} else {

// request failed. add error handling.

}

}

} while ($running);

curl_multi_close($master);

return true;

}

https://gist.github.com/anonymous/1a9eb381f6a5f260bd20

Thanks a lot for this guide and its helping a lot! 🙂

if (sizeof($urls) >= $i + 1) {

is a CPU killer. You can probably use curl_multi_select instead or suffer the los time of a microsleep().
Kaolin Fire's solution is much better than the line I specified.