Yes, depending on the traffic of your site, spawning a separate PHP process for running a script could be devastating. It would be more efficient to use shell_exec() to start a background process that saves the output to a filename you already know, but even this could be resource intensive. You could also have a … Read more
Reuse the same cURL handler ($ch) without running curl_close. This will speed it up just a little bit. Use curl_multi_init to run the processes in parallel. This can have a tremendous effect.
You can explore two article that describes this example. PHP and curl_multi_exec First, here’s the high level. There are two outer loops. The first one is responsible for clearing out the curl buffer right now. The second one is responsible for waiting for more information, and then getting that information. This is an example of … Read more