How can I emulate a get request exactly like a web browser?

by

Are you sure the curl module honors ini_set(‘user_agent’,…)? There is an option CURLOPT_USERAGENT described at http://docs.php.net/function.curl-setopt.
Could there also be a cookie tested by the server? That you can handle by using CURLOPT_COOKIE, CURLOPT_COOKIEFILE and/or CURLOPT_COOKIEJAR.

edit: Since the request uses https there might also be error in verifying the certificate, see CURLOPT_SSL_VERIFYPEER.

$url="https://new.aol.com/productsweb/subflows/ScreenNameFlow/AjaxSNAction.do?s=username&f=firstname&l=lastname";
$agent="Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.0.3705; .NET CLR 1.1.4322)";

$ch = curl_init();
curl_setopt($ch, CURLOPT_SSL_VERIFYPEER, false);
curl_setopt($ch, CURLOPT_VERBOSE, true);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
curl_setopt($ch, CURLOPT_USERAGENT, $agent);
curl_setopt($ch, CURLOPT_URL,$url);
$result=curl_exec($ch);
var_dump($result);

More Related Contents:

  1. How to get file_get_contents() to work with HTTPS?
  2. PHP CURL & HTTPS
  3. HTTPS and SSL3_GET_SERVER_CERTIFICATE:certificate verify failed, CA is OK
  4. curl POST format for CURLOPT_POSTFIELDS
  5. PHP cURL custom headers
  6. Setting Curl’s Timeout in PHP
  7. Keeping session alive with Curl and PHP
  8. Save image from url with curl PHP
  9. What’s the net::ERR_HTTP2_PROTOCOL_ERROR about?
  10. How to resolve cURL Error (7): couldn’t connect to host?
  11. How to use CURL via a proxy?
  12. Copy Image from Remote Server Over HTTP
  13. Async curl request in PHP
  14. Manually parse raw multipart/form-data data with PHP
  15. Posting raw image data as multipart/form-data in curl
  16. curl_exec() always returns false
  17. Posting multidimensional array with PHP and CURL
  18. How to switch from POST to GET in PHP CURL
  19. Post to a Facebook user’s wall with cURL PHP
  20. another twitter oAuth cURL access token request that fails
  21. PHP unable to load php_curl.dll extension
  22. Login to Google with PHP and Curl, Cookie turned off?
  23. Laravel 5 Socialite – cURL error 77: error setting certificate verify locations
  24. Any way to keep curl’s cookies in memory and not on disk
  25. How to get an option previously set with curl_setopt()?
  26. Using curl in php with client certificate and private key in separate files
  27. Get the last modified date of a remote file
  28. PHP Get Content of HTTP 400 Response
  29. Composer install error – requires ext_curl when it’s actually enabled
  30. How to perform multiple Guzzle requests at the same time?

Leave a Comment