How to use curl to get a GET request exactly same as using Chrome?

by

If you need to set the user header string in the curl request, you can use the -H option to set user agent like:

curl -H "user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36" http://stackoverflow.com/questions/28760694/how-to-use-curl-to-get-a-get-request-exactly-same-as-using-chrome

Updated user-agent form newest Chrome at 02-22-2021

Using a proxy tool like Charles Proxy really helps make short work of something like what you are asking. Here is what I do, using this SO page as an example (as of July 2015 using Charles version 3.10):

  1. Get Charles Proxy running
  2. Make web request using browser
  3. Find desired request in Charles Proxy
  4. Right click on request in Charles Proxy
  5. Select ‘Copy cURL Request’

Copy cURL Request example in Charles 3.10.2

You now have a cURL request you can run in a terminal that will mirror the request your browser made. Here is what my request to this page looked like (with the cookie header removed):

curl -H "Host: stackoverflow.com" -H "Cache-Control: max-age=0" -H "Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8" -H "User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.89 Safari/537.36" -H "HTTPS: 1" -H "DNT: 1" -H "Referer: https://www.google.com/" -H "Accept-Language: en-US,en;q=0.8,en-GB;q=0.6,es;q=0.4" -H "If-Modified-Since: Thu, 23 Jul 2015 20:31:28 GMT" --compressed http://stackoverflow.com/questions/28760694/how-to-use-curl-to-get-a-get-request-exactly-same-as-using-chrome

More Related Contents:

  1. Simulate a specific CURL in PostMan
  2. Local Storage vs Cookies
  3. Auto detect mobile browser (via user-agent?) [closed]
  4. curl: (60) SSL certificate problem: unable to get local issuer certificate
  5. How to send a header using a HTTP request through a cURL call?
  6. How can you debug a CORS request with cURL?
  7. Determine a user’s timezone
  8. Using cURL with a username and password?
  9. Best way to manage long-running php script?
  10. How do I deal with certificates using cURL while trying to access an HTTPS url?
  11. How do I measure request and response times at once using cURL?
  12. Scrape web page contents
  13. How do you properly install libcurl for use in visual studio 2017?
  14. Why do Chrome and IE put “Mozilla 5.0” in the User-Agent they send to the server? [duplicate]
  15. How can I download a single raw file from a private github repo using the command line?
  16. Batch script get html site and parse content (without wget, curl or other external app)
  17. curl follow location error
  18. How to display request headers with command line curl
  19. CURLOPT_FOLLOWLOCATION cannot be activated [duplicate]
  20. Why is curl truncating this query string?
  21. Set cURL to use local virtual hosts
  22. Is there a way to follow redirects with command line cURL?
  23. Sending Push via Postman using Firebase Messaging
  24. How to set the authorization header using cURL
  25. curl -GET and -X GET
  26. PHP cURL how to add the User Agent value OR overcome the Servers blocking cURL requests?
  27. How to debug SSL handshake using cURL?
  28. Using wildcards in wget or curl query
  29. How do I install cURL on cygwin?
  30. Install curl with openssl

Leave a Comment