How to get page content using cURL?

by

this is how: 

   /**
     * Get a web file (HTML, XHTML, XML, image, etc.) from a URL.  Return an
     * array containing the HTTP server response header fields and content.
     */
    function get_web_page( $url )
    {
        $user_agent="Mozilla/5.0 (Windows NT 6.1; rv:8.0) Gecko/20100101 Firefox/8.0";

        $options = array(

            CURLOPT_CUSTOMREQUEST  =>"GET",        //set request type post or get
            CURLOPT_POST           =>false,        //set to GET
            CURLOPT_USERAGENT      => $user_agent, //set user agent
            CURLOPT_COOKIEFILE     =>"cookie.txt", //set cookie file
            CURLOPT_COOKIEJAR      =>"cookie.txt", //set cookie jar
            CURLOPT_RETURNTRANSFER => true,     // return web page
            CURLOPT_HEADER         => false,    // don't return headers
            CURLOPT_FOLLOWLOCATION => true,     // follow redirects
            CURLOPT_ENCODING       => "",       // handle all encodings
            CURLOPT_AUTOREFERER    => true,     // set referer on redirect
            CURLOPT_CONNECTTIMEOUT => 120,      // timeout on connect
            CURLOPT_TIMEOUT        => 120,      // timeout on response
            CURLOPT_MAXREDIRS      => 10,       // stop after 10 redirects
        );

        $ch      = curl_init( $url );
        curl_setopt_array( $ch, $options );
        $content = curl_exec( $ch );
        $err     = curl_errno( $ch );
        $errmsg  = curl_error( $ch );
        $header  = curl_getinfo( $ch );
        curl_close( $ch );

        $header['errno']   = $err;
        $header['errmsg']  = $errmsg;
        $header['content'] = $content;
        return $header;
    }

Example

//Read a web page and check for errors:

$result = get_web_page( $url );

if ( $result['errno'] != 0 )
    ... error: bad url, timeout, redirect loop ...

if ( $result['http_code'] != 200 )
    ... error: no page, no permissions, no service ...

$page = $result['content'];

More Related Contents:

  1. How to get file_get_contents() to work with HTTPS?
  2. PHP CURL & HTTPS
  3. HTTPS and SSL3_GET_SERVER_CERTIFICATE:certificate verify failed, CA is OK
  4. curl POST format for CURLOPT_POSTFIELDS
  5. PHP cURL custom headers
  6. Setting Curl’s Timeout in PHP
  7. Keeping session alive with Curl and PHP
  8. Save image from url with curl PHP
  9. What’s the net::ERR_HTTP2_PROTOCOL_ERROR about?
  10. How to resolve cURL Error (7): couldn’t connect to host?
  11. How to use CURL via a proxy?
  12. Copy Image from Remote Server Over HTTP
  13. Async curl request in PHP
  14. Manually parse raw multipart/form-data data with PHP
  15. Posting raw image data as multipart/form-data in curl
  16. How to get response using cURL in PHP
  17. curl_exec() always returns false
  18. Posting multidimensional array with PHP and CURL
  19. How to switch from POST to GET in PHP CURL
  20. Post to a Facebook user’s wall with cURL PHP
  21. PHP unable to load php_curl.dll extension
  22. Login to Google with PHP and Curl, Cookie turned off?
  23. Laravel 5 Socialite – cURL error 77: error setting certificate verify locations
  24. Any way to keep curl’s cookies in memory and not on disk
  25. How can I connect to a Tor hidden service using cURL in PHP?
  26. Can I do a CURL request to the same server?
  27. How do I send a HTTP/2 POST request in PHP
  28. Unable to make php curl request with port number
  29. Saving file using curl and PHP
  30. PHP cURL, POST JSON

Leave a Comment