php: Get html source code with cURL

by

Try the following:

$ch = curl_init("http://www.example-webpage.com/file.html");
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
curl_setopt($ch, CURLOPT_BINARYTRANSFER, true);
$content = curl_exec($ch);
curl_close($ch);

I would only recommend this for small files. Big files are read as a whole and are likely to produce a memory error.

EDIT: after some discussion in the comments we found out that the problem was that the server couldn’t resolve the host name and the page was in addition a HTTPS resource so here comes your temporary solution (until your server admin fixes the name resolving).

what i did is just pinging graph.facebook.com to see the IP address, replace the host name with the IP address and instead specify the header manually. This however renders the SSL certificate invalid so we have to suppress peer verification.

//$url = "https://graph.facebook.com/19165649929?fields=name";
$url = "https://66.220.146.224/19165649929?fields=name";
$ch = curl_init($url);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
curl_setopt($ch, CURLOPT_BINARYTRANSFER, true);
curl_setopt($ch, CURLOPT_SSL_VERIFYPEER, FALSE);
curl_setopt($ch, CURLOPT_HTTPHEADER, array('Host: graph.facebook.com'));
$output = curl_exec($ch);
curl_close($ch);

Keep in mind that the IP address might change and this is an error source. you should also do some error handling using curl_error();.

More Related Contents:

  1. Scrape web page contents
  2. Web scraping in PHP
  3. How can I get the destination URL using cURL?
  4. Can a customer without a PayPal account still pay for recurring payments with a credit card
  5. Form submit file attach
  6. default image not showing [closed]
  7. w3 schools form tutorial doesnt send email
  8. How do you parse and process HTML/XML in PHP?
  9. How to retrieve images from MySQL database and display in an html tag
  10. how to get the cookies from a php curl into a variable
  11. Selecting a css class with xpath
  12. Remote file size without downloading file
  13. Submit an HTML form with empty checkboxes
  14. PHP cURL, extract an XML response
  15. Check whether image exists on remote URL
  16. file_get_contents returns 403 forbidden
  17. How to get the browser to cache images, with PHP?
  18. How to set selected value of HTML select box with PHP
  19. Fastest way to retrieve a in PHP
  20. Convert .doc to html in php [closed]
  21. Correct indentation of HTML and PHP using Vim
  22. Get variable from PHP file using JQuery/AJAX
  23. Multiple javascript/css files: best practices?
  24. PHP cURL HTTP PUT
  25. How to place two forms on the same page?
  26. cURL requires CURLOPT_SSL_VERIFYPEER=FALSE
  27. get url content PHP [duplicate]
  28. PHP Include for HTML?
  29. Include PHP file into HTML file [duplicate]
  30. download a file from ftp using curl and php

Leave a Comment