The best piece of code I found for extracting text without getting javascript or not wanted things : from urllib.request import urlopen from bs4 import BeautifulSoup url = “http://news.bbc.co.uk/2/hi/health/2284783.stm” html = urlopen(url).read() soup = BeautifulSoup(html, features=”html.parser”) # kill all script and style elements for script in soup([“script”, “style”]): script.extract() # rip it out # get … Read more
$url=”http://example.com”; $html = file_get_contents($url); $doc = new DOMDocument(); @$doc->loadHTML($html); $tags = $doc->getElementsByTagName(‘img’); foreach ($tags as $tag) { echo $tag->getAttribute(‘src’); }
Html Agility Pack This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you actually don’t HAVE to understand XPATH nor XSLT to use it, don’t worry…). It is a .NET code library that allows you to parse “out of the web” HTML files. The parser is very … Read more