Missing parts on Beautiful Soup results

by

BeautifulSoup can use different parsers to handle HTML input. The HTML input here is a little broken, and the default HTMLParser parser doesn’t handle it very well.

Use the html5lib parser instead:

>>> len(BeautifulSoup(r.text, 'html').find('td', attrs={'class': 'eelantext'}).find_all('p'))
0
>>> len(BeautifulSoup(r.text, 'lxml').find('td', attrs={'class': 'eelantext'}).find_all('p'))
0
>>> len(BeautifulSoup(r.text, 'html5lib').find('td', attrs={'class': 'eelantext'}).find_all('p'))
22

More Related Contents:

  1. UnicodeEncodeError: ‘ascii’ codec can’t encode character u’\xa0′ in position 20: ordinal not in range(128)
  2. Scraping: SSL: CERTIFICATE_VERIFY_FAILED error for http://en.wikipedia.org
  3. Difference between .string and .text BeautifulSoup
  4. Scraping Google Finance (BeautifulSoup)
  5. How to scrape a website which requires login using python and beautifulsoup?
  6. Parsing HTML in python – lxml or BeautifulSoup? Which of these is better for what kinds of purposes?
  7. Get an attribute value based on the name attribute with BeautifulSoup
  8. ImportError: No Module Named bs4 (BeautifulSoup)
  9. How to extract and download all images from a website using beautifulSoup?
  10. Beautiful Soup cannot find a CSS class if the object has other classes, too
  11. Scrape a dynamic website
  12. Extracting text from script tag using BeautifulSoup in Python
  13. Convert HTML into CSV
  14. BeautifulSoup returns empty list when searching by compound class names
  15. Extract content of with BeautifulSoup
  16. How to scrape only visible webpage text with BeautifulSoup?
  17. Beautifulsoup : Difference between .find() and .select()
  18. How to find all comments with Beautiful Soup
  19. How to find tag with particular text with Beautiful Soup?
  20. Can bs4 get the dynamic content of a webpage if requests can’t?
  21. Extract the ‘src’ attribute from an ‘img’ tag using Beautiful Soup
  22. How can I access namespaced XML elements using BeautifulSoup?
  23. How find specific data attribute from html tag in BeautifulSoup4?
  24. BeautifulSoup – extracting attribute values
  25. What causes `None` results from BeautifulSoup functions? How can I avoid “AttributeError: ‘NoneType’ object has no attribute…” with BeautifulSoup?
  26. Scrape the absolute URL instead of a relative path in python
  27. How to find the comment tag with BeautifulSoup?
  28. Install Beautiful Soup using pip [duplicate]
  29. BeautifulSoup getText from between , not picking up subsequent paragraphs
  30. How to scrape dynamic webpages by Python

Leave a Comment