BeautifulSoup getText from between , not picking up subsequent paragraphs

by

You are getting close!

# Find all of the text between paragraph tags and strip out the html
page = soup.find('p').getText()

Using find (as you’ve noticed) stops after finding one result. You need find_all if you want all the paragraphs. If the pages are formatted consistently ( just looked over one), you could also use something like 

soup.find('div',{'id':'ctl00_PlaceHolderMain_RichHtmlField1__ControlWrapper_RichHtmlField'})

to zero in on the body of the article.

More Related Contents:

  1. How to remove \xa0 from string in Python?
  2. bs4.FeatureNotFound: Couldn’t find a tree builder with the features you requested: lxml. Do you need to install a parser library?
  3. BeautifulSoup returns empty list when searching by compound class names
  4. Extract content of with BeautifulSoup
  5. Install Beautiful Soup using pip [duplicate]
  6. How to handle IncompleteRead: in python
  7. Searching for IP addresses in a file
  8. python program doesn’t work
  9. BeautifulSoup Grab Visible Webpage Text
  10. Skip the headers when editing a csv file using Python
  11. “OSError: [Errno 1] Operation not permitted” when installing Scrapy in OSX 10.11 (El Capitan) (System Integrity Protection)
  12. In Python, why is list[] automatically global?
  13. Improve Row Append Performance On Pandas DataFrames
  14. Spell Checker for Python
  15. Scrape Dynamic contents created by Javascript using Python
  16. TypeError: cannot perform reduce with flexible type
  17. Understanding Pickling in Python
  18. How can I read pdf in python? [duplicate]
  19. How to download a full webpage with a Python script?
  20. How to avoid “WindowsError: [Error 5] Access is denied”
  21. How to save python screen output to a text file
  22. Python: How to resize an image using PIL module
  23. Python not able to open file with non-english characters in path
  24. BeautifulSoup returns None even though the element exists
  25. numpy.sum() giving strange results on large arrays
  26. How to fix TypeError: ‘int’ object is not subscriptable
  27. Elegant way to perform tuple arithmetic
  28. ‘is’ operator behaves unexpectedly with floats
  29. Extract content within a tag with BeautifulSoup
  30. Searching in Google with Python

Leave a Comment