BeautifulSoup: extract text from anchor tag

by

This will help:

from bs4 import BeautifulSoup

data=""'<div class="image">
        <a href="http://www.example.com/eg1">Content1<img  
        src="http://image.example.com/img1.jpg" /></a>
        </div>
        <div class="image">
        <a href="http://www.example.com/eg2">Content2<img  
        src="http://image.example.com/img2.jpg" /> </a>
        </div>'''

soup = BeautifulSoup(data)

for div in soup.findAll('div', attrs={'class':'image'}):
    print(div.find('a')['href'])
    print(div.find('a').contents[0])
    print(div.find('img')['src'])

If you are looking into Amazon products then you should be using the official API. There is at least one Python package that will ease your scraping issues and keep your activity within the terms of use.

More Related Contents:

  1. How to find the comment tag with BeautifulSoup?
  2. Using Find_All function returns an unexpected result set
  3. How to find elements by class
  4. BeautifulSoup getting href [duplicate]
  5. Beautiful Soup findAll doesn’t find them all
  6. Can I remove script tags with BeautifulSoup?
  7. BeautifulSoup findAll() given multiple classes?
  8. How can I get href links from HTML using Python?
  9. BeautifulSoup webscraping find_all( ): finding exact match
  10. How to load all entries in an infinite scroll at once to parse the HTML in python
  11. How to find children of nodes using BeautifulSoup
  12. BeautifulSoup innerhtml?
  13. Understand the Find() function in Beautiful Soup
  14. Convert a HTML Table to JSON
  15. python beautifulsoup iframe document html extract
  16. How to find all comments with Beautiful Soup
  17. How to find tag with particular text with Beautiful Soup?
  18. How find specific data attribute from html tag in BeautifulSoup4?
  19. Exclude unwanted tag on Beautifulsoup Python
  20. How to install beautiful soup 4 with python 2.7 on windows
  21. BeautifulSoup return unexpected extra spaces
  22. BeautifulSoup: get css classes from html
  23. How to get inner text value of an HTML tag with BeautifulSoup bs4?
  24. How to scrape dynamic webpages by Python
  25. Convert HTML entities to Unicode and vice versa
  26. Is there a built in package to parse html into dom?
  27. Passing a matplotlib figure to HTML (flask)
  28. How can I access namespaced XML elements using BeautifulSoup?
  29. What causes `None` results from BeautifulSoup functions? How can I avoid “AttributeError: ‘NoneType’ object has no attribute…” with BeautifulSoup?
  30. HTML to IMAGE using Python

Leave a Comment