Download image file from the HTML page source

by

Here is some code to download all the images from the supplied URL, and save them in the specified output folder. You can modify it to your own needs.

"""
dumpimages.py
    Downloads all the images on the supplied URL, and saves them to the
    specified output file ("/test/" by default)

Usage:
    python dumpimages.py http://example.com/ [output]
"""
from bs4 import BeautifulSoup as bs
from urllib.request import (
    urlopen, urlparse, urlunparse, urlretrieve)
import os
import sys

def main(url, out_folder="/test/"):
    """Downloads all the images at 'url' to /test/"""
    soup = bs(urlopen(url))
    parsed = list(urlparse(url))

    for image in soup.findAll("img"):
        print("Image: %(src)s" % image)
        filename = image["src"].split("https://stackoverflow.com/")[-1]
        parsed[2] = image["src"]
        outpath = os.path.join(out_folder, filename)
        if image["src"].lower().startswith("http"):
            urlretrieve(image["src"], outpath)
        else:
            urlretrieve(urlunparse(parsed), outpath)

def _usage():
    print("usage: python dumpimages.py http://example.com [outpath]")

if __name__ == "__main__":
    url = sys.argv[-1]
    out_folder = "/test/"
    if not url.lower().startswith("http"):
        out_folder = sys.argv[-1]
        url = sys.argv[-2]
        if not url.lower().startswith("http"):
            _usage()
            sys.exit(-1)
    main(url, out_folder)

Edit: You can specify the output folder now.

More Related Contents:

  1. Web scraping with Python [closed]
  2. Scraping ajax pages using python
  3. web scraping dynamic content with python
  4. Beautiful Soup cannot find a CSS class if the object has other classes, too
  5. Scrape a dynamic website
  6. unable to call firefox from selenium in python on AWS machine
  7. scrape websites with infinite scrolling
  8. How to download any(!) webpage with correct charset in python?
  9. Using Python and Mechanize to submit form data and authenticate
  10. Scraping contents of multi web pages of a website using BeautifulSoup and Selenium
  11. How can i grab CData out of BeautifulSoup
  12. Print cubes of the numbers 1 through 10 only if the cube is evenly divisible by four
  13. How can I calculate a list modulo a numer in python?
  14. How to do for loop through all items of a list except the first [duplicate]
  15. How to select a drop-down menu value with Selenium using Python?
  16. How do I create a list of lambdas (in a list comprehension/for loop)?
  17. Add text to Existing PDF using Python
  18. Python Socket Receive Large Amount of Data
  19. Spark Dataframe distinguish columns with duplicated name
  20. Python Decimals format
  21. ImportError: No module named
  22. Python OpenCV load image from byte string
  23. How to check if the current time is in range in python?
  24. How to make Django serve static files with Gunicorn?
  25. Make Anaconda’s tkinter aware of system fonts or install new fonts for Anaconda
  26. Pandas custom function to find whether it is the 1st, 2nd etc Monday, Tuesday, etc – all suggestions welcome
  27. How to save python screen output to a text file
  28. How to add a mean and median line to a Seaborn displot
  29. numpy.sum() giving strange results on large arrays
  30. Python: Why is threaded function slower than non thread

Leave a Comment