stream

With the following streaming code, the Python memory usage is restricted regardless of the size of the downloaded file: def download_file(url): local_filename = url.split(“https://stackoverflow.com/”)[-1] # NOTE the stream=True parameter below with requests.get(url, stream=True) as r: r.raise_for_status() with open(local_filename, ‘wb’) as f: for chunk in r.iter_content(chunk_size=8192): # If you have chunk encoded response uncomment if # … Read more