check if a key exists in a bucket in s3 using boto3

by

Boto 2’s boto.s3.key.Key object used to have an exists method that checked if the key existed on S3 by doing a HEAD request and looking at the the result, but it seems that that no longer exists. You have to do it yourself:

import boto3
import botocore

s3 = boto3.resource('s3')

try:
    s3.Object('my-bucket', 'dootdoot.jpg').load()
except botocore.exceptions.ClientError as e:
    if e.response['Error']['Code'] == "404":
        # The object does not exist.
        ...
    else:
        # Something else has gone wrong.
        raise
else:
    # The object does exist.
    ...

load() does a HEAD request for a single key, which is fast, even if the object in question is large or you have many objects in your bucket.

Of course, you might be checking if the object exists because you’re planning on using it. If that is the case, you can just forget about the load() and do a get() or download_file() directly, then handle the error case there.

More Related Contents:

  1. How to write a file or data to an S3 object using boto3
  2. Boto3 to download all files from a S3 Bucket
  3. How to import a text file on AWS S3 into pandas without writing to disk
  4. Save Dataframe to csv directly to s3 Python
  5. Read file content from S3 bucket with boto3
  6. Error “Read-only file system” in AWS Lambda when downloading a file from S3
  7. Listing contents of a bucket with boto3
  8. Retrieving subfolders names in S3 bucket from boto3
  9. How to upload File in FastAPI, then to Amazon S3 and finally process it?
  10. Can I use boto3 anonymously?
  11. Getting S3 objects’ last modified datetimes with boto
  12. How to specify credentials when connecting to boto3 S3?
  13. Open S3 object as a string with Boto3
  14. how to copy s3 object from one bucket to another using python boto3
  15. How to return a PDF file from in-memory buffer using FastAPI?
  16. Reading an JSON file from S3 using Python boto3
  17. Download a folder from S3 using Boto3
  18. Difference in boto3 between resource, client, and session?
  19. setting up s3 for logs in airflow
  20. How to handle errors with boto3?
  21. How can I use boto to stream a file out of Amazon S3 to Rackspace Cloudfiles?
  22. How to choose an AWS profile when using boto3 to connect to CloudFront
  23. How to save S3 object to a file using boto3
  24. How to SSH and run commands in EC2 using boto3?
  25. Getting started with secure AWS CloudFront streaming with Python
  26. Amazon S3 boto – how to delete folder?
  27. AWS Content Type Settings in S3 Using Boto3
  28. Read a file line by line from S3 using boto?
  29. Mocking boto3 S3 client method Python
  30. Python: How to read and load an excel file from AWS S3?

Leave a Comment