How to upload a file to directory in S3 bucket using boto

by

NOTE: This answer uses boto. See the other answer that uses boto3, which is newer.

Try this…

import boto
import boto.s3
import sys
from boto.s3.key import Key

AWS_ACCESS_KEY_ID = ''
AWS_SECRET_ACCESS_KEY = ''

bucket_name = AWS_ACCESS_KEY_ID.lower() + '-dump'
conn = boto.connect_s3(AWS_ACCESS_KEY_ID,
        AWS_SECRET_ACCESS_KEY)


bucket = conn.create_bucket(bucket_name,
    location=boto.s3.connection.Location.DEFAULT)

testfile = "replace this with an actual filename"
print 'Uploading %s to Amazon S3 bucket %s' % \
   (testfile, bucket_name)

def percent_cb(complete, total):
    sys.stdout.write('.')
    sys.stdout.flush()


k = Key(bucket)
k.key = 'my test file'
k.set_contents_from_filename(testfile,
    cb=percent_cb, num_cb=10)

[UPDATE]
I am not a pythonist, so thanks for the heads up about the import statements.
Also, I’d not recommend placing credentials inside your own source code. If you are running this inside AWS use IAM Credentials with Instance Profiles (http://docs.aws.amazon.com/IAM/latest/UserGuide/id_roles_use_switch-role-ec2_instance-profiles.html), and to keep the same behaviour in your Dev/Test environment, use something like Hologram from AdRoll (https://github.com/AdRoll/hologram)

More Related Contents:

  1. How to write a file or data to an S3 object using boto3
  2. Amazon S3 boto – how to delete folder?
  3. Listing contents of a bucket with boto3
  4. Read a file line by line from S3 using boto?
  5. Can I use boto3 anonymously?
  6. Getting S3 objects’ last modified datetimes with boto
  7. Open S3 object as a string with Boto3
  8. Boto3 to download all files from a S3 Bucket
  9. How to handle errors with boto3?
  10. How can I use boto to stream a file out of Amazon S3 to Rackspace Cloudfiles?
  11. Load S3 Data into AWS SageMaker Notebook
  12. How to save S3 object to a file using boto3
  13. Read file content from S3 bucket with boto3
  14. Getting started with secure AWS CloudFront streaming with Python
  15. Retrieving subfolders names in S3 bucket from boto3
  16. AWS Content Type Settings in S3 Using Boto3
  17. Move files between two AWS S3 buckets using boto3
  18. How to specify credentials when connecting to boto3 S3?
  19. Can you upload to S3 using a stream rather than a local file?
  20. how to copy s3 object from one bucket to another using python boto3
  21. Reading an JSON file from S3 using Python boto3
  22. Python: How to read and load an excel file from AWS S3?
  23. Download a folder from S3 using Boto3
  24. Recommended way to manage credentials with multiple AWS accounts?
  25. How to import a text file on AWS S3 into pandas without writing to disk
  26. unable to call firefox from selenium in python on AWS machine
  27. Cannot use Requests-Module on AWS Lambda
  28. How to bootstrap installation of Python modules on Amazon EMR?
  29. Python request in AWS Lambda timing out
  30. Run manage.py from AWS EB Linux instance

Leave a Comment