Complete scan of dynamoDb with boto3

by

I think the Amazon DynamoDB documentation regarding table scanning answers your question.

In short, you’ll need to check for LastEvaluatedKey in the response. Here is an example using your code:

import boto3
dynamodb = boto3.resource('dynamodb',
                          aws_session_token=aws_session_token,
                          aws_access_key_id=aws_access_key_id,
                          aws_secret_access_key=aws_secret_access_key,
                          region_name=region
)

table = dynamodb.Table('widgetsTableName')

response = table.scan()
data = response['Items']

while 'LastEvaluatedKey' in response:
    response = table.scan(ExclusiveStartKey=response['LastEvaluatedKey'])
    data.extend(response['Items'])

More Related Contents:

  1. How to write a file or data to an S3 object using boto3
  2. Boto3 to download all files from a S3 Bucket
  3. How to handle errors with boto3?
  4. How to choose an AWS profile when using boto3 to connect to CloudFront
  5. How to save S3 object to a file using boto3
  6. Read file content from S3 bucket with boto3
  7. Listing contents of a bucket with boto3
  8. Retrieving subfolders names in S3 bucket from boto3
  9. Can I use boto3 anonymously?
  10. Getting S3 objects’ last modified datetimes with boto
  11. How to specify credentials when connecting to boto3 S3?
  12. Open S3 object as a string with Boto3
  13. how to copy s3 object from one bucket to another using python boto3
  14. Reading an JSON file from S3 using Python boto3
  15. Download a folder from S3 using Boto3
  16. Difference in boto3 between resource, client, and session?
  17. How to import a text file on AWS S3 into pandas without writing to disk
  18. Using psycopg2 with Lambda to Update Redshift (Python)
  19. Save Dataframe to csv directly to s3 Python
  20. How to SSH and run commands in EC2 using boto3?
  21. Getting started with secure AWS CloudFront streaming with Python
  22. Amazon S3 boto – how to delete folder?
  23. Cannot use Requests-Module on AWS Lambda
  24. Read a file line by line from S3 using boto?
  25. toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading
  26. Mocking boto3 S3 client method Python
  27. How to return a PDF file from in-memory buffer using FastAPI?
  28. Import libraries in lambda layers
  29. Python request in AWS Lambda timing out
  30. Tesseract OCR on AWS Lambda via virtualenv

Leave a Comment