Getting historical data from Twitter [closed]

Twitter notoriously does not make “available” tweets older than three weeks. In some cases you can only get one week. You’re better off storing tweets for the next three months. Many rightly doubt if they’re even persisted by Twitter.

Are you looking for just any tweets? If so, check out the Streaming API’s status/sample method. The streaming API uses persistent HTTP sockets that can be a pain to program, but it’s quite graceful when you get it working. I’d recommend setting up a little script to dump tweets from status/sample into a DB. You should have a TON of data after just a few days.

Leave a Comment