cassandra get all records in time range

by

The timeout is because Cassandra is taking longer than the timeout (default is 10 seconds) to return the data. For your query, Cassandra will attempt to fetch the entire dataset before returning. For more than a few records this can easily take longer than the timeout.

For queries that are producing lots of data you need to page e.g.

SELECT * FROM userlog WHERE ts >= '2013-01-01 00:00:00+0200' AND  ts <= '2013-08-13 23:59:00+0200' AND token(user_id) > previous_token LIMIT 100 ALLOW FILTERING;

where user_id is the previous user_id returned. You will also need to page on ts to guarantee you get all the records for the last user_id returned.

Alternatively, in Cassandra 2.0.0 (just released), paging is done transparently so your original query should work with no timeout or manual paging.

The ALLOW FILTERING means Cassandra is reading through all your data, but only returning data within the range specified. This is only efficient if the range is most of the data. If you wanted to find records within e.g. a 5 minute time window, this would be very inefficient.

More Related Contents:

  1. Cassandra cqlsh – how to show microseconds/milliseconds for timestamp columns?
  2. How do secondary indexes work in Cassandra?
  3. How to do a join queries with 2 or more tables in cassandra cql
  4. Difference between partition key, composite key and clustering key in Cassandra?
  5. Is the IN relation in Cassandra bad for queries?
  6. MAX(), DISTINCT and group by in Cassandra
  7. Inner Join in cassandra CQL
  8. How to create auto increment IDs in Cassandra
  9. Understand cassandra replication factor versus consistency level
  10. Cassandra cqlsh – connection refused
  11. cassandra – Saved cluster name Test Cluster != configured name
  12. Cassandra has a limit of 2 billion cells per partition, but what’s a partition?
  13. What version of Cassandra does Fluent Cassandra v0.7.0.3 support? [closed]
  14. MySQL and NoSQL: Help me to choose the right one
  15. How to run shell script file using nodejs?
  16. cqlsh connection error: ‘ref() does not take keyword arguments’
  17. MongoDB vs. Cassandra [closed]
  18. Cassandra port usage – how are the ports used?
  19. TaskSchedulerImpl: Initial job has not accepted any resources;
  20. Is there a reason not to use SparkContext.getOrCreate when writing a spark job?
  21. java.lang.NoClassDefFoundError: org/apache/spark/Logging
  22. Elasticsearch vs Cassandra vs Elasticsearch with Cassandra
  23. Is there any query for Cassandra as same as SQL:LIKE Condition?
  24. com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured table schema_keyspaces
  25. How to fix the “Found Netty’s native epoll transport in the classpath, but epoll is not available. Using NIO instead” warning?

Leave a Comment