Make @lru_cache ignore some of the function arguments

by

With cachetools you can write:

from cachetools import cached
from cachetools.keys import hashkey

from random import randint

@cached(cache={}, key=lambda db_handle, query: hashkey(query))
def find_object(db_handle, query):
    print("processing {0}".format(query))
    return query

queries = list(range(5))
queries.extend(range(5))
for q in queries:
    print("result: {0}".format(find_object(randint(0, 1000), q)))

You will need to install cachetools (pip install cachetools).

The syntax is:

@cached(
    cache={},
    key=lambda <all-function-args>: hashkey(<relevant-args>)
)

Here is another example that includes keyword args:

@cached(
    cache={},
    key=lambda a, b, c=1, d=2: hashkey(a, c)
)
def my_func(a, b, c=1, d=2):
    return a + c

In the example above note that the lambda function input args match the my_func args. You don’t have to exactly match the argspec if you don’t need to. For example, you can use kwargs to squash out things that aren’t needed in the hashkey:

@cached(
    cache={},
    key=lambda a, b, c=1, **kwargs: hashkey(a, c)
)
def my_func(a, b, c=1, d=2, e=3, f=4):
    return a + c

In the above example we don’t care about d=, e= and f= args when looking up a cache value, so we can squash them all out with **kwargs.

More Related Contents:

  1. Python functools lru_cache with instance methods: release object
  2. How to make function decorators and chain them together?
  3. How does the @property decorator work in Python?
  4. What’s with the integer cache maintained by the interpreter?
  5. What does functools.wraps do?
  6. Is there a decorator to simply cache function return values?
  7. Class method decorator with self arguments?
  8. How does functools partial do what it does?
  9. Expire a view-cache in Django?
  10. Decorating class methods – how to pass the instance to the decorator?
  11. How do I pass extra arguments to a Python decorator?
  12. How can I decorate an instance method with a decorator class?
  13. How do I force Django to ignore any caches and reload data?
  14. What is __pycache__?
  15. Decorator execution order
  16. Disabling caching in Flask [duplicate]
  17. Real world example about how to use property feature in python?
  18. How to use Python decorators to check function arguments?
  19. Why are some mysql connections selecting old data the mysql database after a delete + insert?
  20. How do I make function decorators and chain them together?
  21. How to make function decorators and chain them together in Python?
  22. @classmethod vs @staticmethod in Python
  23. Python decorator? – can someone please explain this? [duplicate]
  24. How to do a conditional decorator in python?
  25. Using a pip cache directory in docker builds
  26. How to create a custom decorator in Django?
  27. Decorator error: NoneType object is not callable
  28. How to count function calls using decorators?
  29. How to skip a pytest using an external fixture?
  30. Python decorator, self is mixed up [duplicate]

Leave a Comment