Python: Why is functools.partial necessary?

by

What functionality does functools.partial offer that you can’t get through lambdas?

Not much in terms of extra functionality (but, see later) – and, readability is in the eye of the beholder.
Most people who are familiar with functional programming languages (those in the Lisp/Scheme families in particular) appear to like lambda just fine – I say “most”, definitely not all, because Guido and I assuredly are among those “familiar with” (etc) yet think of lambda as an eyesore anomaly in Python…
He was repentant of ever having accepted it into Python whereas planned to remove it from Python 3, as one of “Python’s glitches”.
I fully supported him in that. (I love lambda in Scheme… while its limitations in Python, and the weird way it just doesn’t fit in with the rest of the language, make my skin crawl).

Not so, however, for the hordes of lambda lovers — who staged one of the closest things to a rebellion ever seen in Python’s history, until Guido backtracked and decided to leave lambda in.
Several possible additions to functools (to make functions returning constants, identity, etc) didn’t happen (to avoid explicitly duplicating more of lambda‘s functionality), though partial did of course remain (it’s no total duplication, nor is it an eyesore).

Remember that lambda‘s body is limited to be an expression, so it’s got limitations. For example…:

>>> import functools
>>> f = functools.partial(int, base=2)
>>> f.args
()
>>> f.func
<type 'int'>
>>> f.keywords
{'base': 2}
>>>

functools.partial‘s returned function is decorated with attributes useful for introspection — the function it’s wrapping, and what positional and named arguments it fixes therein. Further, the named arguments can be overridden right back (the “fixing” is rather, in a sense, the setting of defaults):

>>> f('23', base=10)
23

So, as you see, it’s definely not as simplistic as lambda s: int(s, base=2)!-)

Yes, you could contort your lambda to give you some of this – e.g., for the keyword-overriding,

>>> f = lambda s, **k: int(s, **dict({'base': 2}, **k))

but I dearly hope that even the most ardent lambda-lover doesn’t consider this horror more readable than the partial call!-). The “attribute setting” part is even harder, because of the “body’s a single expression” limitation of Python’s lambda (plus the fact that assignment can never be part of a Python expression)… you end up “faking assignments within an expression” by stretching list comprehension well beyond its design limits…:

>>> f = [f for f in (lambda f: int(s, base=2),)
           if setattr(f, 'keywords', {'base': 2}) is None][0]

Now combine the named-arguments overridability, plus the setting of three attributes, into a single expression, and tell me just how readable that is going to be…!

More Related Contents:

  1. How does functools partial do what it does?
  2. list.reverse does not return list?
  3. Can you explain closures (as they relate to Python)?
  4. List comprehension vs. lambda + filter
  5. Python Argument Binders
  6. How to use filter, map, and reduce in Python 3
  7. Why isn’t Python very good for functional programming? [closed]
  8. How to zip lists in a list
  9. How to call Python functions dynamically
  10. How can I get a reversed copy of a list (avoid a separate statement when chaining a method after .reverse)?
  11. Composing functions in python
  12. Get number of items from list (or other iterable) with certain condition
  13. Can one partially apply the second argument of a function that takes no keyword arguments?
  14. Python 3 Map function is not Calling up function
  15. What is the ‘pythonic’ equivalent to the ‘fold’ function from functional programming?
  16. How to sort with lambda in Python
  17. Why program functionally in Python?
  18. Using python map and other functional tools
  19. Useful code which uses reduce()? [closed]
  20. Any Functional Programming method of traversing a nested dictionary?
  21. Python recursive function to display all subsets of given set
  22. Modify bound variables of a closure in Python
  23. How can I bind arguments to a function in Python?
  24. Functional pipes in python like %>% from R’s magrittr
  25. functools.partial wants to use a positional argument as a keyword argument
  26. Find column whose name contains a specific string
  27. How to validate a url in Python? (Malformed or not)
  28. Rendering JSON objects using a Django template after an Ajax call
  29. does close() imply flush() in Python?
  30. How can I decode a SSL certificate using python?

Leave a Comment