python eval vs ast.literal_eval vs JSON decode

by

I don’t really like this attitude on stackoverflow (and elsewhere) telling people without any context that what they are doing is insecure and they shouldn’t do it. Maybe it’s just a throwaway script to import some data, in that case why not choose the fastest or most convenient way?

In this case, however, json.loads is not only more secure, but also more than 4x faster (depending on your data). 

In [1]: %timeit json.loads(data)
10000 loops, best of 3: 41.6 µs per loop

In [2]: %timeit eval(data)
10000 loops, best of 3: 194 µs per loop

In [3]: %timeit ast.literal_eval(data)
1000 loops, best of 3: 269 µs per loop

If you think about it makes sense json is a such more constrained language/format than python, so it must be faster to parse with an optimized parser.

More Related Contents:

  1. How to append new line to the list
  2. Code to calculate file compression on python [closed]
  3. Timeout function if it takes too long to finish [duplicate]
  4. How can I read large text files line by line, without loading it into memory?
  5. Retrieving the output of subprocess.call() [duplicate]
  6. How to write to a CSV line by line?
  7. How to make a cross-module variable?
  8. Reconstruct a categorical variable from dummies in pandas
  9. Hashable, immutable
  10. Python, HTTPS GET with basic authentication
  11. Python: Passing variables between functions
  12. How to insert newlines on argparse help text?
  13. Flask at first run: Do not use the development server in a production environment
  14. Quickest way to make a get_dummies type dataframe from a column with a multiple of strings
  15. How do you have shared log files under Windows?
  16. Split string based on a regular expression
  17. Plot correlation matrix using pandas
  18. Flask Download a File
  19. OpenSSL errors in python requests
  20. Find the index of an item in a list of lists
  21. Discord.py error: TypeError: __new__() got an unexpected keyword argument ‘deny_new’
  22. How to run sudo with Paramiko? (Python)
  23. How to select at the same time from two Listbox?
  24. trouble aligning ticks for matplotlib twinx axes
  25. Combining node.js and Python
  26. Plotting a line over several graphs
  27. How do I use vi keys in ipython under *nix?
  28. Ceil a datetime to next quarter of an hour
  29. How to warp an image using deformed mesh
  30. Python file.write creating extra carriage return

Leave a Comment