How to get string objects instead of Unicode from JSON?

by

While there are some good answers here, I ended up using PyYAML to parse my JSON files, since it gives the keys and values as str type strings instead of unicode type. Because JSON is a subset of YAML it works nicely:

>>> import json
>>> import yaml
>>> list_org = ['a', 'b']
>>> list_dump = json.dumps(list_org)
>>> list_dump
'["a", "b"]'
>>> json.loads(list_dump)
[u'a', u'b']
>>> yaml.safe_load(list_dump)
['a', 'b']

Notes

Some things to note though:

  • I get string objects because all my entries are ASCII encoded. If I would use unicode encoded entries, I would get them back as unicode objects — there is no conversion!

  • You should (probably always) use PyYAML’s safe_load function; if you use it to load JSON files, you don’t need the “additional power” of the load function anyway.

  • If you want a YAML parser that has more support for the 1.2 version of the spec (and correctly parses very low numbers) try Ruamel YAML: pip install ruamel.yaml and import ruamel.yaml as yaml was all I needed in my tests.

Conversion

As stated, there is no conversion! If you can’t be sure to only deal with ASCII values (and you can’t be sure most of the time), better use a conversion function:

I used the one from Mark Amery a couple of times now, it works great and is very easy to use. You can also use a similar function as an object_hook instead, as it might gain you a performance boost on big files. See the slightly more involved answer from Mirec Miskuf for that.

More Related Contents:

  1. What exactly do “u” and “r” string flags do, and what are raw string literals?
  2. UnicodeEncodeError: ‘ascii’ codec can’t encode character u’\xa0′ in position 20: ordinal not in range(128)
  3. How to make a class JSON serializable
  4. What is the best way to remove accents (normalize) in a Python unicode string?
  5. Saving utf-8 texts with json.dumps as UTF8, not as \u escape sequence
  6. Writing Unicode text to a text file?
  7. Making object JSON serializable with regular encoder
  8. How to JSON serialize sets?
  9. What exactly do “u” and “r” string prefixes do, and what are raw string literals?
  10. Why does Python print unicode characters when the default encoding is ASCII?
  11. Serializing class instance to JSON
  12. How I can I lazily read multiple JSON values from a file/stream in Python?
  13. Python – ‘ascii’ codec can’t decode byte
  14. What is the difference between encode/decode?
  15. is not JSON serializable
  16. Python ascii utf unicode
  17. Flask jsonify a list of objects
  18. Unicode values in strings are escaped when dumping to JSON in Python [duplicate]
  19. Serialising an Enum member to JSON
  20. UnicodeDecodeError: ‘utf8’ codec can’t decode bytes in position 3-6: invalid data
  21. How do convert unicode escape sequences to unicode characters in a python string
  22. Saving UTF-8 texts with json.dumps as UTF-8, not as a \u escape sequence
  23. Read Unicode characters from command-line arguments in Python 2.x on Windows
  24. Why does ENcoding a string result in a DEcoding error (UnicodeDecodeError)?
  25. List of objects to JSON with Python
  26. Printing a string prints ‘u’ before the string in Python?
  27. TypeError: Object of type ‘bytes’ is not JSON serializable
  28. Pretty print JSON dumps
  29. SQLite, python, unicode, and non-utf data
  30. Serializing list to JSON [duplicate]

Leave a Comment