Url decode UTF-8 in Python

by

The data is UTF-8 encoded bytes escaped with URL quoting, so you want to decode, with urllib.parse.unquote(), which handles decoding from percent-encoded data to UTF-8 bytes and then to text, transparently:

from urllib.parse import unquote

url = unquote(url)

Demo:

>>> from urllib.parse import unquote
>>> url="example.com?title=%D0%BF%D1%80%D0%B0%D0%B2%D0%BE%D0%B2%D0%B0%D1%8F+%D0%B7%D0%B0%D1%89%D0%B8%D1%82%D0%B0"
>>> unquote(url)
'example.com?title=правовая+защита'

The Python 2 equivalent is urllib.unquote(), but this returns a bytestring, so you’d have to decode manually:

from urllib import unquote

url = unquote(url).decode('utf8')

More Related Contents:

  1. Changing default encoding of Python?
  2. Why should we NOT use sys.setdefaultencoding(“utf-8”) in a py script?
  3. Working with UTF-8 encoding in Python source [duplicate]
  4. How to convert a file to utf-8 in Python?
  5. Dangers of sys.setdefaultencoding(‘utf-8’)
  6. How do I check if a string is unicode or ascii?
  7. How to print UTF-8 encoded text to the console in Python < 3?
  8. How to write UTF-8 in a CSV file
  9. Why doesn’t Python recognize my utf-8 encoded source file?
  10. Why declare unicode by string in python?
  11. ‘utf-8’ codec can’t decode byte 0xa0 in position 4276: invalid start byte
  12. Should I use encoding declaration in Python 3?
  13. Python ascii utf unicode
  14. ElementTree and unicode
  15. UnicodeDecodeError: ‘ascii’ codec can’t decode byte 0xc3 in position 23: ordinal not in range(128)
  16. Why does this Python program send empty emails when I encode it with utf-8? [duplicate]
  17. Changing the “locale preferred encoding” in Python 3 in Windows
  18. Convert “\x” escaped string into readable string in python
  19. python encoding utf-8
  20. Python – dealing with mixed-encoding files
  21. Python 3 CSV file giving UnicodeDecodeError: ‘utf-8’ codec can’t decode byte error when I print
  22. UnicodeDecodeError when performing os.walk
  23. Replace non-ASCII characters with a single space
  24. UnicodeDecodeError: ‘ascii’ codec can’t decode byte 0xef in position 1
  25. Convert Unicode to ASCII without errors in Python
  26. Writing UTF-8 String to MySQL with Python
  27. ‘UCS-2’ codec can’t encode characters in position 1050-1050
  28. How to handle response encoding from urllib.request.urlopen() , to avoid TypeError: can’t use a string pattern on a bytes-like object
  29. How to send utf-8 e-mail?
  30. Read a base 64 encoded image from memory using OpenCv python library

Leave a Comment