How can I split a URL string up into separate parts in Python?

by

The urlparse module in Python 2.x (or urllib.parse in Python 3.x) would be the way to do it.

>>> from urllib.parse import urlparse
>>> url="http://example.com/random/folder/path.html"
>>> parse_object = urlparse(url)
>>> parse_object.netloc
'example.com'
>>> parse_object.path
'/random/folder/path.html'
>>> parse_object.scheme
'http'
>>>

If you wanted to do more work on the path of the file under the URL, you can use the posixpath module:

>>> from posixpath import basename, dirname
>>> basename(parse_object.path)
'path.html'
>>> dirname(parse_object.path)
'/random/folder'

After that, you can use posixpath.join to glue the parts together.

Note: Windows users will choke on the path separator in os.path. The posixpath module documentation has a special reference to URL manipulation, so all’s good.

More Related Contents:

  1. Retrieving parameters from a URL
  2. URL query parameters to dict python
  3. Extracting a URL in Python
  4. How to extract top-level domain name (TLD) from URL
  5. How to get everything after last slash in a URL?
  6. Python urlparse — extract domain name without subdomain
  7. How do I get the different parts of a Flask request’s url?
  8. Get all text inside a tag in lxml
  9. using lxml and iterparse() to parse a big (+- 1Gb) XML file
  10. TypeError: expected a character buffer object – while trying to save integer to textfile
  11. How do you extract a url from a string using python?
  12. Searching text in a PDF using Python?
  13. Malformed String ValueError ast.literal_eval() with String representation of Tuple
  14. How to create a dictionary from a line of text?
  15. Python code to remove HTML tags from a string [duplicate]
  16. How do I send a POST request as a JSON?
  17. Python BeautifulSoup XML Parsing
  18. Python flask app routing in cpanel: can only access root url
  19. How to parse/read a YAML file into a Python object?
  20. Using isdigit for floats?
  21. How to parse a string and return a nested array?
  22. How can I unshorten a URL?
  23. Simple CSV to XML Conversion – Python
  24. Is there a built-in or more Pythonic way to try to parse a string to an integer
  25. urllib2 file name
  26. Comparing two xml files in python
  27. fuzzy timestamp parsing with Python
  28. Changing hostname in a url
  29. How to make unique short URL with Python?
  30. Download all pdf files from a website using Python

Leave a Comment