How to “log in” to a website using Python’s Requests module?

by

I know you’ve found another solution, but for those like me who find this question, looking for the same thing, it can be achieved with requests as follows:

Firstly, as Marcus did, check the source of the login form to get three pieces of information – the url that the form posts to, and the name attributes of the username and password fields. In his example, they are inUserName and inUserPass.

Once you’ve got that, you can use a requests.Session() instance to make a post request to the login url with your login details as a payload. Making requests from a session instance is essentially the same as using requests normally, it simply adds persistence, allowing you to store and use cookies etc.

Assuming your login attempt was successful, you can simply use the session instance to make further requests to the site. The cookie that identifies you will be used to authorise the requests.

Example

import requests

# Fill in your details here to be posted to the login form.
payload = {
    'inUserName': 'username',
    'inUserPass': 'password'
}

# Use 'with' to ensure the session context is closed after use.
with requests.Session() as s:
    p = s.post('LOGIN_URL', data=payload)
    # print the html returned or something more intelligent to see if it's a successful login page.
    print p.text

    # An authorised request.
    r = s.get('A protected web page url')
    print r.text
        # etc...

More Related Contents:

  1. Python Requests throwing SSLError
  2. Python Requests and persistent sessions
  3. Python requests – print entire http request (raw)?
  4. Python Requests library redirect new url
  5. MaxRetryError: HTTPConnectionPool: Max retries exceeded (Caused by ProtocolError(‘Connection aborted.’, error(111, ‘Connection refused’)))
  6. How could I use requests in asyncio?
  7. Can I set max_retries for requests.request?
  8. How to use cookies in Python Requests
  9. Python Requests – No connection adapters
  10. using requests with TLS doesn’t give SNI support
  11. Python Request Post with param data
  12. Upload Image using POST form data in Python-requests
  13. Unable to get local issuer certificate when using requests in python
  14. Fastest parallel requests in Python
  15. How to prevent python requests from percent encoding my URLs?
  16. Only download a part of the document using python requests
  17. How to receive json data using HTTP POST request in Django 1.6?
  18. Python : Trying to POST form using requests
  19. Python Requests getting SSLerror
  20. Requests, bind to an ip
  21. python requests get cookies
  22. How to send JSON as part of multipart POST-request
  23. How do I use basic HTTP authentication with the python Requests library?
  24. What is the difference between ‘content’ and ‘text’
  25. parse multipart/form-data, received from requests post
  26. How to get the raw content of a response in requests with Python?
  27. openssl, python requests error: “certificate verify failed”
  28. How to limit download rate of HTTP requests in requests python library?
  29. Progress of Python requests post
  30. Sending SOAP request using Python Requests

Leave a Comment