Error tells me I need JavaScript

You are actually getting the response from the site but the site’s server has its own way of responding when it receives a request from a client, which it thinks has no javascript support.

So, you need to look for ways to spoof your scraping call to the site to make it look like you can handle Javascript.

You can try to fake the user-agent request header but I seriously doubt that would work. You will be better off with something like Selenium.

Edit

Leave a Comment