Do Google’s crawlers interpret Javascript? What if I load a page through AJAX? [closed]

by

Despite the answers above, apparently it does interpret JavaScript, to an extent, according to Matt Cutts:

“For a while, we were scanning within JavaScript, and we were looking for links. Google has gotten smarter about JavaScript and can execute some JavaScript. I wouldn’t say that we execute all JavaScript, so there are some conditions in which we don’t execute JavaScript. Certainly there are some common, well-known JavaScript things like Google Analytics, which you wouldn’t even want to execute because you wouldn’t want to try to generate phantom visits from Googlebot into your Google Analytics”.

(Why answer an answered question? Mostly because I just saw it because of a duplicate question posted today, and didn’t see this info here.)

More Related Contents:

  1. Detecting ‘stealth’ web-crawlers
  2. How to write a crawler?
  3. Python Google Web Crawler
  4. Sending “User-agent” using Requests library in Python
  5. how to detect search engine bots with php?
  6. How can I scrape pages with dynamic content using node.js?
  7. How do I make a simple crawler in PHP? [closed]
  8. Scrapy – Reactor not Restartable [duplicate]
  9. How to pass a user defined argument in scrapy spider
  10. Parse HTML content in VBA
  11. How can I handle Javascript in a Perl web crawler?
  12. Click a Button in Scrapy
  13. Spider a Website and Return URLs Only
  14. Selenium wait for Ajax content to load – universal approach
  15. how to filter duplicate requests based on url in scrapy
  16. python: [Errno 10054] An existing connection was forcibly closed by the remote host
  17. how to extract links and titles from a .html page?
  18. How to give URL to scrapy for crawling?
  19. How can I use different pipelines for different spiders in a single Scrapy project
  20. getting Forbidden by robots.txt: scrapy
  21. Detecting honest web crawlers
  22. how do web crawlers handle javascript
  23. Web crawler that can interpret JavaScript [closed]
  24. selenium implicitly wait doesn’t work
  25. Finding the layers and layer sizes for each Docker image
  26. I need a Powerful Web Scraper library [closed]
  27. scrapy- how to stop Redirect (302)
  28. Creating a generic scrapy spider
  29. find a word on a website and get its page link
  30. How to programmatically fill input elements built with React?

Leave a Comment