You can always directly scrape Google results. To do this, you can use the URL https://google.com/search?q=<Query> this will return the top 10 search results. Then you can use lxml for example to parse the page. Depending on what you use, you can either query the resulting node tree via a CSS-Selector (.r a) or using … Read more
I assume you are using this library by Mario Vilas because of the stop=20 argument which appears in his code. It seems like this library is not able to return anything but the URLs, making it horribly undeveloped. As such, what you want to do is not possible with the library you are currently using. … Read more
If you are using the script element as data block, “the src attribute must not be specified”. If the script element is not used as data block, it has to be “used to include dynamic scripts”. But a JSON-LD document is not a dynamic script. For linking to another resource, just like you do it … Read more
Those are Google Sitelinks. You can block them by using Google Webmaster Tools, however they are auto-generated, and can only be remove-picked. After Google Webmaster Tools: Sitelinks are links to a site’s interior pages. Not all sites have sitelinks. Google generates these links automatically, but you can remove sitelinks you don’t want. (…) Sitelinks are … Read more
Google Search may change webpage titles they show in the result page (since 2012-01): We use many signals to decide which title to show to users, primarily the <title> tag if the webmaster specified one. But for some pages, a single title might not be the best one to show for all queries, and so … Read more
Request Overview The Google search request is a standard HTTP GET command. It includes a collection of parameters relevant to your queries. These parameters are included in the request URL as name=value pairs separated by ampersand (&) characters. Parameters include data like the search query and a unique CSE ID (cx) that identifies the CSE … Read more
UPDATE: Google have just published a blog article called Google Instant, behind the scenes. It’s an interesting read, and obviously related to this question. You can read how they tackled the extra load (5-7X according to the article) on the server-side, for example. The answer below examines what happens on the client-side: Examining with Firebug, … Read more
Google calls them sitelinks. You can’t enforce them currently: We only show sitelinks for results when we think they’ll be useful to the user. If the structure of your site doesn’t allow our algorithms to find good sitelinks, or we don’t think that the sitelinks for your site are relevant for the user’s query, we … Read more
This answers your problem. You can use JavaScript/Canvas to do the job but it is still experimental. Update: There is a library for this now https://html2canvas.hertzen.com/
Use PushState and Precomposition The current (2015) way to do this is using the JavaScript pushState method. PushState changes the URL in the top browser bar without reloading the page. Say you have a page containing tabs. The tabs hide and show content, and the content is inserted dynamically, either using AJAX or by simply … Read more