I very much share your take on CAPTCHA. I’ll list what I have been able to detect so far, for my own detection script, with similar goals. It’s only partial, as they are many more headless browsers. Fairly safe to use exposed window properties to detect/assume those particular headless browser: window._phantom (or window.callPhantom) //phantomjs window.__phantomas … Read more
You will need to use Casper fill() function. Below is an example which login to Facebook and print out your name after login. Note that you need to put in your username and password: var casper = require(‘casper’).create({ verbose: true, logLevel: ‘debug’, pageSettings: { loadImages: false, // The WebPage instance used by Casper will loadPlugins: … Read more
The CasperJS documentation has a pretty good description of what casper.evaluate() does. To recap: You pass a function that will be executed in the DOM context (you can also call it the page context). You can pass some primitives as arguments to this function and return one primitive back. Keep in mind that this function … Read more
This problem has been in my way for the last couple of days. The proxy solution wasn’t very clean in my environment so I found out where phantomjs’s QTNetworking core put the resources when it caches them. Long story short, here is my gist. You need the cache.js and mimetype.js files: https://gist.github.com/bshamric/4717583 //for this to … Read more
Because you’re mixing up casperjs and remote page environments. The evaluate function will execute code within the remote page env, so the console.log call won’t output anything. If you want to catch remote console.log calls, listen to the remote.message event: casper.on(‘remote.message’, function(msg) { this.echo(‘remote message caught: ‘ + msg); }) Btw, documentation for events is … Read more
Spent forever looking for this, and of course I found the answer minutes after posting the question. I can use the new frame switching commands added to phantomjs in this commit. Specifically, the this.page.switchToChildFrame(0) and this.page.switchToParentFrame() functions. It appears undocumented, and it also seems that the methods have been changed for upcoming releases, but it … Read more
It makes sense, because elmnt.options in the last snippet is an array full with undefined values. So you know the number of elements, but not their values. The reason is that DOM nodes cannot be passed from page context. The docs say: Note: The arguments and the return value to the evaluate function must be … Read more
Rule of thumb: All CasperJS functions which contain the words then and wait are asynchronous. This statement has many exceptions. What is then() doing? CasperJS is organized as a series of steps that handle the control flow of your script. then() handles the many PhantomJS/SlimerJS event types that define the ending of a step. When … Read more
PhantomJS and SlimerJS (the engines that are used for CasperJS) are not Node.js modules. They can be installed through npm for convenience. They have a different base infrastructure of modules which is distinct from Node.js. You will not be able to use imap or any module that depends on the net module. As Fanch points … Read more
Generally, it’s not possible because a casper script runs inside only one phantomjs runtime. In your case it seems possible. Note: Because this relies on a second casper instance, this cannot be used in a casper test environment. You can create a new casper instance (casper2) inside one step of the outer casper instance (casper1). … Read more