Using Multiple page.open in Single Script

by

The problem is that the second page.open is being invoked before the first one finishes, which can cause multiple problems. You want logic roughly like the following (assuming the filenames are given as command line arguments):

function handle_page(file){
    page.open(file,function(){
        ...
        page.evaluate(function(){
            ...do stuff...
        });
        page.render(...);
        setTimeout(next_page,100);
    });
}
function next_page(){
    var file=args.shift();
    if(!file){phantom.exit(0);}
    handle_page(file);
}
next_page();

Right, it’s recursive. This ensures that the processing of the function passed to page.open finishes, with a little 100ms grace period, before you go to the next file.

By the way, you don’t need to keep repeating

page = require('webpage').create();

More Related Contents:

  1. phantomjs not waiting for “full” page load
  2. CasperJS/PhantomJS doesn’t load https page
  3. PhantomJS; click an element
  4. How can I scrape pages with dynamic content using node.js?
  5. Pass arguments with page.evaluate
  6. How to submit a form using PhantomJS
  7. CasperJS bind issue
  8. How to scroll down with Phantomjs to load dynamic content
  9. Save and render a webpage with PhantomJS and node.js
  10. How to render part of a page with PhantomJS?
  11. how to wait for element visibility in phantomjs
  12. Phantomjs page.content isn’t retrieving the page content
  13. save html output of page after execution of the page’s javascript
  14. how to Execute PhantomJS from PHP
  15. can phantomjs work with node.js?
  16. Using PhantomJS to embed all images of a webpage produces warnings but works
  17. Looping over urls to do the same thing
  18. Why doesn’t this.evaluate return DOM nodes correctly?
  19. How do I access an iframe from CasperJS?
  20. How to download a csv file using PhantomJS
  21. How to login into a website with CasperJS?
  22. Phantom JS synchronous AJAX request : NETWORK_ERR: XMLHttpRequest Exception 101
  23. Define a function with a prototype chain
  24. Is NaN falsy? Why NaN === false returns false
  25. JavaScript Array Push key value
  26. React native – objects are not valid as a React child (found: object with keys {$$typeof, type, key, ref, props, _owner, _store})
  27. Using JavaScript to increment top/left/bottom/right values
  28. How to create a “show more” button and specify how many lines of text can be initially shown
  29. Adding Event Listeners on Elements – Javascript
  30. Update or Change or Remove/Reset Javascript event listener

Leave a Comment