Puppeteer – scroll down until you can’t anymore

by

Give this a shot:

const puppeteer = require('puppeteer');

(async () => {
    const browser = await puppeteer.launch({
        headless: false
    });
    const page = await browser.newPage();
    await page.goto('https://www.yoursite.com');
    await page.setViewport({
        width: 1200,
        height: 800
    });

    await autoScroll(page);

    await page.screenshot({
        path: 'yoursite.png',
        fullPage: true
    });

    await browser.close();
})();

async function autoScroll(page){
    await page.evaluate(async () => {
        await new Promise((resolve, reject) => {
            var totalHeight = 0;
            var distance = 100;
            var timer = setInterval(() => {
                var scrollHeight = document.body.scrollHeight;
                window.scrollBy(0, distance);
                totalHeight += distance;

                if(totalHeight >= scrollHeight - window.innerHeight){
                    clearInterval(timer);
                    resolve();
                }
            }, 100);
        });
    });
}

Source: https://github.com/chenxiaochun/blog/issues/38

EDIT

added window.innerHeight to the calculation because the available scrolling distance is body height minus viewport height, not the entire body height.

More Related Contents:

  1. Puppeteer page.evaluate querySelectorAll return empty objects
  2. Puppeteer log inside page.evaluate
  3. How to run Puppeteer code in any web browser?
  4. puppeteer: how to wait until an element is visible?
  5. How to pass a function in Puppeteers .evaluate() method?
  6. How to make Puppeteer work with a ReactJS application on the client-side
  7. Puppeteer unable to run on Heroku
  8. puppeteer: wait N seconds before continuing to the next line
  9. VSCODE: No debug adapter, can not send ‘variables'”
  10. Get elements from page.evaluate in Puppeteer? [duplicate]
  11. Can the browser turned headless mid-execution when it was started normally, or vice-versa?
  12. Why I got document is not defined error in puppeteer?
  13. puppeteer wait for page/DOM updates – respond to new items that are added after initial loading
  14. Puppeteer wait for all images to load then take screenshot
  15. How can I mock an ES6 module import using Jest?
  16. ReferenceError: fetch is not defined
  17. Is it possible to pass a flag to Gulp to have it run tasks in different ways?
  18. How to create a simple http proxy in node.js?
  19. How to sort in mongoose?
  20. How to use ES8 async/await with streams?
  21. Error: No Firebase App ‘[DEFAULT]’ has been created – call Firebase App.initializeApp()
  22. How to convert binary string to decimal?
  23. Secure distribution of NodeJS applications
  24. JavaScript performance difference between double equals (==) and triple equals (===)
  25. Difference between readFile() and readFileSync()
  26. Message “Async callback was not invoked within the 5000 ms timeout specified by jest.setTimeout”
  27. How to handle errors from setTimeout in JavaScript?
  28. Cloning an Object in Node.js
  29. How can I capture all network requests and full response data when loading a page in Chrome?
  30. chart.js Failed to create chart: can’t acquire context from the given item

Leave a Comment