How to run a Jupyter notebook with Python code automatically on a daily basis?

by

Update
recently I came across papermill which is for executing and parameterizing notebooks.

https://github.com/nteract/papermill

papermill local/input.ipynb s3://bkt/output.ipynb -p alpha 0.6 -p l1_ratio 0.1

This seems better than nbconvert, because you can use parameters. You still have to trigger this command with a scheduler. Below is an example with cron on Ubuntu.

Old Answer

nbconvert --execute

can execute a jupyter notebook, this embedded into a cronjob will do what you want.

Example setup on Ubuntu:

Create yourscript.sh with the following content:

/opt/anaconda/envs/yourenv/bin/jupyter nbconvert \
                      --execute \
                      --to notebook /path/to/yournotebook.ipynb \
                      --output /path/to/yournotebook-output.ipynb

You have more options except –to notebook. I like this option since you have a fully executable “log”-File afterwards.

I recommend using a virtual environment to run your notebook, to avoid that future updates mess with your script. Do not forget to install nbconvert into the environment.

Now create a cronjob, that runs every day e.g. at 5:10 AM, by typing crontab -e in your terminal and add this line:

10 5 * * * /path/to/yourscript.sh

More Related Contents:

  1. Passing command line arguments to argv in jupyter/ipython notebook
  2. How do I increase the cell width of the Jupyter/ipython notebook in my browser?
  3. Jupyter Notebook with Python 3.8 – NotImplementedError
  4. Scheduling Python Script to run every hour accurately
  5. Schedule Python Script – Windows 7
  6. How do I get the current IPython / Jupyter Notebook name
  7. How to use Jupyter notebooks in a conda environment?
  8. Running Jupyter via command line on Windows
  9. Schedule a repeating event in Python 3
  10. How to load/edit/run/save text files (.py) into an IPython notebook cell?
  11. How to increase Jupyter notebook Memory limit?
  12. How to dynamically update a plot in a loop in IPython notebook (within one cell)
  13. How can I open the interactive matplotlib window in IPython notebook?
  14. Installing a pip package from within a Jupyter Notebook not working
  15. Passing IPython variables as arguments to bash commands
  16. How can I schedule a Task to execute at a specific time using celery?
  17. How can I share Jupyter notebooks with non-programmers? [closed]
  18. Jupyter Notebook 500 : Internal Server Error
  19. How can I display an image from a file in Jupyter Notebook?
  20. When I use matplotlib in jupyter notebook,it always raise ” matplotlib is currently using a non-GUI backend” error?
  21. OSError: cannot load library ‘C:\Program Files\R\R-4.0.2\bin\x64\R.dll’: error 0x7e
  22. Simple way to measure cell execution time in ipython notebook
  23. How to get autocomplete in jupyter notebook without using tab?
  24. How to disable password request for a Jupyter notebook session?
  25. IPython Notebook ipywidgets does not show
  26. Cannot open new Jupyter Notebook [Permission Denied]
  27. multi_line hover in bokeh
  28. Is there an equivalent to CTRL+C in IPython Notebook in Firefox to break cells that are running?
  29. import a function from another .ipynb file
  30. How to fix ipykernel_launcher.py: error: unrecognized arguments in jupyter?

Leave a Comment