Docker how to run pip requirements.txt only if there was a change?

by

I’m assuming that at some point in your build process, you’re copying your entire application into the Docker image with COPY or ADD:

COPY . /opt/app
WORKDIR /opt/app
RUN pip install -r requirements.txt

The problem is that you’re invalidating the Docker build cache every time you’re copying the entire application into the image. This will also invalidate the cache for all subsequent build steps.

To prevent this, I’d suggest copying only the requirements.txt file in a separate build step before adding the entire application into the image:

COPY requirements.txt /opt/app/requirements.txt
WORKDIR /opt/app
RUN pip install -r requirements.txt
COPY . /opt/app
# continue as before...

As the requirements file itself probably changes only rarely, you’ll be able to use the cached layers up until the point that you add your application code into the image.

More Related Contents:

  1. Deploying a minimal flask app in docker – server connection issues
  2. Python app does not print anything when running detached in docker
  3. Activate python virtualenv in Dockerfile
  4. toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading
  5. Integrating Python Poetry with Docker
  6. standard_init_linux.go:211: exec user process caused “exec format error”
  7. Install Oracle Instant client into Docker container for Python cx_Oracle
  8. How do I reduce a python (docker) image size using a multi-stage build?
  9. Is distributing python source code in Docker secure?
  10. Error: pg_config executable not found when installing psycopg2 on Alpine in Docker
  11. standard_init_linux.go:178: exec user process caused “exec format error”
  12. Django connection to postgres by docker-compose
  13. Can’t install pip packages inside a docker container with Ubuntu
  14. Flask CLI throws ‘OSError: [Errno 8] Exec format error’ when run through docker-compose
  15. How to avoid reinstalling packages when building Docker image for Python projects?
  16. Reading in environment variables from an environment file
  17. installing cPickle with python 3.5
  18. WARNING: Running pip as the ‘root’ user
  19. ImportError: cannot import name ‘soft_unicode’ from ‘markupsafe’
  20. Encrypted and secure docker containers
  21. Docker- django throws error while connecting to postgres: psycopg2.OperationalError: could not connect to server: Connection refused
  22. Using a pip cache directory in docker builds
  23. Installing numpy on Docker Alpine
  24. Python multiprocessing application is getting stuck in docker container
  25. What’s the difference between Docker and Python virtualenv?
  26. Access Jupyter notebook running on Docker container
  27. Activate conda environment in docker
  28. How to ssh connect through Python Paramiko with ppk public key
  29. Get data from pandas into a SQL server with PYODBC
  30. Kill a running subprocess call

Leave a Comment