TensorFlow: How to measure how much GPU memory each tensor takes?

by

Now that 1258 has been closed, you can enable memory logging in Python by setting an environment variable before importing TensorFlow:

import os
os.environ['TF_CPP_MIN_VLOG_LEVEL']='3'
import tensorflow as tf

There will be a lot of logging as a result of this. You’ll want to grep the results to find the appropriate lines. For example:

grep MemoryLogTensorAllocation train.log

More Related Contents:

  1. TensorFlow and person recognition in video stream
  2. How to understand static shape and dynamic shape in TensorFlow?
  3. How to Properly Combine TensorFlow’s Dataset API and Keras?
  4. How Can I Define Only the Gradient for a Tensorflow Subgraph?
  5. Get the value of some weights in a model trained by TensorFlow
  6. How do I disable TensorFlow’s eager execution?
  7. Confused by the behavior of `tf.cond`
  8. Split a dataset created by Tensorflow dataset API in to Train and Test?
  9. TensorFlow: slow performance when getting gradients at inputs
  10. TensorFlow, why there are 3 files after saving the model?
  11. Tensorflow doesn’t seem to see my gpu
  12. tensorflow on GPU: no known devices, despite cuda’s deviceQuery returning a “PASS” result
  13. How can I run Tensorflow on one single core?
  14. Initializing tensorflow Variable with an array larger than 2GB
  15. Holding variables constant during optimizer
  16. TensorFlow: Dst tensor is not initialized
  17. Using Gensim Fasttext model with LSTM nn in keras
  18. What is the proper way to install TensorFlow on Apple M1 in 2022
  19. Simple way to visualize a TensorFlow graph in Jupyter?
  20. How do I convert a directory of jpeg images to TFRecords file in tensorflow?
  21. Tensorflow get all variables in scope
  22. Could not install packages due to an EnvironmentError: [WinError 5] Access is denied:
  23. CUDA_ERROR_OUT_OF_MEMORY in tensorflow
  24. Convert between NHWC and NCHW in TensorFlow
  25. How to properly use tf.metrics.accuracy?
  26. How can I convert a trained Tensorflow model to Keras?
  27. ImportError: libcudnn when running a TensorFlow program
  28. Google Storage (gs) wrapper file input/out for Cloud ML?
  29. parallelising tf.data.Dataset.from_generator
  30. Choosing number of Steps per Epoch

Leave a Comment