How to get current available GPUs in tensorflow?

by

There is an undocumented method called device_lib.list_local_devices() that enables you to list the devices available in the local process. (N.B. As an undocumented method, this is subject to backwards incompatible changes.) The function returns a list of DeviceAttributes protocol buffer objects. You can extract a list of string device names for the GPU devices as follows:

from tensorflow.python.client import device_lib

def get_available_gpus():
    local_device_protos = device_lib.list_local_devices()
    return [x.name for x in local_device_protos if x.device_type == 'GPU']

Note that (at least up to TensorFlow 1.4), calling device_lib.list_local_devices() will run some initialization code that, by default, will allocate all of the GPU memory on all of the devices (GitHub issue). To avoid this, first create a session with an explicitly small per_process_gpu_fraction, or allow_growth=True, to prevent all of the memory being allocated. See this question for more details.

More Related Contents:

  1. How to tell if tensorflow is using gpu acceleration from inside python shell?
  2. How do I use TensorFlow GPU?
  3. Clearing Tensorflow GPU memory after model execution
  4. Why is Tensorflow not recognizing my GPU after conda install?
  5. Training a simple model in Tensorflow GPU slower than CPU
  6. How to print the value of a Tensor object in TensorFlow?
  7. What are logits? What is the difference between softmax and softmax_cross_entropy_with_logits?
  8. How to export Keras .h5 to tensorflow .pb?
  9. How to choose cross-entropy loss in TensorFlow?
  10. Could not load dynamic library ‘cudart64_101.dll’ on tensorflow CPU-only installation
  11. Meaning of inter_op_parallelism_threads and intra_op_parallelism_threads
  12. Error running basic tensorflow example
  13. Keras replacing input layer
  14. Tensorflow: How to write op with gradient in python?
  15. ValueError at /image/ Tensor Tensor(“activation_5/Softmax:0”, shape=(?, 4), dtype=float32) is not an element of this graph
  16. Streaming large training and test files into Tensorflow’s DNNClassifier
  17. Conditional assignment of tensor values in TensorFlow
  18. How to get other metrics in Tensorflow 2.0 (not only accuracy)?
  19. Removing then Inserting a New Middle Layer in a Keras Model
  20. Why can’t I get reproducible results in Keras even though I set the random seeds?
  21. AttributeError: module ‘tensorflow.python.keras.utils.generic_utils’ has no attribute ‘populate_dict_with_module_objects’
  22. How to get stable results with TensorFlow, setting random seed
  23. “freeze” some variables/scopes in tensorflow: stop_gradient vs passing variables to minimize
  24. overcome Graphdef cannot be larger than 2GB in tensorflow
  25. How to fix “AttributeError: module ‘tensorflow’ has no attribute ‘get_default_graph'”?
  26. What is right batch normalization function in Tensorflow?
  27. Is it thread-safe when using tf.Session in inference service?
  28. Strange behaviour of the loss function in keras model, with pretrained convolutional base
  29. Attach a queue to a numpy array in tensorflow for data fetch instead of files?
  30. TensorFlow 2.0 Keras: How to write image summaries for TensorBoard

Leave a Comment