How to extract data/labels back from TensorFlow dataset

by

In case your tf.data.Dataset is batched, the following code will retrieve all the y labels:

y = np.concatenate([y for x, y in ds], axis=0)

Quick explanation: [y for x, y in ds] is known as “list comprehension” in python. If dataset is batched, this expression will loop thru each batch and put each batch y (a TF 1D tensor) in the list, and return it. Then, np.concatenate will take this list of 1-D tensor (implicitly casting to numpy) and stack it in the 0-axis to produce a single long vector. In summary, it is just converting a bunch of 1-d little vector into one long vector.

Note: if your y is more complex, this answer will need some minor modification.

More Related Contents:

  1. Meaning of buffer_size in Dataset.map , Dataset.prefetch and Dataset.shuffle
  2. How do I split Tensorflow datasets?
  3. Split a dataset created by Tensorflow dataset API in to Train and Test?
  4. tf.data with multiple inputs / outputs in Keras
  5. parallelising tf.data.Dataset.from_generator
  6. Parallelism isn’t reducing the time in dataset map
  7. Which TensorFlow and CUDA version combinations are compatible?
  8. Can I measure the execution time of individual operations with TensorFlow?
  9. How to import an saved Tensorflow model train using tf.estimator and predict on input data
  10. Keras : How should I prepare input data for RNN?
  11. What’s the difference of name scope and a variable scope in tensorflow?
  12. How does TensorFlow name tensors?
  13. How Can I Define Only the Gradient for a Tensorflow Subgraph?
  14. What is the meaning of the “None” in model.summary of KERAS?
  15. Module ‘tensorflow’ has no attribute ‘contrib’
  16. Understanding TensorBoard (weight) histograms
  17. Confused by the behavior of `tf.cond`
  18. Multivariate LSTM with missing values
  19. TensorFlow: numpy.repeat() alternative
  20. TensorFlow: slow performance when getting gradients at inputs
  21. TensorFlow, why there are 3 files after saving the model?
  22. tensorflow on GPU: no known devices, despite cuda’s deviceQuery returning a “PASS” result
  23. How can I run Tensorflow on one single core?
  24. Create keras callback to save model predictions and targets for each batch during training
  25. Obtaining output of an Intermediate layer in TensorFlow/Keras
  26. ImportError: libcublas.so.10.0: cannot open shared object file: No such file or directory
  27. Convert between NHWC and NCHW in TensorFlow
  28. How can I convert a trained Tensorflow model to Keras?
  29. How to display custom images in TensorBoard using Keras?
  30. how does tensorflow indexing work

Leave a Comment