How to get other metrics in Tensorflow 2.0 (not only accuracy)?

by

I am adding another answer because this is the cleanest way in order to compute these metrics correctly on your test set (as of 22nd of March 2020).

The first thing you need to do is to create a custom callback, in which you send your test data:

import tensorflow as tf
from tensorflow.keras.callbacks import Callback
from sklearn.metrics import classification_report 

class MetricsCallback(Callback):
    def __init__(self, test_data, y_true):
        # Should be the label encoding of your classes
        self.y_true = y_true
        self.test_data = test_data
        
    def on_epoch_end(self, epoch, logs=None):
        # Here we get the probabilities
        y_pred = self.model.predict(self.test_data))
        # Here we get the actual classes
        y_pred = tf.argmax(y_pred,axis=1)
        # Actual dictionary
        report_dictionary = classification_report(self.y_true, y_pred, output_dict = True)
        # Only printing the report
        print(classification_report(self.y_true,y_pred,output_dict=False)

In your main, where you load your dataset and add the callbacks:

metrics_callback = MetricsCallback(test_data = my_test_data, y_true = my_y_true)
...
...
#train the model
model.fit(x_train, y_train, callbacks = [cp_callback, metrics_callback,tensorboard], epochs=5)

More Related Contents:

  1. Keras Dense layer’s input is not flattened
  2. Make a custom loss function in keras
  3. Keras not training on entire dataset
  4. Deep-Learning Nan loss reasons
  5. How to apply gradient clipping in TensorFlow?
  6. Can Keras with Tensorflow backend be forced to use CPU or GPU at will?
  7. Proper way to feed time-series data to stateful LSTM?
  8. ValueError at /image/ Tensor Tensor(“activation_5/Softmax:0”, shape=(?, 4), dtype=float32) is not an element of this graph
  9. Keras custom loss function: Accessing current input pattern
  10. How can I use a pre-trained neural network with grayscale images?
  11. Removing then Inserting a New Middle Layer in a Keras Model
  12. How to know if underfitting or overfitting is occuring?
  13. Save and load model optimizer state
  14. Unknown initializer: GlorotUniform when loading Keras model
  15. How to create a keras layer with a custom gradient in TF2.0?
  16. ‘Tensor’ object has no attribute ‘lower’
  17. ValueError: Output tensors to a Model must be the output of a TensorFlow `Layer`
  18. How to fix “ResourceExhaustedError: OOM when allocating tensor”
  19. How is the Keras Conv1D input specified? I seem to be lacking a dimension
  20. Could not load dynamic library ‘cudart64_101.dll’ on tensorflow CPU-only installation
  21. Keras replacing input layer
  22. Keras Sequential model with multiple inputs
  23. expected ndim=3, found ndim=2
  24. How to understand the term `tensor` in TensorFlow?
  25. Custom loss function in Keras
  26. confusion matrix error “Classification metrics can’t handle a mix of multilabel-indicator and multiclass targets”
  27. Keras accuracy does not change
  28. How does mask_zero in Keras Embedding layer work?
  29. Can I send callbacks to a KerasClassifier?
  30. TensorFlow, “‘module’ object has no attribute ‘placeholder'”

Leave a Comment