TensorFlow operator overloading

by

If at least one of x or y is a tf.Tensor object, the expressions tf.add(x, y) and x + y are equivalent. The main reason you might use tf.add() is to specify an explicit name keyword argument for the created op, which is not possible with the overloaded operator version.

Note that if neither x nor y is a tf.Tensor—for example if they are NumPy arrays—then x + y will not create a TensorFlow op. tf.add() always creates a TensorFlow op and converts its arguments to tf.Tensor objects. Therefore, if you are writing a library function that might accept both tensors and NumPy arrays, you might prefer to use tf.add().

The following operators are overloaded in the TensorFlow Python API:

  • __neg__ (unary -)
  • __abs__ (abs())
  • __invert__ (unary ~)
  • __add__ (binary +)
  • __sub__ (binary -)
  • __mul__ (binary elementwise *)
  • __div__ (binary / in Python 2)
  • __floordiv__ (binary // in Python 3)
  • __truediv__ (binary / in Python 3)
  • __mod__ (binary %)
  • __pow__ (binary **)
  • __and__ (binary &)
  • __or__ (binary |)
  • __xor__ (binary ^)
  • __lt__ (binary <)
  • __le__ (binary <=)
  • __gt__ (binary >)
  • __ge__ (binary >=)

Please note, __eq__ ( binary == ) is not overloaded. x == y will simply return a Python boolean whether x and y refer to the same tensor. You need to use tf.equal() explicitly to check for element-wise equality. Same goes for not equal, __ne__ ( binary != ).

More Related Contents:

  1. What are logits? What is the difference between softmax and softmax_cross_entropy_with_logits?
  2. Make a custom loss function in keras
  3. Keras not training on entire dataset
  4. Deep-Learning Nan loss reasons
  5. How to apply gradient clipping in TensorFlow?
  6. Can Keras with Tensorflow backend be forced to use CPU or GPU at will?
  7. Proper way to feed time-series data to stateful LSTM?
  8. ValueError at /image/ Tensor Tensor(“activation_5/Softmax:0”, shape=(?, 4), dtype=float32) is not an element of this graph
  9. Keras custom loss function: Accessing current input pattern
  10. How to get other metrics in Tensorflow 2.0 (not only accuracy)?
  11. How can I use a pre-trained neural network with grayscale images?
  12. How to understand the term `tensor` in TensorFlow?
  13. Removing then Inserting a New Middle Layer in a Keras Model
  14. How do I set TensorFlow RNN state when state_is_tuple=True?
  15. error: (-2:Unspecified error) The function is not implemented. Rebuild the library with Windows, GTK+ 2.x or Cocoa support
  16. How to know if underfitting or overfitting is occuring?
  17. Unbalanced data and weighted cross entropy
  18. Save and load model optimizer state
  19. Unknown initializer: GlorotUniform when loading Keras model
  20. Tensor is not an element of this graph
  21. How to handle non-determinism when training on a GPU?
  22. How to create a keras layer with a custom gradient in TF2.0?
  23. Tensorflow One Hot Encoder?
  24. Tensorflow Precision / Recall / F1 score and Confusion matrix
  25. ‘Tensor’ object has no attribute ‘lower’
  26. ValueError: Output tensors to a Model must be the output of a TensorFlow `Layer`
  27. How to fix “ResourceExhaustedError: OOM when allocating tensor”
  28. How is the Keras Conv1D input specified? I seem to be lacking a dimension
  29. TensorFlow, “‘module’ object has no attribute ‘placeholder'”
  30. How do you read Tensorboard files programmatically?

Leave a Comment