How to do Xavier initialization on TensorFlow

by

Since version 0.8 there is a Xavier initializer, see here for the docs.

You can use something like this:

W = tf.get_variable("W", shape=[784, 256],
           initializer=tf.contrib.layers.xavier_initializer())

More Related Contents:

  1. TensorFlow not found using pip
  2. Convert a tensor to numpy array in Tensorflow?
  3. Keras not training on entire dataset
  4. How to apply gradient clipping in TensorFlow?
  5. FailedPreconditionError: Attempting to use uninitialized in Tensorflow
  6. NotImplementedError: Layers with arguments in `__init__` must override `get_config`
  7. Tensorflow error : DLL load failed: The specified procedure could not be found
  8. can’t import tensorflow in python, windows 10 64 bit
  9. How to set adaptive learning rate for GradientDescentOptimizer?
  10. Tensorflow Different ways to Export and Run graph in C++
  11. Tensorflow: How to replace a node in a calculation graph?
  12. This model has not yet been built error on model.summary()
  13. How to understand the term `tensor` in TensorFlow?
  14. Tensorflow r1.0 : could not a find a version that satisfies the requirement tensorflow
  15. TensorFlow ValueError: Cannot feed value of shape (64, 64, 3) for Tensor u’Placeholder:0′, which has shape ‘(?, 64, 64, 3)’
  16. TypeError: ‘Tensor’ object does not support item assignment in TensorFlow
  17. TensorFlow – numpy-like tensor indexing
  18. How do I set TensorFlow RNN state when state_is_tuple=True?
  19. In Tensorflow, get the names of all the Tensors in a graph
  20. Save and load model optimizer state
  21. Keras misinterprets training data shape
  22. In TensorFlow, what is the difference between Session.run() and Tensor.eval()?
  23. Why can I not import Tensorflow.contrib I get an error of No module named ‘tensorflow.python.saved
  24. How do I get the weights of a layer in Keras?
  25. Why is numpy native on M1 Max greatly slower than on old Intel i5?
  26. Is it thread-safe when using tf.Session in inference service?
  27. How do I plot a Keras/Tensorflow subclassing API model?
  28. Attach a queue to a numpy array in tensorflow for data fetch instead of files?
  29. TensorFlow 2.0 Keras: How to write image summaries for TensorBoard
  30. Multi-input Multi-output Model with Keras Functional API

Leave a Comment