How to count total number of trainable parameters in a tensorflow model?

by

Loop over the shape of every variable in tf.trainable_variables().

total_parameters = 0
for variable in tf.trainable_variables():
    # shape is an array of tf.Dimension
    shape = variable.get_shape()
    print(shape)
    print(len(shape))
    variable_parameters = 1
    for dim in shape:
        print(dim)
        variable_parameters *= dim.value
    print(variable_parameters)
    total_parameters += variable_parameters
print(total_parameters)

Update: I wrote an article to clarify the dynamic/static shapes in Tensorflow because of this answer: https://pgaleone.eu/tensorflow/2018/07/28/understanding-tensorflow-tensors-shape-static-dynamic/

More Related Contents:

  1. What’s the difference between sparse_softmax_cross_entropy_with_logits and softmax_cross_entropy_with_logits?
  2. What does tf.nn.conv2d do in tensorflow?
  3. should I use float or classes as output for the final layer in my neural network?
  4. How to make a custom activation function with only Python in Tensorflow?
  5. Keras input explanation: input_shape, units, batch_size, dim, etc
  6. Test labels for regression caffe, float not allowed?
  7. How to choose cross-entropy loss in TensorFlow?
  8. Keras + Tensorflow and Multiprocessing in Python
  9. What is the meaning of the word logits in TensorFlow? [duplicate]
  10. Tensorflow: How to replace or modify gradient?
  11. Tensorflow: How to write op with gradient in python?
  12. How to calculate the number of parameters for convolutional neural network?
  13. Multivariate LSTM with missing values
  14. Negative dimension size caused by subtracting 3 from 1 for ‘conv2d_2/convolution’
  15. LSTM module for Caffe
  16. caffe data layer example step by step
  17. Loading a trained Keras model and continue training
  18. How do I check if keras is using gpu version of tensorflow?
  19. What is the purpose of the add_loss function in Keras?
  20. Pytorch, what are the gradient arguments
  21. Multiple outputs in Keras
  22. Tensor is not an element of this graph
  23. Tensorflow : Memory leak even while closing Session?
  24. scale the loss value according to “badness” in caffe
  25. In Keras, what exactly am I configuring when I create a stateful `LSTM` layer with N `units`?
  26. Tensorflow One Hot Encoder?
  27. What is right batch normalization function in Tensorflow?
  28. caffe: model definition: write same layer with different phase using caffe.NetSpec()
  29. 2-D convolution as a matrix-matrix multiplication [closed]
  30. Choosing number of Steps per Epoch

Leave a Comment