What is the role of TimeDistributed layer in Keras?

by

In keras – while building a sequential model – usually the second dimension (one after sample dimension) – is related to a time dimension. This means that if for example, your data is 5-dim with (sample, time, width, length, channel) you could apply a convolutional layer using TimeDistributed (which is applicable to 4-dim with (sample, width, length, channel)) along a time dimension (applying the same layer to each time slice) in order to obtain 5-d output.

The case with Dense is that in keras from version 2.0 Dense is by default applied to only last dimension (e.g. if you apply Dense(10) to input with shape (n, m, o, p) you’ll get output with shape (n, m, o, 10)) so in your case Dense and TimeDistributed(Dense) are equivalent.

More Related Contents:

  1. Keras Sequential model input layer
  2. keras: how to save the training history attribute of the history object
  3. How can I use a weight matrix created by a trained neural network to make predictions in another file?
  4. What is a `”Python”` layer in caffe?
  5. How to apply gradient clipping in TensorFlow?
  6. How does Keras calculate the accuracy?
  7. How to initialize weights in PyTorch?
  8. How to concatenate two layers in keras?
  9. How do I initialize weights in PyTorch?
  10. Does Any one got “AttributeError: ‘str’ object has no attribute ‘decode’ ” , while Loading a Keras Saved Model
  11. Keras custom loss function: Accessing current input pattern
  12. How can I use a pre-trained neural network with grayscale images?
  13. Removing then Inserting a New Middle Layer in a Keras Model
  14. How to use fit_generator with multiple inputs
  15. Multiple outputs in Keras
  16. How to log Keras loss output to a file
  17. How to fix “ResourceExhaustedError: OOM when allocating tensor”
  18. Can I send callbacks to a KerasClassifier?
  19. Keras give input to intermediate layer and get final output
  20. how to implement custom metric in keras?
  21. Many to one and many to many LSTM examples in Keras
  22. NaN loss when training regression network
  23. Can Keras with Tensorflow backend be forced to use CPU or GPU at will?
  24. How does Pytorch’s “Fold” and “Unfold” work?
  25. What is the difference between loss function and metric in Keras? [duplicate]
  26. Negative dimension size caused by subtracting 3 from 1 for ‘conv2d_2/convolution’
  27. Neural network XOR gate not learning
  28. How to implement the ReLU function in Numpy
  29. How do I plot a Keras/Tensorflow subclassing API model?
  30. Multi-input Multi-output Model with Keras Functional API

Leave a Comment