How is the Keras Conv1D input specified? I seem to be lacking a dimension

by

Don’t let the name confuse you. The layer tf.keras.layers.Conv1D needs the following shape: (time_steps, features). If your dataset is made of 10,000 samples with each sample having 64 values, then your data has the shape (10000, 64), which is not directly applicable to the tf.keras.layers.Conv1D layer. You are missing the time_steps dimension. What you can do is use the tf.keras.layers.RepeatVector, which repeats your array input n times, in the example 5. This way your Conv1D layer gets an input of the shape (5, 64). Check out the documentation for more information:


time_steps = 5
model = tf.keras.Sequential()
model.add(tf.keras.layers.Input(shape=(64,), name="input"))
model.add(tf.keras.layers.RepeatVector(time_steps))
model.add(tf.keras.layers.Conv1D(64, 2, activation="relu", padding="same", name="convLayer"))

As a side note, you should ask yourself if using a tf.keras.layers.Conv1D layer is the right option for your use case. This layer is usually used for NLP and other time series tasks. For example, in sentence classification, each word in a sentence is usually mapped to a high-dimensional word vector representation, as seen in the image. This results in data with the shape (time_steps, features).

                                          enter image description here

If you want to use character one hot encoded embeddings it would look something like this:

                                          enter image description here

This is a simple example of one single sample with the shape (10, 10) –> 10 characters along the time series dimension and 10 features. It should help you understand the tutorial I mentioned a bit better.

More Related Contents:

  1. Keras Dense layer’s input is not flattened
  2. Make a custom loss function in keras
  3. Keras not training on entire dataset
  4. Deep-Learning Nan loss reasons
  5. How to apply gradient clipping in TensorFlow?
  6. Can Keras with Tensorflow backend be forced to use CPU or GPU at will?
  7. Proper way to feed time-series data to stateful LSTM?
  8. ValueError at /image/ Tensor Tensor(“activation_5/Softmax:0”, shape=(?, 4), dtype=float32) is not an element of this graph
  9. Keras custom loss function: Accessing current input pattern
  10. How to get other metrics in Tensorflow 2.0 (not only accuracy)?
  11. How can I use a pre-trained neural network with grayscale images?
  12. Removing then Inserting a New Middle Layer in a Keras Model
  13. How to know if underfitting or overfitting is occuring?
  14. Save and load model optimizer state
  15. Unknown initializer: GlorotUniform when loading Keras model
  16. How to create a keras layer with a custom gradient in TF2.0?
  17. ‘Tensor’ object has no attribute ‘lower’
  18. ValueError: Output tensors to a Model must be the output of a TensorFlow `Layer`
  19. How to fix “ResourceExhaustedError: OOM when allocating tensor”
  20. What are logits? What is the difference between softmax and softmax_cross_entropy_with_logits?
  21. Keras + Tensorflow and Multiprocessing in Python
  22. How to concatenate two layers in keras?
  23. How to use a Keras RNN model to forecast for future dates or events?
  24. What do I need K.clear_session() and del model for (Keras with Tensorflow-gpu)?
  25. Passing output of a CNN to BILSTM
  26. error: (-2:Unspecified error) The function is not implemented. Rebuild the library with Windows, GTK+ 2.x or Cocoa support
  27. memory issues when transforming np.array using to_categorical
  28. How do I check if keras is using gpu version of tensorflow?
  29. Tensorflow : logits and labels must have the same first dimension
  30. NotImplementedError: Cannot convert a symbolic Tensor (2nd_target:0) to a numpy array

Leave a Comment