Initializing tensorflow Variable with an array larger than 2GB

by

It seems like the only option is to use a placeholder. The cleanest way I can find is to initialize to a placeholder directly:

X_init = tf.placeholder(tf.float32, shape=(3000000, 300))
X = tf.Variable(X_init)
# The rest of the setup...
sess.run(tf.initialize_all_variables(), feed_dict={X_init: model.syn0})

More Related Contents:

  1. How to compile Tensorflow with SSE4.2 and AVX instructions?
  2. On Windows, running “import tensorflow” generates No module named “_pywrap_tensorflow” error
  3. Keras : How should I prepare input data for RNN?
  4. Meaning of buffer_size in Dataset.map , Dataset.prefetch and Dataset.shuffle
  5. How does TensorFlow name tensors?
  6. What is the meaning of the word logits in TensorFlow? [duplicate]
  7. How to set specific gpu in tensorflow?
  8. Can I use TensorBoard with Google Colab?
  9. Understanding TensorBoard (weight) histograms
  10. How do I split Tensorflow datasets?
  11. After building TensorFlow from source, seeing libcudart.so and libcudnn errors
  12. Multivariate LSTM with missing values
  13. TensorFlow: numpy.repeat() alternative
  14. Specify connections in NN (in keras)
  15. What are the differences between all these cross-entropy losses in Keras and TensorFlow?
  16. Tensorflow: ImportError: libcusolver.so.8.0: cannot open shared object file: No such file or directory
  17. Tensorflow crashes with CUBLAS_STATUS_ALLOC_FAILED
  18. Keras Loss Function with Additional Dynamic Parameter
  19. Create keras callback to save model predictions and targets for each batch during training
  20. Working with multiple graphs in TensorFlow
  21. How to extract data/labels back from TensorFlow dataset
  22. Making predictions with a TensorFlow model
  23. tf.data with multiple inputs / outputs in Keras
  24. Update only part of the word embedding matrix in Tensorflow
  25. Convert between NHWC and NCHW in TensorFlow
  26. How to properly use tf.metrics.accuracy?
  27. How can I convert a trained Tensorflow model to Keras?
  28. ImportError: libcudnn when running a TensorFlow program
  29. Google Storage (gs) wrapper file input/out for Cloud ML?
  30. parallelising tf.data.Dataset.from_generator

Leave a Comment