Is Keras thread safe?

by

Yes, Keras is thread safe, if you pay a little attention to it.

In fact, in reinforcement learning there is an algorithm called Asynchronous Advantage Actor Critics (A3C) where each agent relies on the same neural network to tell them what they should do in a given state. In other words, each thread calls model.predict concurrently as in your problem. An example implementation with Keras of it is here.

You should, however, pay extra attention to this line if you looked into the code:
model._make_predict_function() # have to initialize before threading

This is never mentioned in the Keras docs, but its necessary to make it work concurrently. In short, _make_predict_function is a function that compiles the predict function. In multi thread setting, you have to manually call this function to compile predict in advance, otherwise the predict function will not be compiled until you run it the first time, which will be problematic when many threading calling it at once. You can see a detailed explanation here.

I have not met any other issues with multi threading in Keras till now.

More Related Contents:

  1. Tkinter: How to use threads to preventing main event loop from “freezing”
  2. Can’t pickle when using multiprocessing Pool.map()
  3. What are the differences between the threading and multiprocessing modules?
  4. PyQt4 Wait in thread for user input from GUI
  5. Keras + Tensorflow and Multiprocessing in Python
  6. Execute a function after Flask returns response
  7. How to concatenate two layers in keras?
  8. Thread that I can pause and resume?
  9. python multi-threading slower than serial?
  10. Does Any one got “AttributeError: ‘str’ object has no attribute ‘decode’ ” , while Loading a Keras Saved Model
  11. How does Keras 1d convolution layer work with word embeddings – text classification problem? (Filters, kernel size, and all hyperparameter)
  12. ValueError at /image/ Tensor Tensor(“activation_5/Softmax:0”, shape=(?, 4), dtype=float32) is not an element of this graph
  13. ValueError: Error when checking target: expected model_2 to have shape (None, 252, 252, 1) but got array with shape (300, 128, 128, 3)
  14. What do I need K.clear_session() and del model for (Keras with Tensorflow-gpu)?
  15. PyQt – Modify GUI from another thread
  16. Closing all threads with a keyboard interrupt
  17. memory issues when transforming np.array using to_categorical
  18. Thread local storage in Python
  19. How do threads work in Python, and what are common Python-threading specific pitfalls?
  20. Keras LSTM input dimension setting
  21. keras: how to save the training history attribute of the history object
  22. How to add and remove new layers in keras after loading weights?
  23. Unexpected keyword argument ‘ragged’ in Keras
  24. How to add an attention mechanism in keras?
  25. Can I send callbacks to a KerasClassifier?
  26. With “args” vs without “args” to pass arguments to a thread in Python
  27. How can I profile a multithread program in Python?
  28. how to implement custom metric in keras?
  29. How to prefetch data using a custom python function in tensorflow
  30. How do I run a long-running job in the background in Python

Leave a Comment