tensorflow-serving

Is it thread-safe when using tf.Session in inference service?

The tf.Session object is thread-safe for Session.run() calls from multiple threads. Before TensorFlow 0.10 graph modification was not thread-safe. This was fixed in the 0.10 release, so you can add nodes to the graph concurrently with Session.run() calls, although this is not advised for performance reasons; instead, it is recommended to call sess.graph.finalize() before using … Read more

How to import an saved Tensorflow model train using tf.estimator and predict on input data

I tried to search for a good base example, but it appears the documentation and samples are a bit scattered for this topic. So let’s start with a base example: the tf.estimator quickstart. That particular example doesn’t actually export a model, so let’s do that (not need for use case 1): def serving_input_receiver_fn(): “””Build the … Read more