Store large data or a service connection per Flask session

by

The following applies to any global Python data that you don’t want to recreate for each request, not just rserve, and not just data that is unique to each user.

We need some common location to create an rserve connection for each user. The simplest way to do this is to run a multiprocessing.Manager as a separate process.

import atexit
from multiprocessing import Lock
from multiprocessing.managers import BaseManager
import pyRserve

connections = {}
lock = Lock()


def get_connection(user_id):
    with lock:
        if user_id not in connections:
            connections[user_id] = pyRserve.connect()

        return connections[user_id]


@atexit.register
def close_connections():
    for connection in connections.values():
        connection.close()


manager = BaseManager(('', 37844), b'password')
manager.register('get_connection', get_connection)
server = manager.get_server()
server.serve_forever()

Run it before starting your application, so that the manager will be available:

python rserve_manager.py

We can access this manager from the app during requests using a simple function. This assumes you’ve got a value for “user_id” in the session (which is what Flask-Login would do, for example). This ends up making the rserve connection unique per user, not per session.

from multiprocessing.managers import BaseManager
from flask import g, session

def get_rserve():
    if not hasattr(g, 'rserve'):
        manager = BaseManager(('', 37844), b'password')
        manager.register('get_connection')
        manager.connect()
        g.rserve = manager.get_connection(session['user_id'])

    return g.rserve

Access it inside a view:

result = get_rserve().eval('3 + 5')

This should get you started, although there’s plenty that can be improved, such as not hard-coding the address and password, and not throwing away the connections to the manager. This was written with Python 3, but should work with Python 2.

More Related Contents:

  1. How do Rpy2, pyrserve and PypeR compare?
  2. Why is sudo not accepting my sudo password? [closed]
  3. Deploying a minimal flask app in docker – server connection issues
  4. Flask view raises TypeError: ‘bool’ object is not callable
  5. How can I get the named parameters from a URL using Flask?
  6. How do you access the query string in Flask routes?
  7. Is it possible to use AngularJS with the Jinja2 template engine?
  8. Can I serve multiple clients using just Flask app.run() as standalone?
  9. Can Flask have optional URL parameters?
  10. Return JSON response from Flask view
  11. Why not generate the secret key every time Flask starts?
  12. Flask-Login raises TypeError: ‘bool’ object is not callable when trying to override is_active property
  13. Importing flask.ext raises ModuleNotFoundError
  14. Flask ImportError: No Module Named Flask
  15. How to build a flask application around an already existing database?
  16. Split Python Flask app into multiple files
  17. How to get http headers in flask?
  18. Flask-SQLAlchemy db.create_all() raises RuntimeError working outside of application context
  19. Reload Flask app when template file changes
  20. AttributeError: ‘int’ object has no attribute ‘_sa_instance_state’
  21. Does R have function startswith or endswith like python? [closed]
  22. Where does flask look for image files?
  23. How to show a pandas dataframe into a existing flask html table?
  24. How to send requests with JSON in unit tests
  25. Flask app “Restarting with stat”
  26. ValueError: Shape of passed values is (1, 6), indices imply (6, 6)
  27. Unable to “import matplotlib.pyplot as plt” in virtualenv
  28. How can we call one route from another route with parameters in Flask?
  29. Return a requests.Response object from Flask
  30. Converting matplotlib png to base64 for viewing in html template

Leave a Comment