Python 2.7: streaming HTTP server supporting multiple connections on one port

by

The default BaseHTTPServer settings re-bind a new socket on every listener, which won’t work in Linux if all the listeners are on the same port. Change those settings between the BaseHTTPServer.HTTPServer() call and the serve_forever() call.

The following example launches 100 handler threads on the same port, with each handler started through BaseHTTPServer.

import time, threading, socket, SocketServer, BaseHTTPServer

class Handler(BaseHTTPServer.BaseHTTPRequestHandler):

    def do_GET(self):
        if self.path != "https://stackoverflow.com/":
            self.send_error(404, "Object not found")
            return
        self.send_response(200)
        self.send_header('Content-type', 'text/html; charset=utf-8')
        self.end_headers()

        # serve up an infinite stream
        i = 0
        while True:
            self.wfile.write("%i " % i)
            time.sleep(0.1)
            i += 1

# Create ONE socket.
addr = ('', 8000)
sock = socket.socket (socket.AF_INET, socket.SOCK_STREAM)
sock.setsockopt(socket.SOL_SOCKET, socket.SO_REUSEADDR, 1)
sock.bind(addr)
sock.listen(5)

# Launch 100 listener threads.
class Thread(threading.Thread):
    def __init__(self, i):
        threading.Thread.__init__(self)
        self.i = i
        self.daemon = True
        self.start()
    def run(self):
        httpd = BaseHTTPServer.HTTPServer(addr, Handler, False)

        # Prevent the HTTP server from re-binding every handler.
        # https://stackoverflow.com/questions/46210672/
        httpd.socket = sock
        httpd.server_bind = self.server_close = lambda self: None

        httpd.serve_forever()
[Thread(i) for i in range(100)]
time.sleep(9e9)

More Related Contents:

  1. How to Multi-thread an Operation Within a Loop in Python
  2. What is a race condition?
  3. How can I pass a reference to a stack variable to a thread?
  4. How many threads is too many?
  5. How to create threads in nodejs
  6. How to avoid Not on FX application thread; currentThread = JavaFX Application Thread error?
  7. What is a semaphore?
  8. If threads share the same PID, how can they be identified?
  9. What is the Re-entrant lock and concept in general?
  10. how to set CPU affinity of a particular pthread?
  11. What does threadsafe mean?
  12. Which would be better for concurrent tasks on node.js? Fibers? Web-workers? or Threads?
  13. Asynchronous vs Multithreading – Is there a difference?
  14. How many memory barriers instructions does an x86 CPU have?
  15. How Do I Choose Between the Various Ways to do Threading in Delphi?
  16. Simple Thread Sample Delphi
  17. To use thread in programming in vb6
  18. How would you define a pool of goroutines to be executed at once?
  19. How to share data between threads in this threaded TCPServer?
  20. How JavaFX application thread works?
  21. Is non-blocking I/O really faster than multi-threaded blocking I/O? How?
  22. Are “data races” and “race condition” actually the same thing in context of concurrent programming
  23. When is a condition variable needed, isn’t a mutex enough?
  24. JavaFX working with threads and GUI
  25. What does it mean to say Apache spawns a thread per request, but node.js does not?
  26. How do I run parallel threads of computation on a partitioned array?
  27. omp parallel vs. omp parallel for
  28. Which is more efficient, basic mutex lock or atomic integer?
  29. software threads vs hardware threads
  30. How to parallelize file reading and writing

Leave a Comment