Limit RAM usage to python program

by

I’ve done some research and found a function to get the memory from Linux systems here: Determine free RAM in Python and I modified it a bit to set the memory hard limit to half of the free memory available.

import resource
import sys

def memory_limit():
    """Limit max memory usage to half."""
    soft, hard = resource.getrlimit(resource.RLIMIT_AS)
    # Convert KiB to bytes, and divide in two to half
    resource.setrlimit(resource.RLIMIT_AS, (get_memory() * 1024 / 2, hard))

def get_memory():
    with open('/proc/meminfo', 'r') as mem:
        free_memory = 0
        for i in mem:
            sline = i.split()
            if str(sline[0]) in ('MemFree:', 'Buffers:', 'Cached:'):
                free_memory += int(sline[1])
    return free_memory  # KiB

if __name__ == '__main__':
    memory_limit_half()
    try:
        main()
    except MemoryError:
        sys.stderr.write('\n\nERROR: Memory Exception\n')
        sys.exit(1)

More Related Contents:

  1. How to get current CPU and RAM usage in Python?
  2. How to delete multiple pandas (python) dataframes from memory to save RAM?
  3. Data size in memory vs. on disk
  4. Google Colaboratory: misleading information about its GPU (only 5% RAM available to some users)
  5. Combine two columns of text in pandas dataframe
  6. Python Ctypes – loading dll throws OSError: [WinError 193] %1 is not a valid Win32 application
  7. Creating a list of dictionaries results in a list of copies of the same dictionary
  8. Why do some functions have underscores “__” before and after the function name?
  9. On localhost, how do I pick a free port number?
  10. Popen with conflicting executable/path
  11. custom matplotlib plot : chess board like table with colored cells
  12. Get the title of a window of another program using the process name
  13. How do you plot a vertical line on a time series plot in Pandas?
  14. why does pandas rolling use single dimension ndarray
  15. Import python package from local directory into interpreter
  16. How to fake/proxy a class in Python
  17. Python: Getting a traceback from a multiprocessing.Process
  18. Numpy loading csv TOO slow compared to Matlab
  19. How to sort dictionary by key in numerical order Python
  20. multiprocessing.Pool seems to work in Windows but not in ubuntu?
  21. How to force integer tick labels
  22. Run custom task when call `pip install`
  23. Are list comprehensions syntactic sugar for `list(generator expression)` in Python 3?
  24. Python and ctypes: how to correctly pass “pointer-to-pointer” into DLL?
  25. Convert True/False value read from file to boolean
  26. How to implement the ReLU function in Numpy
  27. Slow Requests on Local Flask Server
  28. Applying uppercase to a column in pandas dataframe
  29. Convert list of lists with different lengths to a numpy array [duplicate]
  30. Import statement works on PyCharm but not from terminal

Leave a Comment