Calling a python script with input within a python script using subprocess

by

To call a Python script from another one using subprocess module and to pass it some input and to get its output:

#!/usr/bin/env python3
import os
import sys
from subprocess import check_output

script_path = os.path.join(get_script_dir(), 'a.py')
output = check_output([sys.executable, script_path],
                      input="\n".join(['query 1', 'query 2']),
                      universal_newlines=True)

where get_script_dir() function is defined here.

A more flexible alternative is to import module a and to call a function, to get the result (make sure a.py uses if __name__=="__main__" guard, to avoid running undesirable code on import):

#!/usr/bin/env python
import a # the dir with a.py should be in sys.path

result = [a.search(query) for query in ['query 1', 'query 2']]

You could use mutliprocessing to run each query in a separate process (if performing a query is CPU-intensive then it might improve time performance):

#!/usr/bin/env python
from multiprocessing import freeze_support, Pool
import a

if __name__ == "__main__":
   freeze_support()
   pool = Pool() # use all available CPUs
   result = pool.map(a.search, ['query 1', 'query 2'])

More Related Contents:

  1. Subprocess.Popen: cloning stdout and stderr both to terminal and variables
  2. Python output to Console within Subprocess from the child scricpt
  3. How to suppress or capture the output of subprocess.run()?
  4. How to parallelize file downloads?
  5. Sending a password over SSH or SCP with subprocess.Popen
  6. Trying to fix tkinter GUI freeze-ups (using threads)
  7. What is the use of stub files (.pyi ) in python?
  8. “subprocess.Popen” – checking for success and errors
  9. Subprocess check_output returned non-zero exit status 1
  10. Print the result obtained from an external window but without opening the window (the selected checkboxes are automatically saved in the database)
  11. Syntax error on print with Python 3 [duplicate]
  12. How to search and replace text in a file?
  13. How to access variables from different classes in tkinter?
  14. live output from subprocess command
  15. Why do I need ‘b’ to encode a string with Base64?
  16. Django – No such table: main.auth_user__old
  17. Normalizing Unicode
  18. How to change the color of certain words in the tkinter text widget?
  19. subprocess.call() arguments ignored when using shell=True w/ list [duplicate]
  20. Accessing attributes on literals work on all types, but not `int`; why? [duplicate]
  21. Python subprocess.Popen() error (No such file or directory)
  22. How to escape curly-brackets in f-strings? [duplicate]
  23. How to kill a python child process created with subprocess.check_output() when the parent dies?
  24. NameError: global name ‘xrange’ is not defined in Python 3
  25. Multiprocessing causes Python to crash and gives an error may have been in progress in another thread when fork() was called
  26. ‘utf-8’ codec can’t decode byte 0x92 in position 18: invalid start byte
  27. Set up Python simpleHTTPserver on Windows [duplicate]
  28. Pandas ParserError EOF character when reading multiple csv files to HDF5
  29. What does colon at assignment for list[:] = […] do in Python [duplicate]
  30. Weird MRO result when inheriting directly from typing.NamedTuple

Leave a Comment