Collectives™ on Stack Overflow

Find centralized, trusted content and collaborate around the technologies you use most.

Learn more about Collectives

Teams

Q&A for work

Connect and share knowledge within a single location that is structured and easy to search.

Learn more about Teams

If you check out the subprocess section of the Python docs , you'll notice there is an example of how to replace os.system() with subprocess.Popen() :

sts = os.system("mycmd" + " myarg")

...does the same thing as...

sts = Popen("mycmd" + " myarg", shell=True).wait()

The "improved" code looks more complicated, but it's better because once you know subprocess.Popen(), you don't need anything else. subprocess.Popen() replaces several other tools (os.system() is just one of those) that were scattered throughout three other Python modules.

If it helps, think of subprocess.Popen() as a very flexible os.system().

@JacobMarble so suppose I am calling a selenium scraping script from another python script, which of these would allow me to complete the scraping script and then and only then execute the next line of code? As in, my scraping should complete before the execution can continue. – praxmon Mar 27, 2015 at 13:15 Maybe also mention stackoverflow.com/questions/3172470/… to point out that you ought to avoid the shell=True if you can. Having this option is one of the benefits of subprocess.Popen() and its helper functions. – tripleee Feb 16, 2017 at 5:50 @PrakharMohanSrivastava If you want to block the flow and wait for command to complete its work check out: stackoverflow.com/a/2837319/5252192 – Amir Hossein Baghernezad Aug 1, 2017 at 6:59 @PrakharMohanSrivastava, in general both os.system and subprocess.call/popen/run does block/wait for the command to finish: stackoverflow.com/a/14059648/4752883 – alpha_989 Mar 10, 2018 at 0:54 It's elegant, but it's not complete, because it doesn't describe what os.system is missing, or why you might need Popen. – naught101 Dec 21, 2020 at 3:56

os.system is equivalent to Unix system command, while subprocess was a helper module created to provide many of the facilities provided by the Popen commands with an easier and controllable interface. Those were designed similar to the Unix Popen command.

system() executes a command specified in command by calling /bin/sh -c command, and returns after the command has been completed

Whereas:

The popen() function opens a process by creating a pipe, forking, and invoking the shell.

If you are thinking which one to use, then use subprocess definitely because you have all the facilities for execution, plus additional control over the process.

okay..then is there any way i can execute both os.system and popen in windows env ? i am a newbie and need to dig deeper.. – Arovit Jan 27, 2011 at 8:15 Yes, you can use both os.system and subprocess in Windows Environment. Have a look at basic tutorials from effbot.org (Python Standard Library online book) – Senthil Kumaran Jan 27, 2011 at 8:40

Subprocess is based on popen2, and as such has a number of advantages - there's a full list in the PEP here, but some are:

  • using pipe in the shell
  • better newline support
  • better handling of exceptions
  • When running python (cpython) on windows the <built-in function system> os.system will execute under the curtains _wsystem while if you're using a non-windows os, it'll use system.

    On contrary, Popen should use CreateProcess on windows and _posixsubprocess.fork_exec in posix-based operating-systems.

    That said, an important piece of advice comes from os.system docs, which says:

    The subprocess module provides more powerful facilities for spawning new processes and retrieving their results; using that module is preferable to using this function. See the Replacing Older Functions with the subprocess Module section in the subprocess documentation for some helpful recipes.

    Thanks for contributing an answer to Stack Overflow!

    • Please be sure to answer the question. Provide details and share your research!

    But avoid

    • Asking for help, clarification, or responding to other answers.
    • Making statements based on opinion; back them up with references or personal experience.

    To learn more, see our tips on writing great answers.