Can MPI_Publish_name be used for two separately started applications?

by

MPI_Publish_name is supplied with an MPI info object, which could have an Open MPI specific boolean key ompi_global_scope. If this key is set to true, then the name would be published to the global scope, i.e. to an already running instance of ompi-server. MPI_Lookup_name by default first does a global name lookup if the URI of the ompi-server was provided.

With a dedicated Open MPI server

The process involves several steps:

1) Start the ompi-server somewhere in the cluster where it could be accessed from all nodes. For debugging purposes you may pass it the --no-daemonize -r + argument. It would start and print to the standard output an URI similar to this one:

$ ompi-server --no-daemonize -r +
1221656576.0;tcp://10.1.13.164:36351;tcp://192.168.221.41:36351

2) In the server, build an MPI info object and set the ompi_global_scope key to true:

MPI_Info info;

MPI_Info_create(&info);
MPI_Info_set(info, "ompi_global_scope", "true");

Then pass the info object to MPI_Publish_name:

MPI_Publish_name("server", info, port_name);

3) In the client, the call to MPI_Lookup_name would automatically do the lookup in the global context first (this could be changed by providing the proper key in the MPI info object, but in your case the default behaviour should suffice).

In order for both client and server code to know where the ompi-server is located, you have to give its URI to both mpirun commands with the --ompi-server 1221656576.0;tcp://10.1.13.164:36351;tcp://192.168.221.41:36351 option.

Another option is to have ompi-server write the URI to a file, which can then be read on the node(s) where mpirun is to be run. For example, if you start the server on the same node where both mpirun commands are executed, then you could use a file in /tmp. If you start the ompi-server on a different node, then a shared file system (NFS, Lustre, etc.) would do. Either way, the set of commands would be:

$ ompi-server [--no-daemonize] -r file:/path/to/urifile
...
$ mpirun --ompi-server file:/path/to/urifile server
...
$ mpirun --ompi-server file:/path/to/urifile client

Serverless method

If run both mpirun‘s on the same node, the --ompi-server could also specify the PID of an already running mpirun instance to be used as a name server. It allows you to use local name publishing in the server (i.e. skip the “run an ompi-server” and “make an info object” parts). The sequence of commands would be:

head-node$ mpirun --report-pid server
[ note the PID of this mpirun instance ]
...
head-node$ mpirun --ompi-server pid:12345 client

where 12345 should be replaced by the real PID of the server’s mpirun.

You can also have the server’s mpirun print its URI and pass that URI to the client’s mpirun:

$ mpirun --report-uri + server
[ note the URI ]
...
$ mpirun --ompi-server URI client

You could also have the URI written to a file if you specify /path/to/file (note: no file: prefix here) instead of + after the --report-uri option:

$ mpirun --report-uri /path/to/urifile server
...
$ mpirun --ompi-server file:/path/to/urifile client

Note that the URI returned by mpirun has the same format as that of an ompi-server, i.e. it includes the host IP address, so it also works if the second mpirun is executed on a different node, which is able to talk to the first node via TCP/IP (and /path/to/urifile lives on a shared file system).

I tested all of the above with Open MPI 1.6.1. Some of the variant might not work with earlier versions.

More Related Contents:

  1. MPI_Rank return same process number for all process
  2. Probe seems to consume the CPU
  3. MPI hangs on MPI_Send for large messages
  4. sending blocks of 2D array in C using MPI
  5. Sending and receiving 2D array over MPI
  6. MPI_Recv overwrites parts of memory it should not access
  7. Ordering Output in MPI
  8. struct serialization in C and transfer over MPI
  9. How do I debug an MPI program?
  10. Sending 2D arrays in Fortran with MPI_Gather
  11. MPI_Bcast a dynamic 2d array
  12. MPI: blocking vs non-blocking
  13. Using MPI_Bcast for MPI communication
  14. Tools to measure MPI communication costs [closed]
  15. Trouble Understanding MPI_Type_create_struct
  16. Creating a counter that stays synchronized across MPI processes
  17. Good profiler for Fortran and MPI
  18. Understanding concurrent file writes from multiple processes
  19. MPI partition matrix into blocks
  20. Scatter Matrix Blocks of Different Sizes using MPI
  21. Sending columns of a matrix using MPI_Scatter
  22. MPI Reading from a text file
  23. How to compile an MPI included c program using cmake
  24. Parallel Algorithms for Generating Prime Numbers (possibly using Hadoop’s map reduce)
  25. MPI_Type_create_subarray and MPI_Gather
  26. writing a matrix into a single txt file with mpi
  27. assign two MPI processes per core
  28. thread safety of MPI send using threads created with std::async
  29. Creating an MPI_Datatype for a structure containing pointers
  30. MPI_Gather gives seg fault in the most basic code

Leave a Comment