Using MPI_Bcast for MPI communication

by

This is a common source of confusion for people new to MPI. You don’t use MPI_Recv() to receive data sent by a broadcast; you use MPI_Bcast().

Eg, what you want is this:

#include <mpi.h>
#include <stdio.h>

int main(int argc, char** argv) {
        int rank;
        int buf;
        const int root=0;

        MPI_Init(&argc, &argv);
        MPI_Comm_rank(MPI_COMM_WORLD, &rank);

        if(rank == root) {
           buf = 777;
        }

        printf("[%d]: Before Bcast, buf is %d\n", rank, buf);

        /* everyone calls bcast, data is taken from root and ends up in everyone's buf */
        MPI_Bcast(&buf, 1, MPI_INT, root, MPI_COMM_WORLD);

        printf("[%d]: After Bcast, buf is %d\n", rank, buf);

        MPI_Finalize();
        return 0;
}

For MPI collective communications, everyone has to particpate; everyone has to call the Bcast, or the Allreduce, or what have you. (That’s why the Bcast routine has a parameter that specifies the “root”, or who is doing the sending; if only the sender called bcast, you wouldn’t need this.) Everyone calls the broadcast, including the receivers; the receviers don’t just post a receive.

The reason for this is that the collective operations can involve everyone in the communication, so that you state what you want to happen (everyone gets one processes’ data) rather than how it happens (eg, root processor loops over all other ranks and does a send), so that there is scope for optimizing the communication patterns (eg, a tree-based hierarchical communication that takes log(P) steps rather than P steps for P processes).

More Related Contents:

  1. sending blocks of 2D array in C using MPI
  2. struct serialization in C and transfer over MPI
  3. MPI_Bcast a dynamic 2d array
  4. Trouble Understanding MPI_Type_create_struct
  5. Understanding concurrent file writes from multiple processes
  6. MPI partition matrix into blocks
  7. Problems with SO_BINDTODEVICE Linux socket option
  8. Scatter Matrix Blocks of Different Sizes using MPI
  9. Sending columns of a matrix using MPI_Scatter
  10. How to compile an MPI included c program using cmake
  11. MPI_Type_create_subarray and MPI_Gather
  12. Creating an MPI_Datatype for a structure containing pointers
  13. Why My DeCompression is showing an Error?
  14. What is the difference between ‘asm’, ‘__asm’ and ‘__asm__’?
  15. do { … } while (0) — what is it good for? [duplicate]
  16. Create a pointer to two-dimensional array
  17. What is the fastest substring search algorithm?
  18. Setting variable to NULL after free
  19. What is an opaque pointer in C?
  20. Syntax and Sample Usage of _Generic in C11
  21. Container Class / Library for C [closed]
  22. Determining endianness at compile time [duplicate]
  23. Does pthread_cond_wait(&cond_t, &mutex); unlock and then lock the mutex?
  24. Execute program from within a C program
  25. How to build x86 and/or x64 on Windows from command line with CMAKE?
  26. Doesn’t a 2D array decay to pointer to pointer
  27. Is it possible to change argv or do I need to create an adjusted copy of it?
  28. What makes a better constant in C, a macro or an enum?
  29. Printing pointers in C
  30. How to compute 2⁶⁴/n in C?

Leave a Comment