Examples of collective communication: broadcast, scatter, gather and reduction.