TY  - JOUR
T1  - Adaptive CoMPI: Enhancing MPI based applications performance and scalability by using adaptive compression.
JF  - International Journal of High Performance Computing and Applications, 2010. Sage
Y1  - 2010
A1  - Rosa Filgueira
A1  - David E. Singh
A1  - Alejandro Calderón
A1  - Félix García Carballeira
A1  - Jesús Carretero
AB  - This paper presents an optimization of MPI communication, called Adaptive-CoMPI, based on runtime compression of MPI messages exchanged by applications. The technique developed can be used for any application, because its implementation is transparent for the user, and integrates different compression algorithms for both MPI collective and point-to-point primitives. Furthermore, compression is turned on and off and the most appropriate compression algorithms are selected at runtime, depending on the characteristics of each message, the network behavior, and compression algorithm behavior, following a runtime adaptive strategy. Our system can be optimized for a specific application, through a guided strategy, to reduce the runtime strategy overhead. Adaptive-CoMPI has been validated using several MPI benchmarks and real HPC applications. Results show that, in most cases, by using adaptive compression, communication time is reduced, enhancing application performance and scalability.
IS  - 25 (3)
ER  -