Cross-platform Analysis of Fast Messages for Myrinet

Designing high performance communication software requires an in-depth understanding of the role of the components of the underlying machine/network architecture and their reciprocal interactions. The task is complicated by the continuing technological advances in the machine architectures. In this paper we analyze the performance of the Fast Messages (FM) high performance messaging layer on three platforms as different as a Spare 5, a Ultra 1, and a PentiumPro PC. Using a characterization in terms of the LogP model, me expose how the differences in the machine architectures are reflected in the way the different parts of a communication library like FM behaves and how their reciprocal interaction is affected. Our work shows that the FM implementation is "robust", tolerating large variations of machine performance while preserving the basic balances of its design. It also shows that a properly extended LogP model can be an invaluable architectural analysis tool.