Abstract
MPI (Message Passing Interface) is getting more popular and important even in the Grid, but its performance still remains a problem, which is caused by the communication bottleneck on wide area links. To overcome such performance wall problem, we propose a dynamic topology selection which provides an effective resource selection service based on the principles of wide area message passing. It attempts to match the communication pattern of application with the topology of resources. Consequently, the proposed method provides an optimized set of resources and improves overall application performance by reducing the communication delay. To demonstrate the proposed method, we executed parallel benchmark programs and measured each execution time in five geometrically distributed clusters by changing resource selection method. When using topology selection method, experimental results show that performance gain can be achieved by up to 200%.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Foster, I., Kesselman, C. (eds.): The GRID: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, San Francisco (1998)
Message Passing Interface Forum, MPI: A Message-Passing Interface standard. International Journal of Supercomputer Applications 8(3/4), 165-414 (1994)
Foster, I., Karonis, N.: A grid-enabled MPI: Message passing in heterogeneous distributed computing systems. In: Proc. Supercomputing 1998, vol. 11 (1998)
Henderson, R., Tweten, D.: Portable Batch System: External reference specification, Ames. Research Center (1996)
Zhou, S.: LSF: Load Sharing in Large-scale Heterogeneous Distributed System. In: Proc. Workshop on Cluster Computing (1992)
Casanova, H., Obertelli, G., Berman, F., Wolski, R.: The AppLeS Parameter Sweep Template: User-Level Middleware for the Grid. In: Proc. Super Computing 2000, Dallas, Texas, vol. 11 (2000)
Frey, J., Tannenbaum, T., Foster, I., Livny, M., Tuecke, S.: Condor-G: A computation Management Agent for Multi-Institutional Grids. Cluster Computing 5(3) (2002)
Kielmann, T., Hofman, R.F.H., Bal, H.E., Plaat, A., Bhoedjang, R.A.F.: MagPIe: MPI’s Collective Communication Operations for Clustered Wide Area Systems. In: Proc. Symposium on Principles and Practice of Parallel Programming, Atlanta, GA, vol. 5 (1999)
Foster, I., Kesselman, C.: Globus: A metacomputing infrastructure toolkit. International Journal of Supercomputer Applications 11(2), 115–128 (1997)
Czajkowski, K., Fitzgerald, S., Foster, I., Kesselman, C.: Grid Information Service for Wide Area Distributed Computations. In: Proc. International Symposium on High Performance Distributed Computing, vol. 8 (2001)
Wolski, R., Spring, N., Hayes, J.: The Network Weather Service: A Distributed Resource Performance Forecasting Service for Metacomputing. Journal of Future Generation Computing Systems 15(5-6), 757–768 (1999)
Foster, I., Kesselman, C.: Resource Co-Allocation in Computational Grids. In: Proc. International Symposium on High Performance Distributed Computing, pp. 217–228 (1999)
Bailey, D., Harris, T., Saphir, W., Wijngaart, R., Woo, A., Yarrow, M.: NAS Parallel benchmark 2.0, Technical Report 95-020, NASA Ames Research Center, 12 (1995)
Antz Grid testbed, online at http://www.antz.or.kr
Subhlok, J., Venkataramaiah, S., Singh, A.: Characterizing NAS Benchmark Performance on Shared Heterogeneous Networks. In: Proc. International Parallel and Distributed Processing Symposium (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Park, KL. et al. (2003). Dynamic Topology Selection for High Performance MPI in the Grid Environments. In: Dongarra, J., Laforenza, D., Orlando, S. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2003. Lecture Notes in Computer Science, vol 2840. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-39924-7_80
Download citation
DOI: https://doi.org/10.1007/978-3-540-39924-7_80
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-20149-6
Online ISBN: 978-3-540-39924-7
eBook Packages: Springer Book Archive