Abstract
The trend of data intensive grid applications has brought grid storage protocols and servers into focus. The objective of this study is to gain an understanding of how time is spent in the storage protocols and servers. The storage protocols have a variety of tuning parameters. Some parameters improve single client performance at the expense of increased server load, thereby limiting the number of served clients. What ultimately matters is the throughput of the whole system. Some parameters increase the flexibility or security of the system at some expense. The objective of this study is to make such trade-offs clear and enable easy full system optimization.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Sagal, B.: Grid Computing: The European Data Grid Project. In: IEEE Nuclear Science Symposium and Medical Imaging Conference, Lyon, France (2000)
CMS: The Compact Muon Solenoid Project (2004), http://cmsinfo.cern.ch/
LIGO: Laser Interferometer Gravitational Wave Observatory (2003), http://www.ligo.caltech.edu/
Allcock, B., Bester, J., Bresnahan, J., Chervenak, A., Foster, I., Kesselman, C., Meder, S., Nefedova, V., Quesnel, D., Tuecke, S.: Secure, efficient data transport and replica management for high-performance data-intensive computing. In: IEEE Mass Storage Conference, San Diego, CA (2001)
Bent, J., Venkataramani, V., LeRoy, N., Roy, A., Stanley, J., Arpaci-Dusseau, A.C., Arpaci-Dusseau, R.H., Livny, M.: Flexibility, manageability, and performance in a Grid storage appliance. In: Proceedings of the Eleventh IEEE Symposium on High Performance Distributed Computing (HPDC11), Edinburgh, Scotland (2002)
Sandberg, R., Goldberg, D., Kleiman, S., Walsh, D., Lyon, B.: Design and implementation of the Sun Network Filesystem. In: Proc. Summer, USENIX Conf., Portland OR (USA), pp. 119–130 (1985)
Oprofile: A System Wide Profiler for Linux (2003), http://oprofile.sourceforge.net
Anderson, J.M., Berc, L.M., Deanand, J., Ghemawat, S., Henzinger, M.R., Leung, S.A., Sites, R.L., Vandevoorde, M.T., Waldspurgerand, C.A., Weihl, W.E.: Continuous profiling: Where have all the cycles gone? In: Proceedings of the sixteenth ACM symposium on Operating systems principles (1997)
Barroso, L., Gharachorloo, K., Bugnion, E.: Memory system characterization of commercial workloads. In: Proceedings of the International Symposium on Computer Architecture (1998)
Lee, D., Crowley, P., Bear, J., Anderson, T., Bershad, B.: Execution characteristics of desktop applications on Windows NT. In: Proceedings of the 25th International Symposium on Computer Architecture (1998)
Crandall, P., Aydt, R., Chien, A., Reed, D.: Input/output characteristics of scalable parallel applications. In: Proceedings of the IEEE/ACM Conference of Supercomputing, San Diego, CA (1995)
Kuo, S., Winslett, M., Cho, Y., Lee, J., Chen, Y.: Efficient input and output for scientific simulations. In: Proceedings of I/O in PArallel and Distributed Systems (1999)
Tierney, B., Gunter, D.: NetLogger: A toolkit for distributed system performance tuning and debugging. Technical Report LBNL-51276, LBNL (2002)
Vazhkudai, S., Schopf, J.M., Foster, I.: Predicting the performance of wide area data transfers. In: Proceedings of the 16th Int. Parallel and Distributed Processing Symposium (2002)
Vazhkudai, S., Schopf, J.M.: Using disk throughput data in predictions of end-toend grid data transfers. In: Proceedings of the third International Workshop on Grid Computing, Baltimore, MD (2002)
Silberstein, M., Factor, M., Lorenz, D.: Dynamo - directory, net archiver and mover. In: Proceedings of the third International Workshop on Grid Computing, Baltimore, MD (2002)
Kosar, T., Livny, M.: Stork: Making Data Placement a First Class Citizen in the Grid. In: Proceedings of the 24th Int. Conference on Distributed Computing Systems, Tokyo, Japan (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kola, G., Kosar, T., Livny, M. (2004). Profiling Grid Data Transfer Protocols and Servers. In: Danelutto, M., Vanneschi, M., Laforenza, D. (eds) Euro-Par 2004 Parallel Processing. Euro-Par 2004. Lecture Notes in Computer Science, vol 3149. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-27866-5_59
Download citation
DOI: https://doi.org/10.1007/978-3-540-27866-5_59
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22924-7
Online ISBN: 978-3-540-27866-5
eBook Packages: Springer Book Archive