Abstract
Historically, large computational clusters have supported hardware requirements for executing High-Performance Computing (HPC) applications. This model has become out of date due to the high costs of maintaining and updating these infrastructures. Currently, computing resources are delivered as a service because of the cloud computing paradigm. In this way, we witnessed consistent efforts to migrate HPC applications to the cloud. However, if on the one hand cloud computing offers an attractive environment for HPC, benefiting from the pay-per-use model and on-demand resource allocation, on the other, there are still significant performance challenges to be addressed, such as the known network bottleneck. In this article, we evaluate the use of a Network Interface Cards (NIC) aggregation approach, using the IEEE 802.3ad standard to improve the performance of representative HPC applications executed in LXD container based-cloud. We assessed the aggregation impact using two and four NICs with three distinct transmission hash policies. Our results demonstrated that if the correct hash policy is selected, the NIC aggregation can significantly improve the performance of network-intensive HPC applications by up to \(\approx \)40%.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
IEEE standard for information technology - local and metropolitan area networks - part 3: carrier sense multiple access with collision detection (CSMA/CD) access method and physical layer specifications-aggregation of multiple link segments. IEEE Std 802.3ad-2000, pp. 1–184 (2000)
Bailey, D., et al.: The NAS parallel benchmarks; summary and preliminary results. In: ACM/IEEE Conference on Supercomputing (SC), pp. 158–165 (1991)
Rista, C., Griebler, D., Maron, C.A.F., Fernandes, L.G: Improving the network performance of a container-based cloud environment for hadoop systems. In: 15th International Conference on High Performance Computing & Simulation (HPCS) (2017)
Chaufournier, L., Ali-Eldin, A., Sharma, P., Shenoy, P., Towsley, D.: Performance evaluation of multi-path TCP for data center and cloud workloads. In: ACM/SPEC International Conference on Performance Engineering, pp. 13–24 (2019)
Davis, T., et al.: Linux Ethernet Bonding (2011). https://www.kernel.org/doc/Documentation/networking/bonding.txt
Gupta, A., et al.: Evaluating and improving the performance and scheduling of HPC applications in cloud. IEEE Trans. Cloud Comput. (TCC) (2016)
Jain, R.: The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation, and Modeling. John Wiley & Sons Inc, Digital Equipment Corporation-Litleton, Massachusetts (1991)
Maliszewski, A.M., Vogel, A., Griebler, D., Roloff, E., Fernandes, L., Navaux, P.O.: Minimizing communication overheads in container-based clouds for HPC applications. In: IEEE Symposium on Computers and Communications (ISCC), pp. 1–6 (2019)
Mauch, V., Kunze, M., Hillenbrand, M.: High performance cloud computing. Future Gen. Comput. Syst. 29(6), 1408–1416 (2013)
Mell, P., Grance, T., et al.: The NIST definition of cloud computing. Nat. Inst. Stand. Technol. (NIST) (2011)
Pretto, G.R., et al.: Boosting HPC applications in the cloud through JIT traffic-aware path provisioning. In: Misra, S., et al. (eds.) ICCSA 2019. LNCS, vol. 11622, pp. 702–716. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-24305-0_52
Ramachandran, A., Vienne, J., Van Der Wijngaart, R., Koesterke, L., Sharapov, I.: Performance evaluation of NAS parallel benchmarks on Intel Xeon Phi. In: International Conference on Parallel Processing (ICPP), pp. 736–743 (2013)
Roloff, E., Diener, M., Gaspary, L.P., Navaux, P.O.A.: HPC application performance and cost efficiency in the cloud. In: Euromicro International Conference on Parallel, Distributed and Network-based Processing (PDP), pp. 473–477 (2017)
Sadooghi, I., et al.: Understanding the performance and potential of cloud computing for scientific applications. IEEE Trans. Cloud Comput. (TCC) 5(2), 358–371 (2017)
Stanisic, L., Legrand, A., Danjean, V.: An effective Git and org-mode based workflow for reproducible research. ACM SIGOPS Oper. Syst. Rev. 49(1), 61–70 (2015)
Watanabe, T., Nakao, M., Hiroyasu, T., Otsuka, T., Koibuchi, M.: Impact of topology and link aggregation on a PC cluster with ethernet. In: IEEE International Conference on Cluster Computing, pp. 280–285 (2008)
Wang, C., Yang, C., Liao, W., Chang, R., Wei, T.: Coupling GPU and MPTCP to improve hadoop/mapreduce performance. In: International Conference on Intelligent Green Building and Smart Grid (IGBSG), pp.1–6 (2016)
Acknowledgment
This work has been supported by the projects; 1) “GREEN-CLOUD: Computação em Cloud com Computação Sustentável” (#16/2551-0000 488-9) from FAPERGS and CNPq Brazil, program PRONEX 12/2014. 2) Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Brasil (CAPES) - Finance Code 001. 3) FAPERGS 01/2017-ARD project ParaElastic (N\(^{\text {o}}\) 17/2551-0000871-5) and the Universal MCTIC/CNPq N\(^{\text {o}}\) 28/2018 project SParCloud (No. 437693/2018-0). 4) BRICS Pilot Call 2016 project CloudHPC. 5) CNPq/MCTIC/BRICS-STI No 18/2016 Project Number 441892/2016-7. Finally, we thank the Três de Maio Faculty (SETREM) and the Laboratory of Advanced Research on Cloud Computing (LARCC), for providing access to computational infrastructure.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Maliszewski, A.M., Roloff, E., Griebler, D., Gaspary, L.P., Navaux, P.O.A. (2020). Performance Impact of IEEE 802.3ad in Container-Based Clouds for HPC Applications. In: Gervasi, O., et al. Computational Science and Its Applications – ICCSA 2020. ICCSA 2020. Lecture Notes in Computer Science(), vol 12254. Springer, Cham. https://doi.org/10.1007/978-3-030-58817-5_13
Download citation
DOI: https://doi.org/10.1007/978-3-030-58817-5_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-58816-8
Online ISBN: 978-3-030-58817-5
eBook Packages: Computer ScienceComputer Science (R0)