Viability of small-scale HPC cloud infrastructures

Ogunshile, Emmanuel Kayode Akinshola

Abstract

RDMA networking has historically been linked closely and almost exclusively with HPC infrastructures. However, as demand for RDMA networking increases in fields outside of HPC, such as with Hadoop in the Big Data space, an increasing number of organisations are exploring methods of introducing merged HPC and cloud platforms into their daily operations. This paper explores the benefits of RDMA over traditional TCP/IP networking, and considers the challenges faced in the areas of storage and networking from the perspectives of integration, management and performance. It also explores the overall viability of building such a platform, providing a suitable hardware infrastructure for a fictional case study business.

• Presentation Conference Type: Conference Paper (published)
• Conference Name: 8th International Conference on Cloud Computing and Services Science
• Acceptance Date: Dec 15, 2018
• Publication Date: Mar 1, 2018
• Deposit Date: Jan 29, 2018
• Publicly Available Date: Jun 17, 2020
• Journal: scitepress
• Peer Reviewed: Peer Reviewed
• Volume: 2018-January
• Pages: 275-286
• Book Title: Proceedings of the 8th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER
• ISBN: 9789897582950
• DOI: https://doi.org/10.5220/0006640802750286
• Keywords: RDMA networking, TCP/IP networking, HPC infrastructures, cloud platforms, integration, management and performance
• Public URL: https://uwe-repository.worktribe.com/output/871022
• Publisher URL: https://doi.org/10.5220/0006640802750286
• Additional Information: Additional Information : This is the author's accepted manuscript. The final version has been published in the CLOSER proceedings, and is available via the following link https://doi.org/10.5220/0006640802750286
• Contract Date: Jan 29, 2018