Bridging Cloud and HPC

Design and roll out of functionalities for high-performance computing, high-performance data analytics, and AI applications on the MeluXina supercomputer.

The project at a glance

Start date:

01 Apr 2022
Duration in months:

48
Funding:

LuxProvide
Principal Investigator(s):

Pascal Bouvry

About

A project within the joint Industrial Research/Development programme between LuxProvide and SnT that aims to investigate, design, develop and roll out a set of functionalities related to the use of high-performance computing (HPC), high-performance data analytics (HPDA) and artificial intelligence (AI) applications on the MeluXina supercomputer (https://luxprovide.lu/) using Big Data tools and data ingestion/storage/processing APIs for bridging Clouds and HPC. High-performance, rich functionality, flexibility, automation, and intuitiveness are key differentiators which constitute a unique value proposition of the proposed HPC access system. To meet this broad range of features, the project will study state of the art of the design, architecture, and functionality of most used HPC systems in comparison with MeluXina, understanding typical patterns of interactions with HPC by different users, define and design a set of requirements for the bridging of Clouds and HPC platform (work done in collaboration with LuxProvide), identify the core issues at the core of the requirements and core research challenges. Focus will be put on high-performance, jobs interoperability, Data/AI workflow exchanges, ease of use and architectural implications. Through friendly user interfaces and data APIs, users will navigate and leverage computation and storage resources while real-time monitoring will be used in order to give visibility into security threats and act for ensuring secure access to the HPC resources.