Research paper: Container Orchestration on HPC Systems

Naweiluo Zhou; Yiannis Georgiou; Li Zhong; Huan Zhou; Marcin Pospieszny

Abstract:

Containerisation demonstrates its efficiency in application deployment in cloud computing.

Containers can encapsulate complex programs with their dependencies in isolated environments, hence are being adopted in HPC clusters.

HPC workload managers lack micro-services support and deeply integrated container management, as opposed to container orchestrators (e.g. Kubernetes).

We introduce Torque-Operator (a plugin) which serves as a bridge between HPC workload managers and container Orchestrators.