This tutorial will cover how to run an Artificial Intelligence (AI) model, based on the Pytorch framework, on the Voyager supercomputer. Voyager comprises an innovative architecture to optimize AI applications thanks to its Intel Habana Gaudi accelerators. We will discuss Voyager architecture and show how to launch jobs using containers in Kubernetes. Then, we will take a Pytorch application and will port it using Intel Gaudi libraries. We will discuss how to run Jupyter notebooks on Voyager. Finally, we will show how to pull a Hugginface model and run inference on Voyager using Transformers/Diffusers and Optimum-Habana libraries.
Voyager 101: Running AI Models on Voyager
Remote event
Instructor
Javier Hernandez-Nicolau, PhD
Data Scientist, SDSC
Dr. Javier Hernandez-Nicolau is a Data Scientist in the Scientific applications group at SDSC. He obtained his PhD in Plasma Physics and Nuclear Fusion at the University of Carlos III of Madrid (Spain) in 2019 and then worked as a Project Scientist at the University of California-Irvine. He developed and optimized fusion plasma codes for several HPC systems using Fortran, OpenMP and OpenACC. He joined SDSC in 2023 where he keeps collaborating with the Nuclear Fusion community developing ML/AI applications. He also offers user support to deploy a large variety of AI models on the Voyager system which uses Intel Gaudi accelerators.