Accelerating scientific applications with OpenMP offload on SDSC Cosmos (Advanced Computing Series)
In this talk we show how OpenMP offload capabilities can allow many traditional scientific codes to run on GPUs. We will provide an overview of which problems are best candidates to be accelerated, and what are the typical pain points programmers can expect. We will also show how shared-memory systems, like the AMD MI300A in SDSC Cosmos, can help mitigate some of those problems. Presented on September 8, 2026
Interactive Video
Agentic Tools and Coding with AI/LLMs
AMD EPYC Advanced User Training on Expanse
This event will help users to make the most effective use of Expanse’s AMD EPYC processors. Topics include an introduction to the EPYC architecture, AMD compilers and math libraries, strategies for mapping processes and tasks to compute cores, Slurm, application tuning and profiling tools. Presented on April 21, 2021
Webinar RecordingGitHub Repository
Architecting Reproducible Science: A Practical Path Beyond the Notebook
Jupyter Notebooks are great for exploration, but terrible for reproducibility and scaling. This talk shows how to migrate notebook code into a structured Python package that can run anywhere—locally, on HPC clusters, or in automated pipelines. We’ll connect these practices to early-stage MLOps concepts, illustrating how packaging is the foundation for reproducible scientific computing. Presented on March 10, 2026
Webinar RecordingInteractive Video
Basic Docker and Kubernetes
Batch Computing: Getting Started with Batch Job Scheduling - Slurm Edition (COMPLECS)
A brief introduction on how to schedule your batch jobs on high-performance computing systems using the Slurm Workload Manager. Presented on March 21, 2024
Webinar RecordingInteractive Video
Batch Computing: Working with the Linux Scheduler
A brief introduction to the Linux scheduler, how to interact with it, and run your research workloads on your personal computer, a shared workstation, or even a high-performance computing system.
Presented on February 12, 2026
Webinar RecordingInteractive Video
Batch Computing: Working with the Linux Scheduler (COMPLECS)
A brief introduction to the Linux scheduler, how to interact with it, and run your research workloads on your personal computer, a shared workstation, or even a high-performance computing system.
Presented on February 6, 2025
Webinar RecordingInteractive Video
Batch Computing (Part II): Getting Started with Batch Job Scheduling (COMPLECS)
Cheap & FAIR Data Practices
This webinar will cover practices that projects at all scales can adopt to promote using the FAIR data principles in their work. I will demonstrate how to apply these practices by deploying a data portal using the Serverless Research Data Repository (SRDR) model, building on free and allocated resources like Globus collections and GitHub repositories. During the webinar, participants will learn the basic components of a research data repository, FAIR data guidelines, dataset elements including files, metadata, identifiers, and landing pages, the role of machine-readable metadata in data discovery, and how to apply access control policies to datasets. Presented on May 13, 2025
Webinar RecordingInteractive Video
Code Migration (COMPLECS)
Code Migration (COMPLECS)
This session introduces key strategies for transitioning computations to HPC systems, including using pre-installed software, compiling code with appropriate tools, and setting up Python, R, and conda environments. It also covers workflow management and introduces containerized solutions with Singularity, featuring hands-on practice on SDSC resources.
Presented on May 28, 2026
Webinar RecordingInteractive Video
Code Migration (COMPLECS)
Code Migration (COMPLECS)
Co-Designing Intelligent Cyberinfrastructure for Computing Continuum: Overview of the Activities at the NSF-AI Institute ICICLE
This talk will start with an overview of the ICICLE (Intelligent CyberInfrastructure (CI) with Computational Learning in the Environment), an NSF-AI Institute, to address these challenges. Presented on February 10, 2026
Webinar RecordingInteractive Video
Containers (COMPLECS)
Containers provide a lightweight, portable way to package and run applications consistently across different computing environments. In HPC and research workflows, they simplify software deployment and ensure reproducibility. Presented on June 11, 2026
Webinar RecordingInteractive Video
Cyberinfrastructure-Enabled Machine Learning Summer Institute
The CIML Summer Institute will involve introducing ML researchers, developers and educators to the techniques and methods needed to migrate their ML applications from smaller, locally run resources, such as laptops and workstations, to large-scale HPC systems, such as the SDSC Expanse supercomputer. Presented on June 27, 2022
Interactive Videos
Data Management & File Systems
Managing data efficiently on a supercomputer is important from both users' and system's perspectives. In this webinar, we will cover a few basic data management techniques and I/O best practices in the context of the Expanse system at SDSC. Presented on March 16, 2023
Interactive Video
Data Storage and File Systems (COMPLECS)
Data Storage and File Systems (COMPLECS)
High-performance computing (HPC) systems use various specialized storage and file systems, each with different performance levels and best-use scenarios. Here, we explain how to properly use these systems for your research. We also introduce common filesystems, their architectures, appropriate I/O patterns, and key Linux tools for managing storage usage, backups, and file permissions.
Presented on April 30, 2026
Webinar RecordingGitHub RepositoryInteractive Video
Data Storage and File Systems (COMPLECS)
Data Transfer (COMPLECS)
Efficiently transferring data is a critical part of building research workflows, whether working with experimental or simulated data on local or high-performance computing (HPC) systems. Here, we introduce key concepts and command-line tools for data transfer, including how to verify data integrity, use compression, and select appropriate transfer methods based on data size, location, and organization. Presented on September 17, 2026
Webinar RecordingInteractive VideoGitHub Repository
Data Transfer (COMPLECS)
Data Transfer (COMPLECS)
Data Transfer (COMPLECS)
Data Transfer (COMPLECS)
Efficiently transferring data is a critical part of building research workflows, whether working with experimental or simulated data on local or high-performance computing (HPC) systems. Here, we introduce key concepts and command-line tools for data transfer, including how to verify data integrity, use compression, and select appropriate transfer methods based on data size, location, and organization.
Presented on March 12, 2026
Webinar RecordingInteractive Video
Deploying JupyterHub and Coder
Expanse 101: Accessing and Running Jobs on Expanse
This webinar covers the basics of accessing the SDSC Expanse supercomputer, managing the user environment, compiling and running jobs on Expanse. Presented on October 8, 2020
Interactive Video
Expanse Webinar: Accessing and Running Jobs on Expanse
This webinar covers the basics of accessing SDSC's Expanse supercomputer, managing the user environment, compiling and running jobs using Slurm, where to run them, and how to run batch jobs. We will also cover interactive computing using applications such as Jupyter Notebooks and how to run them via the command line or from the Expanse portal. It is assumed that you have mastered the basic skills of logging onto HPC systems using SSH and running basic Unix commands on these systems. Presented on February 17, 2022
Interactive Video
Expanse Webinar: Accessing and Running Jobs on Expanse
This webinar covers the basics of accessing SDSC's Expanse supercomputer, managing the user environment, compiling and running jobs using Slurm, where to run them, and how to run batch jobs. Presented on September 16, 2021
Interactive Video
Expanse Webinar: An Introduction to Singularity: Containers for Scientific and High-Performance Computing
Come learn about Singularity containers and how you might use them in your own work. Presented on January 21, 2021
Interactive Video
Expanse Webinar: Composable Systems in Expanse
This webinar will present the approach and the architecture of the composable systems component of Expanse. We will also summarize scientific case studies that demonstrate the application of this new infrastructure and its federation with Nautilus, a Kubernetes-based GPU geo-distributed cluster. Presented on April 15, 2021
Interactive Video
Expanse Webinar: Data Management & File Systems on Expanse
Managing data efficiently on a supercomputer is very important from both users' and system's perspectives. In this webinar, we will cover some of the basic data management techniques, I/O best practices in the context of the Expanse system at SDSC. Presented on October 21, 2021
Interactive Video
Expanse Webinar: Enduring Security: The Journey Continues
The first in a recurring webinar series on using Expanse and other SDSC HPC resources securely. This webinar will cover security and security-related topics relevant to researchers and the trustworthiness of their work produced on these resources. Presented on April 21, 2022
Interactive Video
Expanse Webinar: GPU Computing and Programming on Expanse
This webinar will give a brief introduction to GPU computing and programming on Expanse. We will cover the GPU architecture, programming with the NVIDIA HPC SDK via libraries, OpenACC compiler directives, CUDA, profiling and debugging, and submitting GPU enabled jobs on Expanse. Presented on May 20, 2021
Interactive Video
Expanse Webinar: How-to secure your Jupyter notebook sessions on Expanse
Come learn how to launch your Jupyter notebook sessions on Expanse in a simple, secure way. Presented on December 14, 2021
Interactive Video
Expanse Webinar: Introduction to Neural Networks, Convolution Neural Networks and Deep Learning on Expanse
This webinar will be a quick introduction and overview of neural networks, convolution networks, and deep learning on Expanse. Presented on May 19, 2022
Interactive Video
Expanse Webinar: Parallel Computing Concepts
In this webinar we cover supercomputer architectures, the differences between threads and processes, implementations of parallelism (e.g., OpenMP and MPI), strong and weak scaling, limitations on scalability (Amdahl’s and Gustafson’s Laws) and benchmarking. Presented on September 14, 2022
Interactive Video
Expanse Webinar: Parallel Computing Concepts
In this webinar we cover supercomputer architectures, the differences between threads and processes, implementations of parallelism (e.g., OpenMP and MPI), strong and weak scaling, limitations on scalability (Amdahl’s and Gustafson’s Laws) and benchmarking. Presented on January 20, 2022
Interactive Video
Expanse Webinar: Performance Tuning and Single Processor Optimization
Presentation will cover cache-level optimizations and other techniques for achieving optimal software performance. We will also cover AMD specific compiler options, libraries and performance tools. Presented on February 18, 2021
Interactive Video
Expanse Webinar: Running Jupyter Notebooks on Expanse
In this webinar, we will present SDSC’s multitiered approach to running notebooks more securely: hosting Jupyter services on Expanse using SSH Tunneling or using the SDSC Jupyter Reverse Proxy Service (JRPS), which connects the user over an HTTPS connection. The JRPS will launch a batch script that creates a securely hosted HTTPS access point for the user, resulting in a safer, more secure notebook environment. Presented on December 10, 2020
Interactive Video
Expanse Webinar: Run your Jupyter Notebooks anywhere: Scaling up your Projects from Laptop to Expanse
In this webinar we demonstrate how to transition your Jupyter Notebooks from a local machine to the Expanse HPC system using command-line tools and the Expanse Portal. We cover creating transferable software environments, scaling up calculations to large datasets, parallel processing, and running Jupyter Notebooks in batch mode. Presented on June 16, 2022
Interactive Video
Expanse Webinar: Scientific Computing with Kubernetes
In this webinar we provide recipes for transitioning scientific workloads that currently run on traditional batch systems to Kubernetes systems. Kubernetes is batch-like in nature, but there are some differences that science users should be aware of. We will also briefly describe capabilities that are not found in traditional batch systems that can improve the effectiveness of scientific computing. Presented on October 20, 2022
Interactive Video
Expanse Webinar: Singularity – Containers for Scientific and High-Performance Computing
Come learn all about Singularity containers. In this webinar, we'll provide an overview of Singularity and how you might incorporate the use of containers in your own research. We'll also show you how to access and use some of the containerized applications that we make available to users on Expanse at SDSC. Presented on March 17, 2022
Interactive Video
Fine Tuning Large Language Models (LLMs) with Domain Specific Datasets
Large language models (LLMs) are trained on massive, publicly available text datasets containing trillions of tokens. However, these models do not necessarily possess sufficient subject matter expertise and often struggle to provide meaningful responses to specialized prompts. Therefore, fine-tuning LLMs with domain-specific datasets – extracted from documents, articles, and other sources – is crucial. In this presentation, we will demonstrate fine-tuning a few smaller LLMs with LoRA approach using instruct datasets on Gaudi hardware. Presented on April 14, 2026
Webinar RecordingInteractive Video
From Atoms to Algorithms: GPU Acceleration of Molecular Dynamics, DFT, and QM/MM Simulations
This talk highlights advances in GPU-accelerated molecular simulations and the hardware that enables them. We will begin with an overview of modern GPU architectures, supercomputers, and programming models that leverage massive parallelism for scientific computing. We will then discuss GPU-optimized molecular dynamics simulations with Amber and quantum chemistry calculations with QUICK, a massively parallel Hartree-Fock and DFT program that performs all major computations on GPUs. Together, these tools enable efficient QM/MM molecular dynamics simulations across diverse GPU platforms. Advances in software and GPU technology are thus transforming the scale and accuracy of simulations for complex chemical and biological systems. Presented on May 12, 2026
Webinar RecordingInteractive Video
Getting Started with Batch Job Scheduling: Slurm Edition
Learn how to write your first batch job script and submit it to a Slurm batch job scheduler. We discuss best practices on how to structure your batch job scripts, teach you how to leverage Slurm environment variables, and provide you with some tips on how to request resources from the scheduler to get your work done faster. We also introduce you to some advanced features like Slurm job arrays and job dependencies for more structured computational workflows. Presented on February 16, 2023
Interactive Video
Getting Started with Batch Job Scheduling (Batch computing Part II) (COMPLECS)
High-performance computing (HPC) systems rely on batch job schedulers like Slurm to efficiently and fairly manage shared computing resources through scripted job submissions. Here, we introduce new users to distributed batch job schedulers, guiding them through writing and submitting their first Slurm job scripts while covering best practices, resource requests, and useful environment variables. Presented on August 20, 2026
Webinar RecordingGitHub RepositoryInteractive Video
GitLab CI/CD and Custom Images (Advanced I)
GPU Computing and Programming on Expanse
This webinar gives a brief introduction to GPU computing and programming on Expanse. We will cover the GPU architecture, programming with the Nvidia CUDA Toolkit and HPC SDK via libraries, OpenACC compiler directives, and CUDA, and submitting GPU enabled jobs on Expanse. Presented on October 26, 2023
Webinar RecordingInteractive Video
High Performance Computing and Data Science Summer Institute
This year’s Summer Institute continues SDSC’s strategy of bringing HPC to the “long tail of science,” i.e., providing resources to a larger number of modest-sized computational research projects that represent, in aggregate, a tremendous amount of scientific research and discovery. Presented on August 2, 2021
GitHub Repository
High Performance Computing and Data Science Summer Institute
The HPC and Data Science Summer Institute is a week-long workshop focusing on a broad spectrum of introductory-to-intermediate topics in High Performance Computing and Data Science. The program is aimed at researchers in academia and industry, especially in domains not traditionally engaged in supercomputing, who have problems that cannot typically be solved using local computing resources. Presented on August 1, 2022
Interactive VideosGitHub Repository
High-Throughput and Many-Task Computing - Slurm Edition (Batch Computing - Part III) (COMPLECS)
How to build and run your high-throughput and many-task computing workflows on high-performance computing systems using the Slurm Workload Manager. Presented on December 4, 2025
Webinar RecordingInteractive Video
High-Throughput and Many-Task Computing - Slurm Edition (COMPLECS)
How to build and run your high-throughput and many-task computing workflows on high-performance computing systems using the Slurm Workload Manager. Presented on October 17, 2024
Webinar RecordingInteractive Video
HPC/CI Training Series
SDSC’s High Performance Computing (HPC)/ Cyberinfrastructure (CI) Training Series was developed to support UC San Diego undergraduates and graduates interested in furthering their knowledge of HPC concepts and hands-on training, as well as, building a team interested in competing in the Student Cluster Competition held at the annual International Conference for High Performance Computing, Networking, Storage, and Analysis (SC). This program is available to any who are interested in advancing their knowledge and experience on HPC systems and concepts. Presented on January 14, 2022
GitHub Repository
HPC CI Onboarding for the UCSD Research Community
The mini-workshop is designed to provide the UCSD research community with a streamlined pathway to swiftly engage with the Expanse cluster for their scientific endeavors. Collaboratively organized by Research IT and SDSC, this workshop series offers participants the opportunity to start using the Expanse cluster through the Campus Champions allocation, while benefiting from comprehensive training resources and expert guidance provided by SDSC. Presented on October 3, 2023
Interactive Video
HPC Hardware Overview (COMPLECS)
A brief introduction into what makes up a HPC system and how users should use this information. No programming required. Presented on November 7, 2024
Webinar RecordingInteractive Video
HPC Hardware Overview (COMPLECS)
A brief introduction into what makes up a HPC system and how users should use this information. No programming required. Presented on April 4, 2024
Webinar RecordingInteractive Video
HPC Security and Getting Help (COMPLECS)
Discussion on best practices for using HPC systems and getting support
Presented on August 15, 2024
Recorded Webinar
HPC Security and Getting Help (COMPLECS)
Implementing Research Data Management for Labs & Grants
Implement a practical and well supported data management plan for your research lab, project or grant with SeedMeLab. Presented on April 28, 2021
Webinar Recording
Interactive Computing (COMPLECS)
Interactive high-performance computing (HPC) involves real-time user inputs that result in actions being performed on HPC compute nodes. This session presents an overview of interactive computing tools and methods. Presented on March 20, 2025
Webinar RecordingInteractive Video
Interactive Computing (COMPLECS)
Interactive high-performance computing (HPC) involves real-time user inputs that result in actions being performed on HPC compute nodes. This session presents an overview of interactive computing tools and methods. Presented on October 9, 2025
Webinar RecordingInteractive Video
Interactive Computing (COMPLECS)
Interactive high-performance computing (HPC) involves real-time user inputs that result in actions being performed on HPC compute nodes. This session presents an overview of interactive computing tools and methods. Presented on December 5, 2024
Webinar RecordingInteractive Video
Interactive Computing (COMPLECS)
Interactive high-performance computing (HPC) involves real-time user inputs that result in actions being performed on HPC compute nodes. This session presents an overview of interactive computing tools and methods. Presented on April 18, 2024
Webinar RecordingInteractive VideoGitHub Repository
Interactive Computing (COMPLECS)
Interactive high-performance computing (HPC) involves real-time user inputs that result in actions being performed on HPC compute nodes. This session presents an overview of interactive computing tools and methods. Presented on March 26, 2026
Webinar RecordingInteractive Video
Interactive Computing on High Performance Computing Resources
Interactive computing includes commonly used programs, such as word processors or spreadsheet applications running user devices (mobile phones, laptops). Interactive high-performance computing (HPC) involves real-time user inputs that result in actions being performed on HPC compute nodes. In this session we’ll present an overview of interactive computing tools and methods. Presented on December 7, 2023
Webinar RecordingInteractive Video
Interactive Digital Twins: Accelerating The Mission to Fusion Energy
In this talk, we will describe an AI-enabled digital twin of the DIII-D National Fusion Facility that transforms fusion energy research by reducing plasma simulation times from weeks to seconds. Presented on April 7, 2026
Interactive Video
Intermediate Kubernetes
Intermediate Linux
Linux command line interface (CLI) skills are essential for advanced cyberinfrastructure (CI). This session covers filesystem hierarchy, permissions, links, wildcards, finding files, environment variables, modules, config files, aliases, history & Bash scripting tips. Presented on January 29, 2026
Webinar RecordingGitHub RepositoryInteractive Video
Intermediate Linux (COMPLECS)
Linux command line interface (CLI) skills are essential for advanced cyberinfrastructure (CI). This session covers filesystem hierarchy, permissions, links, wildcards, finding files, environment variables, modules, config files, aliases, history & Bash scripting tips. Presented on July 9, 2026
Webinar RecordingInteractive Video
Intermediate Linux (COMPLECS)
Intermediate Linux (COMPLECS)
Intermediate Linux and Shell Scripting (COMPLECS)
A survey of intermediate Linux skills for effectively using advanced cyberinfrastructure. Presented on September 19, 2024
LinkRecorded Webinar
Intermediate Linux and Shell Scripting (COMPLECS)
Intermediate Linux and Shell Scripting (COMPLECS)
Introduction to Neural Networks, Convolution Neural Networks and Deep Learning
This webinar will be a quick introduction and overview of neural networks, convolution networks, and demonstration of executing deep learning models in an HPC environment. Presented on April 20, 2023
Interactive Video
Introduction to Singularity: Creating and Running Containers for High-Performance Computing
In this webinar, Yuwu Chen from TSCC User Services will show how to build Singularity images and then run them on the SDSC supercomputer clusters such as TSCC. Yuwu will also be sharing his insider knowledge of best practices along with pitfalls to avoid while working with Singularity. Presented on October 13, 2022
Interactive Video
Introduction to the National Research Platform
Introduction to TSCC 2.0
This training will cover everything users need to know about the new TSCC 2.0 system that will be launched in phases starting late spring. Topics will include changes to the TSCC system, scheduler, queues, software stack, accounting, and policies for using TSCC. Presented on April 13, 2023
Recording
Kubernetes for Science Compute
Several new scientific compute resources are becoming available only through Kubernetes and their users will have to adapt their workloads to interface to it. This tutorial provides the basic Kubernetes notions any science user will need, paired with extensive hands-on exercises on a production-quality system to better explore the details. Presented on May 4, 2022
RepositoryVideo
Linux Shell Scripting (COMPLECS)
Linux Shell Scripting (COMPLECS)
Shell scripting improves productivity and reduces errors in HPC workflows by automating tasks like data processing, backups, and system monitoring. This session builds on basic Linux command-line skills to teach Bash scripting syntax, constructs, and best practices for effective automation. Presented on April 9, 2026
Webinar RecordingInteractive Video
Linux Shell Scripting (COMPLECS)
Linux Tools for File Processing (COMPLECS)
Linux Tools for File Processing (COMPLECS)
Linux tools for text processing (COMPLECS)
An overview of commonly used Linux tools for searching and manipulating text. We progress from the simplest tools, such as head, tail, cut, paste, to more complex tools grep, awk and sed. Presented on September 3, 2026
Webinar RecordingInteractive VideoGitHub Repository
Linux Tools for Text Processing (COMPLECS)
Linux Tools for Text Processing (COMPLECS)
Linux Tools for Text Processing (COMPLECS)
An overview of commonly used Linux tools for searching and manipulating text. We progress from the simplest tools, such as head, tail, cut, paste, to more complex tools grep, awk and sed.
Presented on February 26, 2026
Webinar RecordingInteractive Video
Parallel and GPU Computing with MATLAB
In this session you will learn how to solve and accelerate computationally and data-intensive problems that are becoming common in the areas of machine learning and deep learning using multicore processors, GPUs, and computer clusters. Presented on April 27, 2022
RepositoryInteractive Video
Parallel Computing Concepts
In this webinar we cover supercomputer architectures, the differences between threads and processes, implementations of parallelism (e.g., OpenMP and MPI), strong and weak scaling, limitations on scalability (Amdahl’s and Gustafson’s Laws) and benchmarking. Presented on January 19, 2023
Interactive Video
Parallel Computing Concepts (COMPLECS)
A brief introduction to fundamental concepts in parallel computing. Topics include threads, processes, Amdahl’s Law, benchmarking, and factors that limit scalability. No programming experience needed.
Presented on January 15, 2026
Webinar RecordingGitHub RepositoryInteractive Video
Parallel Computing Concepts (COMPLECS)
Parallel Computing Concepts (COMPLECS)
Parallel Computing Concepts (COMPLECS)
Parallel Computing Concepts (COMPLECS)
PEARC25 Workshop: Opportunities, benefits and challenges of sharing memory between CPUs and GPUs
Performance Tuning and Optimization
This webinar is a condensed version of the Performance Tuning session, targeting code developers who want to speed up their calculations. It will cover various optimization techniques, including cache usage, loop optimization, and compiler optimization, with exercises primarily in C but applicable to any language. Presented on February 11, 2025
Webinar RecordingInteractive Video
Performance Tuning and Optimization
This session is intended for attendees who do their own code development and need their calculations to finish as quickly as possible. We cover effective use of cache, loop-level optimizations, and other topics for writing and building optimal code. Presented on September 21, 2023
Interactive Video
Portable Accelerator Programming with SYCL
SYCL is an open standard for programming heterogeneous architectures in ISO C++. This webinar will give a high-level overview of the SYCL programming language and the software ecosystem to write and tune SYCL code for different accelerator architectures. We will focus on GPUs and discuss how we can provide SYCL performance portability across hardware from different vendors, including Intel, Nvidia, and AMD GPUs, by employing a single-source model based on a modern C++ standard. As an example of complex scientific software, we will demonstrate briefly how the Amber molecular dynamics software was ported from CUDA to SYCL using Intel oneAPI software development tools and Intel Xe architecture GPUs. We will discuss numerical results and benchmark data that demonstrate the accuracy and performance of the SYCL implementation on data center and consumer-grade GPU hardware. Presented on November 4, 2025
Webinar RecordingInteractive Video
Porting your AI application to Voyager Gaudi Architecture
Voyager offers a unique architecture to optimize and scale deep learning applications. In this tutorial we will introduce Voyager and its Gaudi architecture. Then we will take a Pytorch application and port it to the Voyager system. Finally, how to run any Huggingface models to Voyager will be also discussed. Presented on April 8, 2025
Webinar RecordingInteractive VideoGitHub Repository
Python for HPC
In this session, we will explore two transformative Python technologies—Numba and Dask—that empower researchers to bridge the gap between Python’s flexibility and the performance demands of supercomputing environments. These tools unlock new possibilities for accelerating computationally intensive tasks and scaling workflows across clusters. Presented on September 9, 2025
Webinar RecordingInteractive VideoBlog Post
R for HPC
We will focus on (1) R package management and user environment configuration on the HPC cluster and (2) understanding the R parallelism in HPC, such as using the "parallel" package in R and a few related packages to parallelize and enhance the performance of R programs. Presented on December 9, 2025
Webinar RecordingInteractive Video
Rich Data Sharing for HPC Users
This free webinar will introduce HPCShare, a web-based resource for users of SDSC’s high-performance computing resources, including Expanse, to easily share small-to medium-scale datasets in an efficient and organized manner. Attendees will learn about using HPCShare and SDSC’s SeedMeLab scientific data management system. Hosted by SDSC Visualization Group Lead Amit Chourasia. Presented on April 22, 2021
Interactive Video
Run your Jupyter Notebooks anywhere: Scaling up your Projects from your Laptop
In this webinar, we demonstrate how to transition your Jupyter Notebooks from a local machine to the Expanse HPC system using command-line tools and the Expanse Portal. We cover creating transferable software environments, scaling up calculations to large datasets, parallel processing, and running Jupyter Notebooks in batch mode. Presented on June 15, 2023
Interactive Video
Scalable Machine Learning
This webinar is an introduction to performing machine learning at scale. An overview of approaches for parallelizing R code on HPC will be provided. We will also cover the essentials of Spark and demonstrate how to use Spark for large-scale data analytics and machine learning. Demonstrations will allow participants to gain practical guidance for building and scaling machine learning workflows. Presented on January 14, 2025
Webinar RecordingInteractive Video
Scientific Computing with Kubernetes
In this webinar we provide recipes for transitioning scientific workloads that currently run on traditional batch systems to Kubernetes systems. Kubernetes is batch-like in nature, but there are some differences that science users should be aware of. We will also briefly describe capabilities that are not found in traditional batch systems that can improve the effectiveness of scientific computing. Presented on July 20, 2023
Interactive Video
Singularity Containers
This webinar will briefly introduce how to build Singularity images and how to run them on the SDSC supercomputer clusters. We will also share some insider knowledge of best practices and pitfalls to avoid while working with Singularity. Presented on May 18, 2023
Interactive Video
Technology Forum: Expanse Supercomputer for Industry
SDSC's newest Supercomputer, Expanse, supports SDSC's vision of 'Computing without Boundaries' by increasing the capacity and performance for thousands of users of batch-oriented and science gateway computing, and by providing new capabilities that will enable research increasingly dependent upon heterogeneous and distributed resources composed into integrated and highly usable cyberinfrastructure. It also implements new technical capabilities such as Direct Liquid Cooling. SDSC has acquired additional capacity for Expanse specifically to support industrial research and collaborations.
Presented on April 15, 2021
Webinar Recording
The Portal: GUI Access to Resources
The TAU Performance System and E4S
The talk will highlight the advances in the TAU Performance System(R). It will describe the different instrumentation, measurement and analysis options that are available and how TAU is integrated in the Extreme-scale Scientific Software Stack (E4S). A hands-on demo on AWS with E4S will be shown. Presented on March 11, 2025
Webinar RecordingInteractive Video
Topographic change with OpenTopography: Adventures in cloud computing, spatial uncertainty, and impactful applications
Topographic differencing measures landscape change at the Earth’s surface due to natural and anthropogenic processes. OpenTopography, an NSF-funded data facility, provides access to topographic data and processing tools. OpenTopography has recently developed on-demand topographic differencing and uncertainty calculation tools that can be applied to roughly 25% of the US mainland. Our uncertainty tool, available via a cloud-based app and Jupyter notebook, quantifies the magnitude of uncertainty at multiple spatial scales, mirroring the variable scales of common error types. We demonstrate these capabilities by calculating topographic change for the 2025 Eaton and Palisades Fires in Los Angeles. Presented on February 25, 2026
Webinar Recording
Triton Shared Computing Cluster (TSCC) 101 Spring Training
This training will cover everything new users need to know about using the TSCC system. Topics will include: an overview of condo/hotel program; how to apply; accounts and allocation usage monitoring; environment and software modules; overview of various queues, building PBS job scripts, job submission and monitoring; data transfers; and file systems. Presented on March 3, 2022
RecordingGitHub Content
TSCC 1.0 to 2.0 Transitional Workshop
During this workshop, we will provide an overview of TSCC 2.0 including the new authentication method, new allocation system, new filesystems, shared data transfer options from the current TSCC to TSCC 2.0, software stack, new partition characteristics, and provide examples of SLURM job scripts. Presented on November 6, 2023
Workshop Recording
TSCC 101: Accessing and Running Jobs on TSCC
During this workshop, we will provide an overview of TSCC, including authentication, allocation, filesystems, software stack, partition characteristics, and job submission, with examples of SLURM job scripts. Presented on September 12, 2024
Recorded Workshop
Using Expanse AI Resource 101 (Advanced Computing Series)
The Expanse AI Resource is available under the NAIRR Pilot program. In this talk we will detail the H100 GPU node architecture, provide examples on usage of AI tools and frameworks, and provide information on the storage options. Presented on June 9, 2026
Interactive Video
Using JupyterHub and Coder as a User
Using Python and Jupyter Notebooks on TSCC
This workshop will focus on providing guidelines for setting up customized Python environments, how to install and manage packages using Miniconda/pip, and how to run secure Jupyter notebooks on Triton Shared Computing Cluster (TSCC) HPC system. Presented on September 2, 2021
Github RepositoryInteractive Videos
Using Regular Expressions with Linux Tools (COMPLECS)
Using Regular Expressions with Linux Tools (COMPLECS)
Using Regular Expressions with Linux Tools (COMPLECS)
Essentials of using regular expressions (regexes) with the Linux tools grep, awk and sed. Topics include quantifiers, wildcards, grouping, alternation, word boundaries, lazy and greedy matching and regex flavors. Attendees should at least be familiar with grep.
Presented on May 14, 2026
Webinar RecordingInteractive Video
VMs, Windows Access, and Edge Use Cases (Advanced II)
Voyager 101: Running AI Models on Voyager
Voyager offers a unique architecture to optimize and scale AI applications. In this tutorial we will introduce Voyager and its Gaudi architecture. We will show how to port a Pytorch application and deploy it into the Voyager system using Kubernetes. Some examples including Jupyter Notebooks and Huggingface models (Diffusers, LLMs) will be presented. Presented on October 14, 2025
Webinar RecordingInteractive Video
Voyager Part 1: Introduction and User Environment
This is the first of a two-part Voyager training session. Voyager is based on Intel’s Habana Lab AI processors and provides a unique opportunity to use AI focused hardware for exploring AI in science and engineering. Voyager features Habana’s Gaudi processors optimized for training, Goya processors optimized for inference, 100 GbE all-to-all connection within Gaudi nodes, 24 x 100GbE RDMA RoCE for scale-out across Gaudi nodes, and a Ceph file system.
Presented on October 18, 2022
Recording
Voyager Part 2: Habana Architecture Deep Dive and Porting of TensorFlow and PyTorch Applications
This is the second of a two-part Voyager training session. Voyager is based on Intel’s Habana Lab AI processors and provides a unique opportunity to use AI focused hardware for exploring AI in science and engineering. Voyager features Habana’s Gaudi processors optimized for training, Goya processors optimized for inference, 100 GbE all-to-all connection within Gaudi nodes, 24 x 100GbE RDMA RoCE for scale-out across Gaudi nodes, and a Ceph file system. Presented on November 8, 2022
Recording
WHPC@SDSC Professional Speaker Series: UC San Diego's Student Cluster Competition 2025 Team
UC San Diego and the San Diego Supercomputing Center have partnered over the past five years to support a student team competing in the Student Cluster Competition. During this 48-hour challenge, students build and optimize high-performance systems while collaborating under pressure on real scientific workloads. Our team has ranked 1st in the U.S. for the past five consecutive years and 3rd internationally this year, with 3/6 students identifying as female. Hear directly from the students about their experiences, how they got involved in HPC, and how opportunities like SCC can support and empower women pursuing careers in the field. Presented on May 28, 2026
Webinar Recording