About this Event
DURHAM UNIVERSITY STAFF AND STUDENTS ONLY
Date - Friday 19th July 2024
Time - 9.00-17.00
Location- Durham University, Stockton Road, Durham DH1 3LE The Palatine Centre
Room - PCL050
Large language models (LLMs) and deep neural networks (DNNs), whether applied to natural language processing (e.g., GPT-3), computer vision (e.g., huge Vision Transformers), or speech AI (e.g., Wave2Vec 2), have certain properties that set them apart from their smaller counterparts. As LLMs and DNNs become larger and are trained on progressively larger datasets, they can adapt to new tasks with just a handful of training examples, accelerating the route toward general artificial intelligence. Training models that contain tens to hundreds of billions of parameters on vast datasets isn’t trivial and requires a unique combination of AI, high-performance computing (HPC), and systems knowledge. The goal of this course is to demonstrate how to train the largest of neural networks and deploy them to production.
More information here
Technologies: PyTorch, NVIDIA NeMo™ Framework, DeepSpeed, Slurm, TensorRT-LLM
Certificate: Upon successful completion of the assessment, participants will receive an NVIDIA DLI certificate to recognize their subject matter competency and support professional career growth.
Hardware Requirements: Desktop or laptop computer capable of running the latest version of Chrome or Firefox. Each participant will be provided with dedicated access to a fully configured, GPU-accelerated workstation in the cloud.
Tea, coffee and lunch will be provided, if you have any dietry requirements please contact [email protected]
Event Venue & Nearby Stays
The Palatine Centre • Durham University, Stockton Road, Durham, United Kingdom
GBP 0.00
