When you enroll through our links, we may earn a small commission—at no extra cost to you. This helps keep our platform free and inspires us to add more value.
Databricks: Large Language Models: Foundation Models from the Ground Up
This course dives into the details of foundation models in large language models (LLMs). You will learn the innovations that led to the proliferation of transformer-based models, including BERT, GPT, and T5, and the key breakthroughs that led to applications such as ChatGPT. Additionally, you will gain understanding about the latest advances that continue to improve LLM functionality including Flash Attention, LoRa, AliBi, and PEFT methods.
This Course Includes
edx
0 (0 reviews )
4 weeks at 4-8 hours per week
english
Online - Self Paced
course
Databricks
About Databricks: Large Language Models: Foundation Models from the Ground Up
This course dives into the details of LLM foundation models. You will learn the innovations that led to the proliferation of transformer-based architectures, from encoder models (BERT), to decoder models (GPT), to encoder-decoder models (T5). You will also learn about the recent breakthroughs that led to applications like ChatGPT. You will gain understanding about the latest advances that continue to improve LLM functionality including Flash Attention, LoRa, AliBi, and PEFT methods. The course concludes with an overview of multi-modal LLM developments to address NLP problems involving a combination of text, audio, and visual components.
What You Will Learn?
- Describe the components and theory behind foundation models, including the attention mechanism, encoder and decoder architectures..
- Articulate the developments in the evolution of GPT models that were critical in the creation of popular LLMs like ChatGPT..
- Explain and implement the latest advances that improve LLM functionality, including Fast Attention, AliBi, and PEFT methods..
- Gain insights into multi-modal applications of Generative AI (GenAI) / LLMs involving a combination of text, audio, and visual elements..