Overview
Curriculum
In this module, you’ll learn about the core principles of Large Language Models (LLMs), with a focus on fine-tuning and transfer learning. You’ll explore methods like prompt tuning, prefix tuning, and low-rank adaptation, while also learning to evaluate the importance of data quality and domain-specific datasets. By the end, you’ll be equipped to customize and optimize LLMs, through hands-on practice with a Llama2 7B quantized model.
What you'll learn
- Analyze the differences between fine-tuning and transfer learning for LLMs.
- Understand the impact of data quality and domain-specific datasets on model performance.
- Explore various fine-tuning methods, including full fine-tuning, low-rank adaptation and advanced optimization strategies.
- Perform fine-tuning on a Llama2 7B quantized model for real-world applications through hands-on experience.
Courses you might be interested in
This module is designed to equip us with the foundational programming knowledge and theory needed to excel in the bootcamp. By covering essential Python concepts and tools, it helps us...
-
13 Lessons
Free
In this module, you will explore the world of large language models (LLMs), including their components, how they process information, and the challenges of adopting them in enterprise settings. You...
-
7 Lessons
$100.00
In this module, you will explore key concepts of transformer architecture, embeddings, attention mechanisms, and tokenization. You’ll gain a deeper understanding of semantic similarity and how it is calculated using...
-
5 Lessons
$100.00
In this module, you will explore the fundamentals of prompt engineering, including key concepts like in-context learning, designing effective prompts, and using various prompting techniques. You will learn how to...
-
12 Lessons
$100.00