Generative AI Fundamentals

Course

Dive into generative AI with this course, which explores its fundamental principles and relationship to prior artificial intelligence innovations. We will walk through popular generative models and how they work, how deep learning models are developed using tools like PyTorch and Hugging Face, and finally, how to customize pre-trained open-source models for a specific use case. In the project, you will apply a cutting-edge technique called parameter-efficient fine-tuning (PEFT), which allows for the adaptation of massive foundation models with minimal usage of computational resources.

Intermediate

3 weeks

Real-world Projects

Completion Certificate

Last Updated August 1, 2024

Skills you'll learn:

Generative AI Fluency • Image classification • Transfer learning • Training neural networks

Prerequisites:

Intermediate Python

Course Lessons

Lesson 1

Introduction to Generative AI Fundamentals

This lesson provides the foundational knowledge needed about generative AI: what it is, how it's applied, and explanations of some popular algorithms and architectures for text and image generation.

Lesson 2

Deep Learning Fundamentals

This lesson covers the essentials of deep learning for the generative AI practitioner. From perceptrons to transfer learning including an introduction to the PyTorch and Hugging Face Python libraries.

Lesson 3

Foundation Models

This lesson explores foundation models in AI, how they differ from traditional models, how you can apply them to various tasks and evaluate their performance, and the ethical implication of their use.

Lesson 4

Adapting Foundation Models

This lesson covers a range of techniques for adapting foundation models, including prompt tuning, in-context learning, full fine-tuning, and parameter-efficient fine-tuning (PEFT).

Lesson 5 • Project

Apply Lightweight Fine-Tuning to a Foundation Model

Load and customize a Hugging Face foundation model using parameter-efficient fine-tuning. This technique allows you to harness the power of a pre-trained model for your custom task.

Taught By The Best

Brian Cruz

Head of AI Engineering

Brian Cruz leads AI Engineering at Advocate, where Generative AI is used to help disabled individuals apply for benefits. He previously worked at Samba TV, contributing significantly to advancements in AI for edge devices, as well as at Salesforce, where he led ML engineering for sales revenue forecasting.

The Udacity Difference

Combine technology training for employees with industry experts, mentors, and projects, for critical thinking that pushes innovation. Our proven upskilling system goes after success—relentlessly.

Demonstrate proficiency with practical projects

Projects are based on real-world scenarios and challenges, allowing you to apply the skills you learn to practical situations, while giving you real hands-on experience.

Gain proven experience
Retain knowledge longer
Apply new skills immediately

Top-tier services to ensure learner success

Reviewers provide timely and constructive feedback on your project submissions, highlighting areas of improvement and offering practical tips to enhance your work.