Skills you'll learn:

Data Ingestion with Kafka and Kafka Streaming
Course
Learn to use REST Proxy, Kafka Connect, KSQL, and Faust Python Stream Processing and use it to stream public transit statuses using Kafka and Kafka ecosystem to build a stream processing application that shows the status of trains in real-time.
Learn to use REST Proxy, Kafka Connect, KSQL, and Faust Python Stream Processing and use it to stream public transit statuses using Kafka and Kafka ecosystem to build a stream processing application that shows the status of trains in real-time.
Advanced
2 months
Last Updated December 29, 2023
Prerequisites:
Advanced
2 months
Last Updated December 29, 2023
Skills you'll learn:
Prerequisites:
Course Lessons
Lesson 1
Introduction to Stream Processing
In this lesson students will learn what data streaming is. Students will learn the pros and cons of data streaming, and how it compares to traditional data strategies.
Lesson 2
Apache Kafka
In this lesson we’ll review the architecture and configuration of Apache Kafka.
Lesson 3
Data Schemas and Apache Avro
This lesson covers data schemas and data schema management, with a focus on Apache Avro.
Lesson 4
Kafka Connect and REST Proxy
This lesson covers producing and consuming data into Kafka with Kafka Connect and REST Proxy.
Lesson 5
Stream Processing Fundamentals
Learn to build real-time applications that instantly process events, the concepts of stream processing state storage, windowed processing, and stateful and non-stateful stream processing.
Lesson 6
Stream Processing with Faust
Students will learn how to use the Python stream processing library Faust to rapidly create powerful stream processing applications.
Lesson 7
KSQL
Learn how to write simple SQL queries to turn Kafka topics into KSQL streams and tables, and then write those tables back out to Kafka.
Lesson 8 • Project
Optimizing Public Transportation
For your first project, you’ll be streaming public transit status using Kafka and the Kafka ecosystem to build a stream processing application that shows the status of trains in real-time.
Taught By The Best

Ben Goldberg
Staff Engineer at SpotHero
In his career as an engineer, Ben Goldberg has worked in fields ranging from computer vision to natural language processing. At SpotHero, he founded and built out their data engineering team, using Airflow as one of the key technologies.
The Udacity Difference
Combine technology training for employees with industry experts, mentors, and projects, for critical thinking that pushes innovation. Our proven upskilling system goes after success—relentlessly.

Demonstrate proficiency with practical projects
Projects are based on real-world scenarios and challenges, allowing you to apply the skills you learn to practical situations, while giving you real hands-on experience.
Gain proven experience
Retain knowledge longer
Apply new skills immediately

Top-tier services to ensure learner success
Reviewers provide timely and constructive feedback on your project submissions, highlighting areas of improvement and offering practical tips to enhance your work.
Get help from subject matter experts
Learn industry best practices
Gain valuable insights and improve your skills

Enroll in Data Ingestion with Kafka and Kafka Streaming. Choose the plan that works for you
All Access monthly
Cancel Anytime
Unlimited access to our top-rated courses
Hands-on projects with expert feedback
Personalized career coaching and interview prep
Program Certificates
Best Value
All Access bundle1
All the same great benefits as our monthly plan
The most cost-effective way to develop the skills you want
- 1Discount applies to the first 4 months of membership, after which plans are converted to month-to-month.
Your subscription also includes:
Your subscription also includes:

2 weeks
Advanced

(147)
2 months
Advanced

3 weeks
Intermediate

2 weeks
Intermediate

3 weeks
Beginner

2 weeks
Advanced

4 weeks
Advanced

4 weeks
Intermediate

2 weeks
Intermediate

2 weeks
Intermediate

1 month
Beginner

4 weeks
Intermediate

4 weeks
Intermediate

2 weeks
Beginner

3 weeks
Intermediate

3 weeks
Intermediate