Lesson 1
Welcome
Introduction to Data Streaming with Spark
Streaming API Development and Documentation
Course
In this course you will grow your expertise in the components of streaming data systems, and build a real time analytics application. Specifically, you will be able to identify components of Spark Streaming (architecture and API), build a continuous application with Structured Streaming, consume and process data from Apache Kafka with Spark Structured Streaming (including setting up and running a Spark Cluster), create a DataFrame as an aggregation of source DataFrames, sink a composite DataFrame to Kafka, and visually inspect a data sink for accuracy.
In this course you will grow your expertise in the components of streaming data systems, and build a real time analytics application. Specifically, you will be able to identify components of Spark Streaming (architecture and API), build a continuous application with Structured Streaming, consume and process data from Apache Kafka with Spark Structured Streaming (including setting up and running a Spark Cluster), create a DataFrame as an aggregation of source DataFrames, sink a composite DataFrame to Kafka, and visually inspect a data sink for accuracy.
Advanced
4 weeks
Real-world Projects
Completion Certificate
Last Updated August 29, 2023
Skills you'll learn:
Apache Spark • JSON • Kafka basics • Kafka connect
Prerequisites:
Intermediate Python • Intermediate SQL • ETL
Course Lessons
Lesson 2
Streaming Dataframes, Views, and Spark SQL
In this lesson, you'll learn about working with Spark Dataframes and views.
Lesson 3
Joins and JSON
In this lesson, you'll learn how to work with JSON and complete Joins for data streaming.
Lesson 4
Redis, Base64 and JSON
This lesson will focus on working with Redis, Base64, and JSON in Data Streaming.
Lesson 5 • Project
Evaluate Human Balance with Spark Streaming
As your final project for this course, you will demonstrate the skills you have learned by evaluating human balance with spark streaming.
Taught By The Best
Sean Murdock
Professor at Brigham Young University Idaho
Sean currently teaches cybersecurity and DevOps courses at Brigham Young University Idaho. He has been a software engineer for over 16 years. Some of the most exciting projects he has worked on involved data pipelines for DNA processing and vehicle telematics.
The Udacity Difference
Combine technology training for employees with industry experts, mentors, and projects, for critical thinking that pushes innovation. Our proven upskilling system goes after success—relentlessly.
Demonstrate proficiency with practical projects
Projects are based on real-world scenarios and challenges, allowing you to apply the skills you learn to practical situations, while giving you real hands-on experience.
Gain proven experience
Retain knowledge longer
Apply new skills immediately
Top-tier services to ensure learner success
Reviewers provide timely and constructive feedback on your project submissions, highlighting areas of improvement and offering practical tips to enhance your work.
Get help from subject matter experts
Learn industry best practices
Gain valuable insights and improve your skills
Unlock access to Streaming API Development and Documentation and the rest of our best-in-class catalog
Unlimited access to our top-rated courses
Real-world projects
Personalized project reviews
Program certificate
Proven career outcomes
Cancel anytime
Full Catalog Access
One subscription opens up this course and our entire catalog of projects and skills.
Month-To-Month
4 Months
*Average time to complete a Nanodegree program
4 weeks
, Advanced
(127)
2 months
, Advanced
4 weeks
, Intermediate
4 weeks
, Intermediate
8 hours
4 weeks
, Intermediate
4 weeks
, Advanced
3 weeks
, Advanced
4 weeks
, Beginner
4 weeks
, Intermediate
4 weeks
, Intermediate
4 weeks
, Beginner
(2)
4 months
, Advanced
4 weeks
, Intermediate
4 weeks
, Intermediate
4 weeks
, Intermediate
Your subscription also includes:
Your subscription also includes:
4 weeks
, Advanced
(127)
2 months
, Advanced
4 weeks
, Intermediate
4 weeks
, Intermediate
8 hours
4 weeks
, Intermediate
4 weeks
, Advanced
3 weeks
, Advanced
4 weeks
, Beginner
4 weeks
, Intermediate
4 weeks
, Intermediate
4 weeks
, Beginner
(2)
4 months
, Advanced
4 weeks
, Intermediate
4 weeks
, Intermediate
4 weeks
, Intermediate
Get Started Today
Streaming API Development and Documentation
Month-To-Month
- Unlimited access to our top-rated courses
- Real-world projects
- Personalized project reviews
- Program certificates
- Proven career outcomes
4 Months
- All the same great benefits in our month-to-month plan
- Most cost-effective way to acquire a new set of skills
Discount applies to the first 4 months of membership, after which plans are converted to month-to-month.
4 weeks
, Advanced
(127)
2 months
, Advanced
4 weeks
, Intermediate
4 weeks
, Intermediate
8 hours
4 weeks
, Intermediate
4 weeks
, Advanced
3 weeks
, Advanced
4 weeks
, Beginner
4 weeks
, Intermediate
4 weeks
, Intermediate
4 weeks
, Beginner
(2)
4 months
, Advanced
4 weeks
, Intermediate
4 weeks
, Intermediate
4 weeks
, Intermediate
Related Programs
Related Programs
4 weeks
, Advanced
(127)
2 months
, Advanced
4 weeks
, Intermediate
4 weeks
, Intermediate
8 hours
4 weeks
, Intermediate
4 weeks
, Advanced
3 weeks
, Advanced
4 weeks
, Beginner
4 weeks
, Intermediate
4 weeks
, Intermediate
4 weeks
, Beginner
(2)
4 months
, Advanced
4 weeks
, Intermediate
4 weeks
, Intermediate
4 weeks
, Intermediate