New!
Nanodegree Program

Data Streaming

Learn the skills to take you into the next era of data engineering.
Build real-time applications to process big data at scale.

  • Estimated Time
    2 Months

    At 5-10 hours/week

  • Enroll by
    November 26, 2019

    Get access to the classroom immediately upon enrollment

  • Prerequisites
    Intermediate Python, SQL, and experience with ETL

    See prerequisites in detail

What You Will Learn

Download Syllabus
Syllabus

Data Streaming

Learn how to process data in real-time by building fluency in modern data engineering tools, such as Apache Spark, Kafka, Spark Streaming, and Kafka Streaming. You’ll start by understanding the components of data streaming systems. You’ll then build a real-time analytics application. Students will also compile data and run analytics, as well as draw insights from reports generated by the streaming console.

Learn how to analyze data in real-time using Apache Kafka and Spark, and build applications to process live insights from data at scale.

Hide details

Estimated 2 Months to complete

Prerequisite Knowledge

To be successful in this program, you should have intermediate Python and SQL skills, as well as experience with ETL.See detailed requirements.

  • Foundations of Data Streaming

    Learn the fundamentals of stream processing, including how to work with the Apache Kafka ecosystem, data schemas, ApacheAvro, Kafka Connect and REST proxy, KSQL, and Faust Stream Processing.

    Optimize Chicago Public Transit
  • Streaming API Development and Documentation

    Grow expertise in the components of streaming data systems, and learn how to build a real-time analytics application. Understand the dimensions of Spark streaming, ingest streaming data to Apache Spark Structured Streaming, and integrate Spark streams into Kafka.

    Analyze San Francisco Crime Rate
Icon - Dark upwards trend arrow

Data Engineer is one of the best jobs for 2019, with a base salary of $100k.

All Our Nanodegree Programs Include

Real-world projects from industry experts

With real world projects and immersive content built in partnership with top tier companies, you’ll master the tech skills companies want.

1-on-1 technical mentor

Get a knowledgeable mentor who guides your learning and is focused on answering your questions, motivating you and keeping you on track.

Personal career coach and career services

You’ll have access to career coaching sessions, interview prep advice, and resume and online professional profile reviews to help you grow in your career.

Flexible learning program

Get a custom learning plan tailored to fit your busy life. Learn at your own pace and reach your personal goals on the schedule that works best for you.
Program OfferingsFull list of offerings included:
Enrollment Includes:
Class content
Real-world projects
icon-checkmarkCheckmark
Project reviews
icon-checkmarkCheckmark
Project feedback from experienced reviewers
icon-checkmarkCheckmark
Student Services
1-on-1 technical mentor
New
icon-checkmarkCheckmark
Check-ins with mentor
New
icon-checkmarkCheckmark
Student community
Improved
icon-checkmarkCheckmark
Career services
Personal career coaching
New
icon-checkmarkCheckmark
Interview preparations
icon-checkmarkCheckmark
Resume services
icon-checkmarkCheckmark
Github review
icon-checkmarkCheckmark
LinkedIn profile review
icon-checkmarkCheckmark
Resume shared with 100+ employers
New
icon-checkmarkCheckmark
Succeed with Personalized Services
We provide services customized for your needs at every step of your learning journey to ensure your success!
Experienced Project Reviewers
Individual 1-on-1 Mentorship
Personal Career Coach
Get personalized feedback on your projects
Reviews By the numbers
2000+ project reviewers
1.8M projects reviewed
4.85/5 reviewer ratings
3 hour avg project review turnaround time
Reviewer Services
  • Personalized feedback
  • Unlimited submissions and feedback loops
  • Practical tips and industry best practices
  • Additional suggested resources to improve
Succeed with Personalized Services
We provide services customized for your needs at every step of your learning journey to ensure your success!
Project Reviewers
1-on-1 Mentors
Career Coaching
Get personalized feedback on your projects
Reviews By the numbers
2000+ project reviewers
1.8M projects reviewed
4.85/5 reviewer ratings
3 hour avg project review turnaround time
Reviewer Services
  • Personalized feedback
  • Unlimited submissions and feedback loops
  • Practical tips and industry best practices
  • Additional suggested resources to improve

Learn with the best

Ben Goldberg
Ben Goldberg

Staff Engineer at SpotHero

In his career as an engineer, Ben Goldberg has worked in fields ranging from Computer Vision to Natural Language Processing. At SpotHero, he founded and built out their Data Engineering team, using Airflow as one of the key technologies.

Judit Lantos
Judit Lantos

Senior Data Engineer at Netflix

Currently, Judit is a Senior Data Engineer at Netflix. Formerly a Data Engineer at Split, where she worked on the statistical engine of their full-stack experimentation platform, she has also been an instructor at Insight Data Science, helping software engineers and academic coders transition to DE roles.

David Drummond
David Drummond

VP of Engineering at Insight

David is VP of Engineering at Insight where he enjoys breaking down difficult concepts and helping others learn data engineering. David has a PhD in Physics from UC Riverside.

Jillian Kim
Jillian Kim

Senior Data Engineer at Change Healthcare

Jillian has worked in roles from building data analytics platforms to machine learning pipelines. Previously, she was a research engineer at Samsung focused on data analytics and ML, and now leads building pipelines at scale as a Senior Data Engineer at Change Healthcare.

The Udacity Impact

Numbers don't lie. See what difference it makes in career searches.*

84%
Better Jobs

Career-seeking and job-ready graduates found a new, better job within six months of graduation.

$24,000
Salary Increase

Average salary increase for graduates who found a new, better job within six months of graduation.

Program Details

    PROGRAM OVERVIEW - WHY SHOULD I TAKE THIS PROGRAM?
  • Why should I enroll?

    As businesses increasingly rely on applications that produce and process data in real-time, data streaming is an increasingly in-demand skill for data engineers. The Data Streaming Nanodegree program will prepare you for the cutting edge of data engineering as more and more companies look to derive live insights from data at scale.

    Students will learn how to process data in real-time by building fluency in modern data engineering tools, such as Apache Spark, Kafka, Spark Streaming, and Kafka Streaming.

    You’ll start by understanding the components of data streaming systems. You’ll then build a real-time analytics application. You will also compile data and run analytics, as well as draw insights from reports generated by the streaming console.

  • What jobs will this program prepare me for?

    This program is designed to upskill experienced Software Engineers and Data Engineers to learn the latest advancements in data processing, sending data records continuously to support live updating.

    The projects in the Data Streaming Nanodegree program will prepare you to develop systems and applications capable of interpreting data in real-time, and position you for roles in all industries that require live data processing for functions including big data, cloud computing, web personalization, fraud detection, sensor monitoring, anomaly detection, supply chain maintenance, location-based services, and much more.

  • How do I know if this program is right for me?

    This program is intended for software engineers looking to build real-time data processing proficiency, as well as data engineers looking to enhance their existing skill set with the next advancement in data engineering.

    Enrollment and Admission
  • Do I need to apply? What are the admission criteria?

    There is no application. This Nanodegree program accepts everyone, regardless of experience and specific background.

  • What are the prerequisites for enrollment?

    The Data Streaming Nanodegree program is designed for students with intermediate Python and SQL skills, as well as experience with ETL. Basic familiarity with traditional batch processing and basic conceptual familiarity with traditional service architectures is desired, but not required.

    Intermediate Python programming knowledge, of the sort gained through the Programming for Data Science Nanodegree program, other introductory programming courses or programs, or additional real-world software development experience. Including:

    • Strings, numbers, and variables; statements, operators, and expressions;
    • Lists, tuples, and dictionaries; Conditions, loops;
    • Procedures, objects, modules, and libraries;
    • Troubleshooting and debugging; Research & documentation;
    • Problem solving; Algorithms and data structures

    Intermediate SQL knowledge and linear algebra mastery, addressed in the Programming for Data Science Nanodegree program, including:

    • Joins, Aggregations, and Subqueries
    • Table definition and manipulation (Create, Update, Insert, Alter)
  • If I do not meet the requirements to enroll, what should I do?

    Udacity’s Programming for Data Science with Python Nanodegree program is great preparation for the Data Engineer Nanodegree program. You’ll learn to code with Python and SQL.

    Similarly, the Data Engineering Nanodegree program is great preparation for the Data Streaming Nanodegree program.

    Tuition and Term of Program
  • How is this Nanodegree program structured?

    The Data Streaming Nanodegree program is comprised of content and curriculum to support two projects. We estimate that students can complete the program in two months, working five to ten hours per week.

    Each project will be reviewed by the Udacity reviewer network. Feedback will be provided, and if you do not pass the project, you will be asked to resubmit the project until it passes.

  • How long is this Nanodegree program?

    Access to this Nanodegree program runs for the length of time specified in the payment card above. If you do not graduate within that time period, you will continue learning with month to month payments. See the Terms of Use and FAQs for other policies regarding the terms of access to our Nanodegree programs.

  • Can I switch my start date? Can I get a refund?

    Please see the Udacity Nanodegree program FAQs for policies on enrollment in our programs.

    Software & Hardware
  • What software and versions will I need in this program?

    There are no software and version requirements to complete this Nanodegree program. All coursework and projects can be completed via Student Workspaces in the Udacity online classroom.

Data Streaming Nanodegree Program