Data Streaming

Data Streaming Nanodegree Program Introduction

Welcome to the Data Streaming Nanodegree Program

Getting Help

You are starting a challenging but rewarding journey! Take 5 minutes to read how to get help with projects and content.

Introduction to Stream Processing

In this lesson students will learn what data streaming is. Students will learn the pros and cons of data streaming, and how it compares to traditional data strategies.

Apache Kafka

In this lesson we’ll review the architecture and configuration of Apache Kafka.

Data Schemas and Apache Avro

This lesson covers data schemas and data schema management, with a focus on Apache Avro.

Kafka Connect and REST Proxy

This lesson covers producing and consuming data into Kafka with Kafka Connect and REST Proxy.

Stream Processing Fundamentals

Learn to build real-time applications that instantly process events, the concepts of stream processing state storage, windowed processing, and stateful and non-stateful stream processing.

Stream Processing with Faust

Students will learn how to use the Python stream processing library Faust to rapidly create powerful stream processing applications.

KSQL

Learn how to write simple SQL queries to turn Kafka topics into KSQL streams and tables, and then write those tables back out to Kafka.

Optimizing Public Transportation

For your first project, you’ll be streaming public transit status using Kafka and the Kafka ecosystem to build a stream processing application that shows the status of trains in real-time.

Welcome

Introduction to Data Streaming with Spark

Streaming Dataframes, Views, and Spark SQL

In this lesson, you'll learn about working with Spark Dataframes and views.

Joins and JSON

In this lesson, you'll learn how to work with JSON and complete Joins for data streaming.

Redis, Base64 and JSON

This lesson will focus on working with Redis, Base64, and JSON in Data Streaming.

Evaluate Human Balance with Spark Streaming

As your final project for this course, you will demonstrate the skills you have learned by evaluating human balance with spark streaming.

Take 30 Min to Improve your LinkedIn

Find your next job or connect with industry peers on LinkedIn. Ensure your profile attracts relevant leads that will grow your professional network.

Optimize Your GitHub Profile

Other professionals are collaborating on GitHub and growing their network. Submit your profile to ensure your profile is on par with leaders in your field.