Skills you'll learn:
Big data fluencyDistributed data processing
Big Data Systems
Course
There are 2 main roles in the Big Data industry: Big Data Engineer and Big Data Architect. We will focus on the Architect role. We will look at the characteristics of Big Data, its business value, and how companies are using Big Data today. We study the most popular storage and processing frameworks.....aka...Big Data ecosystem components. We will dive deep into NoSQL, how it differs from traditional relational databases, how to model, and what the tool interface looks like. Finally, we will talk about the benefits, challenges, design patterns of Data Lake technology. Your final project is based on a real-world scenario that will require you to think like an architect and build an end-to-end data lake system proposal.
There are 2 main roles in the Big Data industry: Big Data Engineer and Big Data Architect. We will focus on the Architect role. We will look at the characteristics of Big Data, its business value, and how companies are using Big Data today. We study the most popular storage and processing frameworks.....aka...Big Data ecosystem components. We will dive deep into NoSQL, how it differs from traditional relational databases, how to model, and what the tool interface looks like. Finally, we will talk about the benefits, challenges, design patterns of Data Lake technology. Your final project is based on a real-world scenario that will require you to think like an architect and build an end-to-end data lake system proposal.
Advanced
4 weeks
Last Updated November 5, 2024
Prerequisites:
ETLRelational database basicsCommand line interface basicsBasic computer programmingBasic SQL
Advanced
4 weeks
Last Updated November 5, 2024
Skills you'll learn:
Big data fluency • Distributed data processing • Data lake management • Database fundamentals
Prerequisites:
ETL • Relational database basics • Command line interface basics
Course Lessons
Lesson 1
Introduction to Big Data Systems
In this lesson, we will take a 30000 foot view of Big Data and see why it is so important. We will meet the instructor and hear about the components of the course, including the final project.
Lesson 2
Characteristics of Big Data
In this lesson you will learn about the main characteristics of Big Data, called the 4Vs. You will also start to explore the Big Data ecosystem.
Lesson 3
Ingestion, Storage and Processing Frameworks
In this lesson, you'll take a look at several of the layers that make Big Data possible, We will also look at some of the tools that help implement those layers.
Lesson 4
NoSQL Databases
In this lesson, we will look at the differences between NoSQL and SQL. We will also see why and how NoSQL databases provide capabilities that allow Big Data to be possible.
Lesson 5
Scalable Data Lake Architecture
In this lesson, we will see what a Data Lake storage implementation of Big Data looks like. In addition to the benefits, we will see what considerations, risks, and challenges organizations face.
Lesson 6 • Project
Project - Designing an Enterprise Data Lake System
In this lesson, we will lead you through the scenario and instructions for completing the final project, which is a proposal for an actual Data Lake architecture.
Taught By The Best
Shrinath Parikh
Senior Data Architect
Shrinath is an entrepreneur and Data Architect passionate about helping enterprise companies transform and engineer their big data analytics applications on Cloud. He has worked with AWS, Google and Microsoft cloud platforms, has over 15 certifications and an MS in Computer Science from The University Of Texas at Dallas.
The Udacity Difference
Combine technology training for employees with industry experts, mentors, and projects, for critical thinking that pushes innovation. Our proven upskilling system goes after success—relentlessly.
Demonstrate proficiency with practical projects
Projects are based on real-world scenarios and challenges, allowing you to apply the skills you learn to practical situations, while giving you real hands-on experience.
Gain proven experience
Retain knowledge longer
Apply new skills immediately
Top-tier services to ensure learner success
Reviewers provide timely and constructive feedback on your project submissions, highlighting areas of improvement and offering practical tips to enhance your work.
Get help from subject matter experts
Learn industry best practices
Gain valuable insights and improve your skills
Enroll in Big Data Systems. Choose the plan that works for you
All Access monthly
Unlimited access to our top-rated courses
Personalized Career Services
Cancel Anytime
Real-world projects
Personalized project reviews
Program certificates
Best Value
All Access bundle1
All the same great benefits as our monthly plan
The most cost-effective way to develop the skills you want
- 1Discount applies to the first 4 months of membership, after which plans are converted to month-to-month.