Real-world projects from industry experts
With real-world projects and immersive content built in partnership with top-tier companies, you’ll master the tech skills companies want.
Become a Sensor Fusion Engineer
Nanodegree Program
Learn to fuse lidar point clouds, radar signatures, and camera images using Kalman Filters to perceive the environment and detect and track vehicles and pedestrians over time.
04Days07Hrs48Min08Sec
Estimated time
4 Months
At 10 hours/week
Enroll by
October 5, 2022
Get access to classroom immediately on enrollment
Prerequisites
Intermediate C++, Calculus, and Probability
Built in collaboration with
What you will learn
Sensor Fusion Engineer
Estimated 4 MonthsLearn to detect obstacles in lidar point clouds through clustering and segmentation, apply thresholds and filters to radar data in order to accurately track objects, and augment your perception by projecting camera images into three dimensions and fusing these projections with other sensor data. Combine this sensor data with Kalman filters to perceive the world around a vehicle and track objects over time.
Prerequisite knowledge
Lidar
Process raw lidar data with filtering, segmentation, and clustering to detect other vehicles on the road.
Cameras
Fuse camera images together with lidar point cloud data. You'll extract object features, classify objects, and project the camera image into three dimensions to fuse with lidar data.
Radar
Analyze radar signatures to detect and track objects. Calculate velocity and orientation by correcting for radial velocity distortions, noise, and occlusions.
Kalman Filters
Fuse data from multiple sources using Kalman filters, and build extended and unscented Kalman filters for tracking nonlinear movement.
All our programs include:
Technical mentor support
Our knowledgeable mentors guide your learning and are focused on answering your questions, motivating you, and keeping you on track.
Career services
You’ll have access to Github portfolio review and LinkedIn profile optimization to help you advance your career and land a high-paying role.
Flexible learning program
Tailor a learning plan that fits your busy life. Learn at your own pace and reach your personal goals on the schedule that works best for you.
Program offerings
Class Content
- Content Co-created with Mercedes-Benz
- Real-world projects
- Project reviews
- Project feedback from experienced reviewers
Student services
- Technical mentor support
- Student community
Career services
- Github review
- Linkedin profile optimization
Succeed with personalized services.
We provide services customized for your needs at every step of your learning journey to ensure your success.
Get timely feedback on your projects.
- Personalized feedback
- Unlimited submissions and feedback loops
- Practical tips and industry best practices
- Additional suggested resources to improve
1,400+ project reviewers
2.7M projects reviewed
88/100 reviewer rating
1.1 hours avg project review turnaround time
Mentors available to answer your questions.
- Support for all your technical questions
- Questions answered quickly by our team of technical mentors
1,400+ technical mentors
0.85 hours median response time
Learn with the best.
Learn with the best.
David Silver
Head of CurriculumDavid Silver leads the Udacity Curriculum Team. Before Udacity, David was a research engineer on the autonomous vehicle team at Ford. He has an MBA from Stanford, and a BSE in Computer Science from Princeton.
Stephen Welch
InstructorStephen is a Content Developer at Udacity and has worked on the C++ and Self-Driving Car Engineer Nanodegree programs. He started teaching and coding while completing a Ph.D. in mathematics, and has been passionate about engineering education ever since.
Andreas Haja
InstructorAndreas Haja is an engineer, educator and autonomous vehicle enthusiast with a PhD in computer science. Andreas now works as a professor, where he focuses on project-based learning in engineering. During his career with Volkswagen and Bosch he developed camera technology and autonomous vehicle prototypes.
Abdullah Zaidi
InstructorAbdullah holds his M.S from the University of Maryland and is an expert in the field of Radio Frequency Design and Digital Signal processing. After spending several years at Qualcomm, Abdullah joined Metawave, where he now leads Radar development for autonomous driving.
Aaron Brown
InstructorAaron Brown has a background in electrical engineering, robotics and deep learning. Aaron has worked as a Content Developer and Simulation Engineer at Udacity focusing on developing projects for self-driving cars.
Become a Sensor Fusion Engineer
Get started today
Monthly access
Pay as you go
Enroll now
per/
/- Maximum flexibility to learn at your own pace.
- Cancel anytime.
- access
Pay upfront and save an extra 0%
Enroll now
for - access- Save an extra 0% vs. pay as you go.
- 4 months is the average time to complete this course.
- Switch to monthly price after if more time is needed.
- Cancel anytime.
Best Value
Learn
Average Time
Benefits include
Program details
Program overview: Why should I take this program?
Why should I enroll?
What jobs will this program prepare me for?
How do I know this program is right for me?
Enrollment and admission
Do I need to apply? What are the admission criteria?
What are the prerequisites for enrollment?
If I don't meet the requirements to enroll, what should I do?
Tuition and terms of program
How is this program structured?
How long is this Nanodegree program?
Can I switch my start date? Can I get a refund?
Software and hardware: What do I need for this program?
What software and versions will I need for this program?