Skip to content

Become a Sensor Fusion Engineer

Nanodegree Program

Learn to fuse lidar point clouds, radar signatures, and camera images using Kalman Filters to perceive the environment and detect and track vehicles and pedestrians over time.

Enroll now

04Days08Hrs49Min10Sec

  • Estimated time
    4 Months

    At 10 hours/week

  • Enroll by
    November 30, 2022

    Get access to classroom immediately on enrollment

  • Prerequisites
    Intermediate C++, Calculus, and Probability
Built in collaboration with
  • Mercedes-Benz

What you will learn

  1. Sensor Fusion Engineer

    Estimated 4 Months

    Learn to detect obstacles in lidar point clouds through clustering and segmentation, apply thresholds and filters to radar data in order to accurately track objects, and augment your perception by projecting camera images into three dimensions and fusing these projections with other sensor data. Combine this sensor data with Kalman filters to perceive the world around a vehicle and track objects over time.

    Prerequisite knowledge

    1. Lidar

      Process raw lidar data with filtering, segmentation, and clustering to detect other vehicles on the road.

    2. Cameras

      Fuse camera images together with lidar point cloud data. You'll extract object features, classify objects, and project the camera image into three dimensions to fuse with lidar data.

    3. Radar

      Analyze radar signatures to detect and track objects. Calculate velocity and orientation by correcting for radial velocity distortions, noise, and occlusions.

    4. Kalman Filters

      Fuse data from multiple sources using Kalman filters, and build extended and unscented Kalman filters for tracking nonlinear movement.

All our programs include:

  • Real-world projects from industry experts

    With real-world projects and immersive content built in partnership with top-tier companies, you’ll master the tech skills companies want.

  • Technical mentor support

    Our knowledgeable mentors guide your learning and are focused on answering your questions, motivating you, and keeping you on track.

  • Career services

    You’ll have access to Github portfolio review and LinkedIn profile optimization to help you advance your career and land a high-paying role.

  • Flexible learning program

    Tailor a learning plan that fits your busy life. Learn at your own pace and reach your personal goals on the schedule that works best for you.

Program offerings

  • Class Content

    • Content Co-created with Mercedes-Benz
    • Real-world projects
    • Project reviews
    • Project feedback from experienced reviewers
  • Student services

    • Technical mentor support
    • Student community
  • Career services

    • Github review
    • Linkedin profile optimization

Succeed with personalized services.

We provide services customized for your needs at every step of your learning journey to ensure your success.

Get timely feedback on your projects.

  • Personalized feedback
  • Unlimited submissions and feedback loops
  • Practical tips and industry best practices
  • Additional suggested resources to improve
  • 1,400+

    project reviewers

  • 2.7M

    projects reviewed

  • 88/100

    reviewer rating

  • 1.1 hours

    avg project review turnaround time

Learn with the best.

Learn with the best.

  • David Silver

    Head of Curriculum

    David Silver leads the Udacity Curriculum Team. Before Udacity, David was a research engineer on the autonomous vehicle team at Ford. He has an MBA from Stanford, and a BSE in Computer Science from Princeton.

  • Stephen Welch

    Instructor

    Stephen is a Content Developer at Udacity and has worked on the C++ and Self-Driving Car Engineer Nanodegree programs. He started teaching and coding while completing a Ph.D. in mathematics, and has been passionate about engineering education ever since.

  • Andreas Haja

    Instructor

    Andreas Haja is an engineer, educator and autonomous vehicle enthusiast with a PhD in computer science. Andreas now works as a professor, where he focuses on project-based learning in engineering. During his career with Volkswagen and Bosch he developed camera technology and autonomous vehicle prototypes.

  • Abdullah Zaidi

    Instructor

    Abdullah holds his M.S from the University of Maryland and is an expert in the field of Radio Frequency Design and Digital Signal processing. After spending several years at Qualcomm, Abdullah joined Metawave, where he now leads Radar development for autonomous driving.

  • Aaron Brown

    Instructor

    Aaron Brown has a background in electrical engineering, robotics and deep learning. Aaron has worked as a Content Developer and Simulation Engineer at Udacity focusing on developing projects for self-driving cars.

Top student reviews

 
0.0 stars
(0)
 
NaN stars

        

 
NaN stars

        

 
NaN stars

        

 
NaN stars

        

 
NaN stars

        

 
NaN stars

        

Become a Sensor Fusion Engineer

Get started today

  • Monthly access

    Pay as you go


    per

    /

    /

    Enroll now
    • Maximum flexibility to learn at your own pace.
    • Cancel anytime.
  • - access

    Pay upfront and save an extra 0%


    for - access

    Enroll now
    • Save an extra 0% vs. pay as you go.
    • 4 months is the average time to complete this course.
    • Switch to monthly price after if more time is needed.
    • Cancel anytime.
    Best Value

    Program details

    Program overview: Why should I take this program?
    • Why should I enroll?
    • What jobs will this program prepare me for?
    • How do I know this program is right for me?
    Enrollment and admission
    • Do I need to apply? What are the admission criteria?
    • What are the prerequisites for enrollment?
    • If I don't meet the requirements to enroll, what should I do?
    Tuition and terms of program
    • How is this program structured?
    • How long is this Nanodegree program?
    • Can I switch my start date? Can I get a refund?
    Software and hardware: What do I need for this program?
    • What software and versions will I need for this program?

    Get Started

    Start your path towards a Sensor Fusion career today

    Enroll now