Exploratory data analysis is an approach for summarizing and visualizing the important characteristics of a data set. Promoted by John Tukey, exploratory data analysis focuses on exploring data to understand the data’s underlying structure and variables, to develop intuition about the data set, to consider how that data set came into existence, and to decide how it can be investigated with more formal statistical methods.
If you’re interested in supplemental reading material for the course check out the Exploratory Data Analysis book. (Not Required)
This course is also a part of our Data Analyst Nanodegree.
You will…
A background in statistics is helpful but not required. Consider taking Intro to Descriptive Statistics and Intro to Inferential Statistics prior to taking this course. Relevant topics include:
Familiarity with the following CS and Math topics will help students:
Comparison and logical operators ( <, >, <=, >=, ==, &, | ) |
See the Technology Requirements for using Udacity.
Jump into a new dataset. Explore, create plots, and summarize the fascinating things you find.
We’ll start by learn about what exploratory data analysis (EDA) is and why it is important. You’ll meet the amazing instructors for the course and find out about the course structure and final project.
EDA, which comes before formal hypothesis testing and modeling, makes use of visual methods to analyze and summarize data sets. R will be our tool for generating those visuals and conducting analyses. In this lesson, we will install RStudio and packages, learn the layout and basic commands of R, practice writing basic R scripts, and inspect data sets.
We perform EDA to understand the distribution of a variable and to check for anomalies and outliers. Learn how to quantify and visualize individual variables within a data set as we begin to make sense of a pseudo-data set of Facebook users. While the data set does not contain real user data, it does contain a wealth of information. Through the lesson, we will create histograms and boxplots, transform variables, and examine tradeoffs in visualizations.
EDA allows us to identify the most important variables and relationships within a data set before building predictive models. In this lesson, we will learn techniques for exploring the relationship between any two variables in a data set. We’ll create scatter plots, calculate correlations, and investigate conditional means.
Data sets can be complex. In this lesson, we will learn powerful methods and visualizations for examining relationships among multiple variables. We’ll learn how to reshape data frames and how to use aesthetics like color and shape to uncover more information. Extending our knowledge of previous plots, we’ll continue to build intuition around the Facebook data set and explore some new data sets as well.
Investigate the diamonds data set alongside Facebook Data Scientist, Solomon Messing. He’ll recap many of the strategies covered in the course and show how predictive modeling can allow us to determine a good price for a diamond. As a final project, you will create your own exploratory data analysis on a data set of your choice.
You’ve explored simulated Facebook user data and the diamonds data set. Now, it’s your turn to conduct your own exploratory data analysis. Choose one data set to explore (one provided by Udacity or your own) and create a RMD file that uncovers the patterns, anomalies and relationships of the data set.
After graduating from Emory in 2008, Chris dabbled in college admissions for a year, which led him to teach high school mathematics in Oakland. He radiates a love for learning and believes everyone deserves a great education. In 2012, Chris joined Udacity to reach thousands of students and share his joy of problem solving with the world.
Dean Eckles is a social scientist, statistician, and member of the Data Science team at Facebook. His primary focus is how interactive technologies affect human behavior by mediating, amplifying, and directing social influence — and the statistical methods to study these processes. Dean holds degrees from Stanford University in philosophy (BA), cognitive science (BS, MS), and statistics (MS), and communication (PhD).
Moira Burke is a Data Scientist at Facebook, where she combines her social psychology and data munging chops to understand how people perceive their audience online and how various uses of the site improve psychological well-being. She received her Ph.D. in Human-Computer Interaction from Carnegie Mellon University, and a B.A. in Computer Science from the University of Oregon. When not coaxing data into pretty plots, she sings a cappella. Badly.
Solomon Messing is a political scientist with Facebook’s Data Science Team. His research and teaching focus on political advertising and campaigns, social influence, and design and analysis of experiments. His work has appeared in the American Political Science Review, Public Opinion Quarterly, and Communication Research. Solomon completed his Ph.D. in political communication and M.S. in Statistics at Stanford.
View more courses in Data Science