Thank you for signing up for the course! We look forward to working with you and hearing your feedback in our forums.

**Need help getting started?**

- Find an answer to your question in the Udacity FAQ
- Learn about different parts of the Classroom in Udacity Introduction

Contents

- 1 Course Resources
- 1.1 Reading Materials
- 1.1.1 Suggested Text
- 1.1.2 Optional Text
- 1.1.3 Reading List

- 1.2 Coding Resources
- 1.3 Applications of Machine Learning
- 1.4 Downloadable Materials

- 1.1 Reading Materials
- 2 Course Syllabus

- Tom Mitchell, Machine Learning. McGraw-Hill, 1997.

You can buy the international edition for $24-$40 from various websites.

- Larry Wasserman, All of Statistics. Springer, 2010.
- Richard Sutton and Andrew Barto, Reinforcement Learning: An introduction. MIT Press, 1998.
- Trevor Hastie, Robert Tibshirani and Jerome Friedman, The Elements of Statistical Learning. Springer, 2009.

- Optimization
- Clustering
- Feature Selection and Transformation
- Information Theory

- WEKA Machine learning software in JAVA that you can use for your projects
- Data Mining with Weka A MOOC Course
- ABAGAIL Machine learning software in JAVA. This is hosted on my github, so you can contribute too
- scikit-learn A popular python library for supervised and unsupervised learning algorithms
- MATLAB NN Toolbox The toolbox supports supervised learning with feedforward, radial basis, and dynamic networks and unsupervised learning with self-organizing maps and competitive layers.
- Murphy's MDP Toolbox for Matlab
- MATLAB Clustering Package By Frank Dellaert
- ICA Example

- UCI Machine Learning Repository An online repository of data sets that can be used for machine learning experiments.
- Stanford Large Network Dataset Dataset of large social and information networks.
- Vision Benchmark Suite Autonomous car dataset
- Other datasets

- Robosoccer
- Make3D - Convert your still image into a 3D model
- Autonomous Helicopter
- Learning to play ping pong
- Cocktail Part Demo
- Brains, Sex, and Machine Learning by Geoffrey Hinton (facts) in Google Tech Talks
- Visualization of the Support Vector Machine with Polynomial Kernel

You can download Supplemental Materials, Lesson Videos and Transcripts from Downloadables (bottom right corner of the Classroom) or from the Dashboard (first option on the navigation bar on the left hand side).

- Optimization, randomized
- Hill climbing
- Random restart hill climbing
- Simulated annealing
- Annealing algorithm
- Properties of simulated annealing
- Genetic algorithms
- GA skeleton
- Crossover example
- What have we learned
- MIMIC
- MIMIC: A probability model
- MIMIC: Pseudo code
- MIMIC: Estimating distributions
- Finding dependency trees
- Probability distribution

- Clustering and expectation maximization
- Basic clustering problem
- Single linkage clustering (SLC)
- Running time of SLC
- Issues with SLC
- K-means clustering
- K-means in Euclidean space
- K-means as optimization
- Soft clustering
- Maximum likelihood Gaussian
- Expectation Maximization (EM)
- Impossibility theorem

- Algorithms
- Filtering and Wrapping
- Speed
- Searching
- Relevance
- Relevance vs. Usefulness

- Feature Transformation
- Words like Tesla
- Principal Components Analysis
- Independent Components Analysis
- Cocktail Party Problem
- Matrix
- Alternatives

- History
- Sending a Message
- Expected size of the message
- Information between two variables
- Mutual information
- Two Independent Coins
- Two Dependent Coins
- Kullback Leibler Divergence

Here you can find a description and details on the final project in Unsupervised Learning: design a system that recommends new movies for you based on your past ratings!