# 252-0220-00L Introduction to Machine Learning

Semester | Spring Semester 2018 |

Lecturers | A. Krause |

Periodicity | yearly recurring course |

Language of instruction | English |

Comment | Previously called Learning and Intelligent Systems Prof. Krause approves that students take distance exams, also if the exam will take place at a later time due to a different time zone of the alternative exam place. To get Prof. Krause's signature on the distance exam form please send it to Rita Klute, Link. |

Abstract | The course introduces the foundations of learning and making predictions based on data. |

Objective | The course will introduce the foundations of learning and making predictions from data. We will study basic concepts such as trading goodness of fit and model complexitiy. We will discuss important machine learning algorithms used in practice, and provide hands-on experience in a course project. |

Content | - Linear regression (overfitting, cross-validation/bootstrap, model selection, regularization, [stochastic] gradient descent) - Linear classification: Logistic regression (feature selection, sparsity, multi-class) - Kernels and the kernel trick (Properties of kernels; applications to linear and logistic regression; k-NN - The statistical perspective (regularization as prior; loss as likelihood; learning as MAP inference) - Statistical decision theory (decision making based on statistical models and utility functions) - Discriminative vs. generative modeling (benefits and challenges in modeling joint vy. conditional distributions) - Bayes' classifiers (Naive Bayes, Gaussian Bayes; MLE) - Bayesian networks and exact inference (conditional independence; variable elimination; TANs) - Approximate inference (sum/max product; Gibbs sampling) - Latent variable models (Gaussian Misture Models, EM Algorithm) - Temporal models (Bayesian filtering, Hidden Markov Models) - Sequential decision making (MDPs, value and policy iteration) - Reinforcement learning (model-based RL, Q-learning) |

Literature | Textbook: Kevin Murphy: A Probabilistic Perspective, MIT Press |

Prerequisites / Notice | Designed to provide basis for following courses: - Advanced Machine Learning - Data Mining: Learning from Large Data Sets - Probabilistic Artificial Intelligence - Probabilistic Graphical Models - Seminar "Advanced Topics in Machine Learning" |