Skip to content

Latest commit

 

History

History
419 lines (357 loc) · 19.3 KB

index.md

File metadata and controls

419 lines (357 loc) · 19.3 KB
layout title
default
Machine Learning @ VU

{::nomarkdown}

Extra resources

{:/nomarkdown}

This page contains all public information about the course Machine Learning at the VU University Amsterdam. We provide the following materials:

  • Lecture slides and videos.
  • Worksheets These are very brief Jupyter notebooks to help you get the software installed and to show the basics. They introduce the libraries Numpy, Matplotlib, Pandas, Sklearn and Keras.
  • Homework The homework consists of small pen-and-paper exercises to help you test that you've really understood the more technical points of the lectures. Answers are provided. If you are a registered student, please refer to the Canvas page instead. All material authored by Peter Bloem unless noted otherwise.

Reuse is allowed under a creative commons license, details below.

All content

{::nomarkdown}

<td><a href="https://www.youtube.com/playlist?list=PLCof9EqayQgs6gGKPUDURn6aoV6gCIUPa">playlist</a> <a href="./lectures/31.ProbabilisticModels1.annotated.pdf">slides</a>  </td>
<td rowspan="2"><a href="./homework/week3.noanswers.pdf">plain</a>, <a href="./homework/week3.answers.pdf">answers</a></td>
<td rowspan="2"><a href="https://github.com/mlvu/worksheets/blob/master/Worksheet%203%2C%20Pandas.ipynb">pandas</a></td>
<td><a href="https://youtu.be/k0_56JyYaOM">2020</a> <a href="https://youtu.be/f2HIW37Ohho">2019</a> <a href="https://youtu.be/DM1APCpqF8g">2018</a></td>
<td><a href="https://www.youtube.com/playlist?list=PLCof9EqayQgs-MP4aQQ-2teemZANWKBjh">playlist</a> <a href="./lectures/32.LinearModels2.annotated.pdf">slides</a></td>
<td><a href="https://youtu.be/1NVgspM98W0">2020</a> <a href="https://youtu.be/g2lziWxf_9Q">2019</a> <a href="https://youtu.be/F6gFYAwXmAs">2018</a></td>
homework worksheets previous
w1

1. Introduction

playlist slides plain, answers getting set up, numpy 2020 2019 2018

2. Linear models and search

playlist slides 2020 2019 2018
w2

3. Model evaluation

</td>
<td> <a href="https://www.youtube.com/playlist?list=PLCof9EqayQgt6iSJnt8ABPhMNiU2hmZiK">playlist</a> <a href="./lectures/21.Methodology1.annotated.pdf">slides</a></td>
<td rowspan="2"><a href="./homework/week2.noanswers.pdf">plain</a>, <a href="./homework/week2.answers.pdf">answers</a></td>
<td rowspan="2"><a href="https://github.com/mlvu/worksheets/blob/master/Worksheet%202%2C%20Sklearn.ipynb">sklearn</a></td>
<td><a href="https://youtu.be/GaoNNaRjauU">2020</a> <a href="https://youtu.be/wbUE6X_B8B4">2019</a> <a href="https://youtu.be/okxskT6ben4">2018</a></td>

4. Data pre-processing

</td>
<td><a href="https://www.youtube.com/playlist?list=PLCof9EqayQgsJDHLYb0dxn5xr2-pjmV08">playlist</a> <a href="./lectures/22.Methodology2.annotated.pdf">slides</a> </td> 
<td><a href="https://youtu.be/Aad5UDrdHPg">2020</a> <a href="https://youtu.be/H4c4qpHdGq8">2019</a> <a href="https://youtu.be/csk2HSWS5r8">2018</a></td>
w3

5. Probabilistic Models

6. Beyond Linear models

w4

7. Deep Learning

</td>
<td> <a href="https://www.youtube.com/playlist?list=PLCof9EqayQgvCGzTPoRXPEYUWvFl8Cj71">playlist</a> <a href="./lectures/41.DeepLearning1.annotated.pdf">slides</a></td> 
<td rowspan="2"><a href="./homework/week4.noanswers.pdf">plain</a>, <a href="./homework/week4.answers.pdf">answers</a></td> 
<td rowspan="2"><a href="https://github.com/mlvu/worksheets/blob/master/Worksheet%204%2C%20Keras.ipynb">keras</a></td> 
<td><a href="https://youtu.be/DidHjsp_OV0">2020</a> <a href="https://youtu.be/VZwrbIBNzzA">2019</a> <a href="https://youtu.be/jOrYBnEPpYU">2018</a></td>

8. Density estimation

<ul class="videos">
     <li><a href="https://youtu.be/VZfAJzXu1hM">8.1 Normal distributions</a></li>
	 <li><a href="https://youtu.be/lRuiHSxtb1w">8.2 Maximum likelihood estimators</a></li>
	 <li><a href="https://youtu.be/Co3xlK2d_oI">8.3 Expectation-maximization</a></li>
	 <li><a href="https://youtu.be/MFQdNuVCk4A">8.4 Expectation-maximization from first principles</a></li>  		   
	 <li><a href="https://youtu.be/r4DYGXmbk_E">8.5 Social impact 3</a></li>
</ul>     

</td>
<td><a href="https://www.youtube.com/playlist?list=PLCof9EqayQgt9mF2CMt3NI1SZQQ_NYe28">playlist</a> <a href="./lectures/42.ProbabilisticModels2.annotated.pdf">slides</a> </td>
<td><a href="https://youtu.be/ZIX7PZgz4qs">2020</a> <a href="https://youtu.be/f2HIW37Ohho">2019</a> <a href="https://youtu.be/-7UJqvjNIjk">2018</a></td>
w5

9. Deep generative models

<ul class="videos">
     <li><a href="https://youtu.be/jAxUolSXGtg">9.1 Generator networks</a></li>
	 <li><a href="https://youtu.be/eaWxDebDDo8">9.2 Generative adversarial networks</a></li>
	 <li><a href="https://youtu.be/t6GxDo1fSt0">9.3 Autoencoders</a></li>
	 <li><a href="https://youtu.be/inUJd7f931g">9.4 Variational autoencoders</a></li>  		   
</ul>    

</td>
<td><a href="https://www.youtube.com/playlist?list=PLCof9EqayQguK56djSLj2C4LHNfLVZGjg">playlist</a> <a href="./lectures/51.Deep Learning2.annotated.pdf">slides</a> </td> 
<td rowspan="2"><a href="./homework/week5.noanswers.pdf">plain</a>, <a href="./homework/week5.answers.pdf">answers</a></td> 
<td rowspan="2"><a href="https://github.com/mlvu/worksheets/blob/master/Worksheet%205%2C%20Pytorch.ipynb">pytorch</a></td> 
<td><a href="https://youtu.be/0zTkHTk_-6s">2020</a> <a href="https://youtu.be/6N4zIx0ATME">2019</a> <a href="https://youtu.be/APuP9SkESGA">2018</a></td>

10. Tree Model and Ensembles

</td>
<td><a href="https://www.youtube.com/playlist?list=PLCof9EqayQgv5bPKEn7F1AEMyojCgTibW">playlist</a> <a href="./lectures/52.Trees.annotated.pdf">slides</a> </td> 
<td><a href="https://youtu.be/3pkOMubnwA8">2020</a> <a href="https://youtu.be/m-at5l3F_ig">2019</a> <a href="https://youtu.be/PGITM1E2CLk">2018</a></td>
w6

11. Models for Sequential Data

playlist slides plain answers 2020 2019 2018

12. Embedding models

playlist slides 2020 2019 2018
w7

13. Reinforcement Learning

playlist slides 2019 2018

14. Review

video slides 2019 2018
w8Exam. See below for practice exams.
{:/nomarkdown}

Feel free to open a github issue if you're working through the material and you spot a mistake, run into a problem or have any other kind of question. We also try to answer questions on youtube.

Required reading

Each week comes with a small amount of reading material. Most resources are publicly available free of charge. If you are a VU student, check Canvas for PDFs of the copyrighted works.

Week 1 Deep Learning, Goodfellow et al. Section 5.1
Week 2 Machine Learning, Peter Flach. Section 2.2
Everything you did and didn't know about PCA, Alex Williams
Week 3 Neural Networks and Deep Learning, Chapter 6
Week 4 What is the expectation maximization algorithm? Do et al.
Week 5 Intuitively Understanding Variational Autoencoders, Irhum Shafkat
Machine Learning, Tom Mitchell. Chapter 3.
Week 6 Understanding LSTM Networks, Chris Olah
Week 7 Reinforcement Learning: Pong from pixels, Andrej Karpathy

Practice exams

Each exam consists of 40 multiple choice questions.

Keynote files and re-use license

All material that is original to this course may be used under a CC BY 4.0 license. That means you are free to use the material, and adapt it, so long as appropriate credit is given. You may redistribute only under the same license.

How to credit:

  • For individual slides, please add a link to mlvu.github.io, on the slide, or in the published slide annotations.
  • If you are using a slide deck for a lecture as is, please indicate the source of the slides as mlvu.github.io clearly at the start of the lecture. Leaving the existing URL in place on the opening slide suffices.
  • If you use many of the slides, a single attribution can be made once at the start of the slide deck. Crediting me by name (Peter Bloem) is appreciated, but not strictly necessary.

If you would like to use the material, but do not want to attribute in this way for some reason, please get in touch. I'm sure we can work something out.

Some parts of the material are taken from other sources. The source should always be credited on the slide itself (let me know if this isn't the case). Please adapt and redistribute these only under the original licenses.

Keynote files

The original keynote files for the lectures (of the 2019 version) can be found here, and may be used under the terms of the license above. These can be converted to ppt, but the formulas may not survive the conversion process.

The formulas were typeset using a fantastic tool called LaTeXiT. Copy pasting a formula from Keynote to LaTeXiT should reveal the original LaTeX. You'll need to use this preample for the typesetting to work.