Announcement:​​​​

​

Data set in homework-2: link​

Data set in homework-4: on-policy, off-policy

Data set in final: off-policy

​

Notes:

​

Chapter 1

 

Incomplete data and the EM algorithm

​

Exponential family

​

Chapter 2

​

EM via Bayesian 

​

Chapter 3

​

Mixture Modeling

​

Chapter 4

​

Hidden Markov Model

​

Chapter 5

 

Reinforcement Learning: value-based RL, policy-based RL

​

​

​

​

​

​

 

​

​

 

​

 

 

 

 

 

 

 

 

 

 

 

 

 

​

​

​

​

​