Skip to the content.

Schedule for In-class Presentations

Date Topic Suggested Readings Reference Homework
Aug.
25
Introduction [En]
Mathematics [En]
Machine Learning Basics [En]
Deep Learning Book
Chap. 2
Chap. 3
Chap. 5
Sep.
8
Feedforward Neural Networks & Optimization Tricks
Deep Learning Book
Chap. 6
Chap. 7
Chap. 8
Sep.
15
PyTorch part 1
PyTorch Part 2
Python Numpy Tutorial
Neural Network from Scratch
Dive into Deep Learning
HW1 (to be announced)
Sep.
22
Convolutional Neural Networks & Recurrent Neural Networks
Deep Learning Book
Chap. 9
Chap. 10
ResNet
ViT
Sep.
29
Word Representation Learning
Word2Vec
SGNS
GPT-1
Oct.
6
Attention, Transformers
Transformer
RoBERTa
Oct.
15
No class (Project proposal)
HW2 (to be announced)
Nov.
3
Large Language Models I
BERT
GPT-3
Survey of Pre-trained LMs
OPT
PaLM
LLaMA
Nov.
10
Large Language Models II - Prompt Tuning
Chain-of-Thought
Self Consistency
ReAct
Prefix-Tuning
Promtp Tuning
LoRA
Instruction Tuning
Nov.
17
Generative Models
GAN
VAE
DDPM
Stable diffusion
Nov.
24
Graph Representation Learning
DeepWalk
LINE
GCN
Open Graph Benchmark
Dec.
1
Poster Session