Schedule for In-class Presentations
Date | Topic | Suggested Readings | Reference | Homework |
---|---|---|---|---|
Aug. 25 |
Introduction [En]
Mathematics [En] Machine Learning Basics [En] |
Deep Learning Book
Chap. 2 Chap. 3 Chap. 5 |
||
Sep. 8 |
Feedforward Neural Networks & Optimization Tricks
|
Deep Learning Book
Chap. 6 Chap. 7 Chap. 8 |
||
Sep. 15 |
PyTorch part 1
PyTorch Part 2 |
Python Numpy Tutorial
Neural Network from Scratch Dive into Deep Learning |
HW1 (to be announced)
|
|
Sep. 22 |
Convolutional Neural Networks & Recurrent Neural Networks
|
Deep Learning Book
Chap. 9 Chap. 10 |
ResNet
ViT |
|
Sep. 29 |
Word Representation Learning
|
Word2Vec
|
SGNS
GPT-1 |
|
Oct. 6 |
Attention, Transformers
|
Transformer
|
RoBERTa
|
|
Oct. 15 |
No class (Project proposal)
|
HW2 (to be announced)
|
||
Nov. 3 |
Large Language Models I
|
BERT
GPT-3 Survey of Pre-trained LMs |
OPT
PaLM LLaMA |
|
Nov. 10 |
Large Language Models II - Prompt Tuning
|
Chain-of-Thought
Self Consistency ReAct |
Prefix-Tuning
Promtp Tuning LoRA Instruction Tuning |
|
Nov. 17 |
Generative Models
|
GAN
VAE |
DDPM
Stable diffusion |
|
Nov. 24 |
Graph Representation Learning
|
DeepWalk
LINE GCN |
Open Graph Benchmark
|
|
Dec. 1 |
Poster Session
|