Schedule
-
EventDateDescriptionCourse Material
-
Lecture01/13/2026
Tuesday1. Introduction[slides]- Manning, C. D. (2022). Human language understanding & reasoning
- Bommasani, R. et al. (2021). On the opportunities and risks of foundation models
-
Assignment01/13/2026
Tuesday1. Paper Presentation released! -
Lecture01/15/2026
Thursday -
Lecture01/20/2026
Tuesday3. Word vectors[slides]- SLP, Chapter 5, Chapter I
- Mikolov et al. (2013). Efficient Estimation of Word Representations in Vector Space
- Pennington, Socher, & Manning (2014). GloVe: Global Vectors for Word Representation
-
Lecture01/22/2026
Thursday- Levy, Goldberg, & Dagan (2015). Improving Distributional Similarity in Word Embeddings
-
Lecture01/27/2026
Tuesday5. Neural network[slides]- SLP, Chapter 6
- Pennington, Socher, & Manning (2014). Natural language processing (almost) from scratch
-
Lecture01/29/2026
Thursday -
Lecture02/03/2026
Tuesday7. Dependency parsing[slides]- SLP, Chapter 19
- de Marneffe et al. (2021). Universal Dependencies
- Chen & Manning (2014). A fast and accurate dependency parser using neural networks
-
Lecture02/05/2026
Thursday8. Lab 4 Dependency parsing[colab] -
Lecture02/10/2026
Tuesday9. Language modeling, RNNs[slides]- SLP, Chapter 3
- SLP, Chapter 13
- Sak et al. (2014). Long Short-Term Memory Recurrent Neural Network Architectures for Large Scale Acoustic Modeling
-
Lecture02/12/2026
Thursday10. Lab 5 Sentiment analysis[colab] -
Lecture02/17/2026
Tuesday11. LSTMs[slides]- SLP, Chapter 13
- Vaswani et el. (2017). Attention Is All You Need
-
Assignment02/17/2026
Tuesday2. Project Proposal released! -
Lecture02/19/2026
Thursday12. Lab 6 Hugging face[colab] -
Lecture02/24/2026
Tuesday13. Transformers[slides]- SLP, Chapter 8
- Devlin et el. (2019). BERT: Pre-training of Deep Bidirectional Transformers
-
Lecture02/26/2026
Thursday14. Lab 7 Ollama[slides]- Huang et al. (2018). Music Transformer; Cool demo.
- Smith. (2020). Contextual Word Representations.
-
Group work03/03/2026
TuesdayProject group meeting -
Group work03/05/2026
ThursdayProject proposal presentation -
No class03/10/2026
TuesdaySpring break -
No class03/12/2026
ThursdaySpring break -
Due03/13/2026 23:59
Friday2. Project Proposal -
Lecture03/17/2026
Tuesday15. Pre/Post-training[slides]- SLP, Chapter 9
- Chung et al. (2022). Scaling Instruction-Finetuned Language Models
- Wang et al. (2022). How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources
-
Lecture03/18/2026
Wednesday16. Lab 8 Constructed languages[slides]- Taguchi & Sproat. (2025). IASC: Interactive Agentic System for ConLangs
-
Lecture03/24/2026
Tuesday17. LLMs in 2025 -
Lecture03/26/2026
Thursday18. Efficient adaptation[slides]- Brown et al. (2020). Language Models Are Few-Shot Learners
- Hu et al. (2021). LoRA: Low-Rank Adaptation of Large Language Models
-
Group work03/31/2026
TuesdayBackground research presentation 1Guided slides used in class are available here.
-
Assignment03/31/2026
Tuesday3. Background Research Presentation released! -
Assignment04/01/2026
Wednesday4. Midway Report released! -
Group work04/02/2026
ThursdayBackground research presentation 2 -
Due04/02/2026 23:59
Thursday3. Background Research Presentation -
Due04/03/2026 23:59
Friday4. Midway Report -
Due04/16/2026 23:59
Thursday1. Paper Presentation -
No class04/28/2026
TuesdayReading day