The lecture schedule will be updated as the term progresses.
| Date | Topic | Readings |
|---|---|---|
| Wed, Aug 28, 2024 | Course Intro | |
| Mon, Sep 2, 2024 | No Lecture, Labor Day Holiday. | |
| Wed, Sep 4, 2024 | Text Classification + Sentiment Analysis |
Jurafsky and Martin, Chapter 4 "Naive Bayes Classification and Sentiment"
Bo Pang, Lillian Lee and Shivakumar Vaithyanathan, Thumbs up? Sentiment Classification using Machine Learning Techniques |
| Mon, Sep 9, 2024 | Word Sense + Log-linear Model + Perceptron |
Eisenstein, Chapter 2 "Linear Text Classification"
Jurafsky and Martin, Chapter 5 "Logistic Regression" Jurafsky and Martin, (optional) Chapter 18 "Word Sense and WordNet" |
| Wed, Sep 11, 2024 | N-gram Language Modeling |
Jurafsky and Martin, Chapter 3 "N-gram Language Modeling"
|
| Mon, Sep 16, 2024 | Part of Speech Tagging with Hidden Markov Models |
Jurafsky and Martin, Chapter A "Part of Speech Tagging"
|
| Mon, Sep 16, 2024 | Homework 1 - Text Classification with features | |
| Wed, Sep 18, 2024 | POS tagging + Dependancy Parsing |
Jurafsky and Martin, Chapter A "Part of Speech Tagging"
Jurafsky and Martin, Chapter C "Constituency Grammars" Jurafsky and Martin, Chapter 19 "Dependency Parsing" |
| Fri, Sep 20, 2024 | Quiz 1 | |
| Mon, Sep 23, 2024 | Vector Spaces and Neural Word Vectors |
Jurafsky and Martin, Chapter 6.1 - 6.7 "Vector Semantics and Embeddings"
|
| Wed, Sep 25, 2024 | Neural Word Vectors and Applications |
Eisenstein, Chapter 14 "Distributional and Distributed Semantics"
|
| Fri, Sep 27, 2024 | Quiz 2 | |
| Mon, Sep 30, 2024 | Introducation to Neural Networks |
Eisenstein, Chapter 3 "Nonlinear Classification"
|
| Wed, Oct 2, 2024 | No Lecture, Fall Break. | |
| Mon, Oct 7, 2024 | Neural Nets and Early Neural Network Language Models |
Jurafsky and Martin, Chapter 7 "Neural Networks and Neural Language Models"
|
| Wed, Oct 9, 2024 | Recurrent Language Models |
Jurafsky and Martin, Chapter 9 "Deep Learning Architectures for Sequence Processing"
|
| Wed, Oct 9, 2024 | Homework 2 - POS tagging with HMM | |
| Mon, Oct 14, 2024 | Sequence to Sequence Models + Attention |
Jurafsky and Martin, Chapter 11 "Machine Translation and Encoder-Decoder Models"
|
| Wed, Oct 16, 2024 | Attention + Neural Machine Translation |
Eisenstein, Chapter 18
|
| Fri, Oct 18, 2024 | Quiz 3 | |
| Mon, Oct 21, 2024 | Transformers + Contextualized Embeddings |
Jay Alammar, Illustrated BERT
Alexander Rush, The Annotated Transformer |
| Mon, Oct 21, 2024 | Project Proposal | |
| Wed, Oct 23, 2024 | Transformers + Contextualized Embeddings continued. |
Jay Alammar, Illustrated BERT
Alexander Rush, The Annotated Transformer |
| Fri, Oct 25, 2024 | Quiz 4 | |
| Mon, Oct 28, 2024 | Homework 3 - Classification with DAN and LSTM | |
| Mon, Oct 28, 2024 | NLP datasets and Applications Part 1. | |
| Wed, Oct 30, 2024 | NLP datasets and Applications Part 2. | |
| Fri, Nov 1, 2024 | Quiz 5 | |
| Fri, Nov 8, 2024 | Project Milestone 1 | |
| Mon, Nov 4, 2024 | Large LMs | |
| Wed, Nov 6, 2024 | Aligning Large LMs | |
| Fri, Nov 8, 2024 | Quiz 6 | |
| Mon, Nov 11, 2024 | Efficient LMs | |
| Mon, Nov 11, 2024 | Homework 4 - Finetuning BERT | |
| Wed, Nov 13, 2024 | Interpretability | |
| Wed, Nov 20, 2024 | Project Milestone 2 | |
| Fri, Nov 15, 2024 | Quiz 7 | |
| Mon, Nov 18, 2024 | Mulitmodality | |
| Wed, Nov 20, 2024 | Dataset Biases | |
| Mon, Nov 25, 2024 | Homework 5 - Prompting | |
| Mon, Nov 25, 2024 | Social Biases | |
| Mon, Dec 2, 2024 | Guest Research Lecture | |
| Wed, Dec 4, 2024 | Guest Research Lecture | |
| Mon, Dec 9, 2024 | Wrap up + Final Thoughts | |
| Mon, Dec 9, 2024 | Project Milestone 3 | |
| Thu, Dec 19, 2024 | Project Final Submission (no late days) |