The lecture schedule will be updated as the term progresses.
| Date | Topic | Readings |
|---|---|---|
| Tue, Aug 30, 2022 | Course Intro | |
| Thu, Sep 1, 2022 | Text Classification + Sentiment Analysis |
Jurafsky and Martin, Chapter 6 "Naive Bayes Classification and Sentiment"
Bo Pang, Lillian Lee and Shivakumar Vaithyanathan, Thumbs up? Sentiment Classification using Machine Learning Techniques |
| Tue, Sep 6, 2022 | Word Sense + Log-linear Model + Perceptron |
Eisenstein, Chapter 2 "Linear Text Classification"
Jurafsky and Martin, Chapter 5 "Logistic Regression" Jurafsky and Martin, (optional) Chapter 18 "Word Sense and WordNet" |
| Thu, Sep 8, 2022 | N-gram Language Modeling |
Jurafsky and Martin, Chapter 3 "N-gram Language Modeling"
|
| Tue, Sep 13, 2022 | Part of Speech Tagging with Hidden Markov Models |
Jurafsky and Martin, Chapter 8 "Part of Speech Tagging"
|
| Thu, Sep 15, 2022 | Feature Rich POS tagging + Constituency Parsing |
Jurafsky and Martin, Chapter 8 "Part of Speech Tagging"
Jurafsky and Martin, Chapter 12 "Constituency Grammars" |
| Thu, Sep 15, 2022 | Homework 1 | |
| Fri, Sep 16, 2022 | Quiz 1 | |
| Tue, Sep 20, 2022 | Dependency Parsing + Constituency Parsing |
Jurafsky and Martin, Chapter 13 "Dependency Parsing"
Jurafsky and Martin, Chapter 12 "Constituency Parsing" |
| Thu, Sep 22, 2022 | Vector Spaces and Neural Word Vectors |
Jurafsky and Martin, Chapter 6.1 - 6.7 "Vector Semantics and Embeddings"
|
| Fri, Sep 23, 2022 | Quiz 2 | |
| Tue, Sep 27, 2022 | Neural Word Vectors and Applications |
Eisenstein, Chapter 14 "Distributional and Distributed Semantics"
|
| Thu, Sep 29, 2022 | Introducation to Neural Networks |
Eisenstein, Chapter 3 "Nonlinear Classification"
|
| Fri, Sep 30, 2022 | Quiz 3 | |
| Tue, Oct 4, 2022 | Neural Nets and Early Neural Network Language Models |
Jurafsky and Martin, Chapter 7 "Neural Networks and Neural Language Models"
|
| Mon, Oct 10, 2022 | Homework 2 | |
| Tue, Oct 11, 2022 | Recurrent Language Models |
Jurafsky and Martin, Chapter 9 "Deep Learning Architectures for Sequence Processing"
|
| Thu, Oct 13, 2022 | Sequence to Sequence Models + Attention |
Jurafsky and Martin, Chapter 11 "Machine Translation and Encoder-Decoder Models"
|
| Fri, Oct 14, 2022 | Quiz 4 | |
| Tue, Oct 18, 2022 | Sequence to Sequence Models + Attention |
Jurafsky and Martin, Chapter 11 "Machine Translation and Encoder-Decoder Models"
|
| Thu, Oct 20, 2022 | Machine Translation |
Eisenstein, Chapter 18
|
| Fri, Oct 21, 2022 | Quiz 5 | |
| Tue, Oct 25, 2022 | Information Extraction |
Jurafsky and Martin, Chapter 17 "Information Extraction"
|
| Thu, Oct 27, 2022 | Homework 3 | |
| Fri, Oct 28, 2022 | Quiz 6 | |
| Thu, Oct 27, 2022 | Semantic Role Labeling |
Jurafsky and Martin, Chapter 19 "Semantic Role Labeling"
|
| Tue, Nov 1, 2022 | Transformers |
Alexander Rush, The Annotated Transformer
|
| Thu, Nov 3, 2022 | Contextualized Embeddings |
Jay Alammar, Illustrated BERT
|
| Fri, Nov 4, 2022 | Quiz 7 | |
| Mon, Nov 7, 2022 | Project Proposal | |
| Tue, Nov 8, 2022 | No Lecture | |
| Thu, Nov 10, 2022 | Coreference Resolution |
Eisenstein, Chapter 15
Jurafsky and Martin, Chapter 21 |
| Fri, Nov 11, 2022 | Quiz 8 | |
| Tue, Nov 15, 2022 | Question Answering |
Jurafsky and Martin, Chapter 23
|
| Thu, Nov 17, 2022 | Generation |
Jurafsky and Martin, chapter 24
|
| Fri, Nov 18, 2022 | Quiz 9 | |
| Tue, Nov 22, 2022 | Homework 4 | |
| Tue, Nov 22, 2022 | No Class, Thanksgiving Week | |
| Thu, Nov 24, 2022 | No Class, Thanksgiving Week | |
| Tue, Nov 29, 2022 | Project Milestone 1 | |
| Tue, Nov 29, 2022 | Guest Lecture (likely remote) | |
| Thu, Dec 1, 2022 | Topic - Gender Bias in NLP | |
| Fri, Dec 2, 2022 | Quiz 10 | |
| Tue, Dec 6, 2022 | Guest Lecture (likely remote) | |
| Thu, Dec 8, 2022 | Project Milestone 2 | |
| Thu, Dec 8, 2022 | Topic - Wrap up and Final Thoughts | |
| Thu, Dec 15, 2022 | Project Milestone 3 | |
| Thu, Dec 22, 2022 | Project Final |