The lecture schedule will be updated as the term progresses.
| Date | Topic | Readings |
|---|---|---|
| Wed, Aug 30, 2023 | Course Intro | |
| Mon, Sep 4, 2023 | No Lecture, Labor Day Holiday. | |
| Wed, Sep 6, 2023 | Text Classification + Sentiment Analysis |
Jurafsky and Martin, Chapter 6 "Naive Bayes Classification and Sentiment"
Bo Pang, Lillian Lee and Shivakumar Vaithyanathan, Thumbs up? Sentiment Classification using Machine Learning Techniques |
| Mon, Sep 11, 2023 | Word Sense + Log-linear Model + Perceptron |
Eisenstein, Chapter 2 "Linear Text Classification"
Jurafsky and Martin, Chapter 5 "Logistic Regression" Jurafsky and Martin, (optional) Chapter 18 "Word Sense and WordNet" |
| Wed, Sep 13, 2023 | N-gram Language Modeling |
Jurafsky and Martin, Chapter 3 "N-gram Language Modeling"
|
| Fri, Sep 15, 2023 | Quiz 1 | |
| Mon, Sep 18, 2023 | Part of Speech Tagging with Hidden Markov Models |
Jurafsky and Martin, Chapter 8 "Part of Speech Tagging"
|
| Mon, Sep 18, 2023 | Homework 1 - Text Classification with features | |
| Wed, Sep 20, 2023 | POS tagging + Dependancy Parsing |
Jurafsky and Martin, Chapter 8 "Part of Speech Tagging"
Jurafsky and Martin, Chapter 12 "Constituency Grammars" Jurafsky and Martin, Chapter 13 "Dependency Parsing" |
| Fri, Sep 22, 2023 | Quiz 2 | |
| Mon, Sep 25, 2023 | Vector Spaces and Neural Word Vectors |
Jurafsky and Martin, Chapter 6.1 - 6.7 "Vector Semantics and Embeddings"
|
| Wed, Sep 27, 2023 | Neural Word Vectors and Applications |
Eisenstein, Chapter 14 "Distributional and Distributed Semantics"
|
| Fri, Sep 29, 2023 | Quiz 3 | |
| Mon, Oct 2, 2023 | Introducation to Neural Networks |
Eisenstein, Chapter 3 "Nonlinear Classification"
|
| Wed, Oct 4, 2023 | Neural Nets and Early Neural Network Language Models |
Jurafsky and Martin, Chapter 7 "Neural Networks and Neural Language Models"
|
| Fri, Oct 6, 2023 | Quiz 3 | |
| Mon, Oct 9, 2023 | Homework 2 - POS tagging with HMM | |
| Mon, Oct 9, 2023 | Recurrent Language Models |
Jurafsky and Martin, Chapter 9 "Deep Learning Architectures for Sequence Processing"
|
| Wed, Oct 11, 2023 | Sequence to Sequence Models + Attention |
Jurafsky and Martin, Chapter 11 "Machine Translation and Encoder-Decoder Models"
|
| Fri, Oct 13, 2023 | Quiz 4 | |
| Mon, Oct 16, 2023 | Attention + Neural Machine Translation |
Eisenstein, Chapter 18
|
| Wed, Oct 18, 2023 | Transformers + Contextualized Embeddings |
Jay Alammar, Illustrated BERT
Alexander Rush, The Annotated Transformer |
| Fri, Oct 20, 2023 | Quiz 5 | |
| Mon, Oct 23, 2023 | Finetuning + Other LLMs ( GPT , BART, T5 ) | |
| Mon, Oct 23, 2023 | Homework 3 - Classification with DAN and LSTM | |
| Wed, Oct 25, 2023 | GPT-3 and Scaling Laws | |
| Fri, Oct 27, 2023 | Quiz 6 | |
| Mon, Oct 30, 2023 | Prompting, Zero-shot, In-context Learning | |
| Wed, Nov 1, 2023 | Efficiency in LLMs | |
| Wed, Nov 1, 2023 | Project Proposal | |
| Fri, Nov 3, 2023 | Quiz 7 | |
| Mon, Nov 6, 2023 | Prompting, Zero-shot, In-context Learning continued | |
| Mon, Nov 6, 2023 | Homework 4 - Fine tuning LLMs | |
| Wed, Nov 8, 2023 | Information Extraction + Semantic Role Labeling |
Jurafsky and Martin, Chapter 17 "Information Extraction"
Jurafsky and Martin, Chapter 19 "Semantic Role Labeling" |
| Fri, Nov 10, 2023 | Quiz 6 | |
| Mon, Nov 13, 2023 | Coreference Resolution |
Eisenstein, Chapter 15
Jurafsky and Martin, Chapter 21 |
| Wed, Nov 15, 2023 | Question Answering |
Jurafsky and Martin, Chapter 23
|
| Fri, Nov 17, 2023 | Quiz 8 | |
| Mon, Nov 20, 2023 | Multimodality | |
| Wed, Nov 22, 2023 | Homework 5 - Prompting | |
| Wed, Nov 22, 2023 | No lecture, Thanksigiving Holiday | |
| Mon, Nov 27, 2023 | Generation |
Jurafsky and Martin, chapter 24
|
| Mon, Nov 27, 2023 | Project Milestone 1 | |
| Wed, Nov 29, 2023 | Interpretability | |
| Fri, Dec 1, 2023 | Quiz 9 | |
| Mon, Dec 4, 2023 | Gender Bias in NLP | |
| Wed, Dec 6, 2023 | Guest Lecture (likely remote) | |
| Wed, Dec 6, 2023 | Project Milestone 2 | |
| Fri, Dec 8, 2023 | Quiz 10 | |
| Mon, Dec 11, 2023 | Wrap up and Final Thoughts | |
| Wed, Dec 13, 2023 | Project Milestone 3 | |
| Wed, Dec 20, 2023 | Project Final |