| Thu, Aug 29, 2024 |
Intro to the class, Interactive Fiction, and Automated Story Generation
(Module 0)
[slides]
|
|
-
Peter A. Jansen, A Systematic Survey of Text Worlds as Embodied Natural Language Environments
-
Marc-Alexandre Côté, Ákos Kádár, Xingdi Yuan, Ben Kybartas, Tavian Barnes, Emery Fine, James Moore, Matthew Hausknecht, Ruo Yu Tao, Layla El Asri, Mahmoud Adada, Wendy Tay, and Adam Trischler, TextWorld: A Learning Environment for Text-based Games
-
Matthew Hausknecht, Prithviraj Ammanabrolu, Marc-Alexandre Côté, Xingdi Yuan, Interactive Fiction Games: A Colossal Adventure
|
|
|
| Tue, Sep 3, 2024 |
Neural Language Models + Attention
(Module 1)
[slides]
|
|
|
|
|
| Wed, Sep 4, 2024 |
Waitlist Deadline
|
|
|
|
|
| Thu, Sep 5, 2024 |
Waitlists Deactivated
|
|
|
|
|
| Thu, Sep 5, 2024 |
Transformers
(Module 1)
[slides]
|
|
-
Emily M. Bender, Timnit Gebru, Angelina McMillan-Major, Margaret Mitchell, On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?
-
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, Illia Polosukhin, [Transformer paper] Attention is All You Need
-
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, [GPT-2 paper] Language Models are Unsupervised Multitask Learners
-
Roy Schwartz, Jesse Dodge, Noah A. Smith, Oren Etzioni, Green AI
|
|
|
| Tue, Sep 10, 2024 |
Output
(Module 1)
[slides]
|
Generating Room Descriptions
|
-
Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, Yejin Choi, The Curious Case of Neural Text Degeneration
-
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, et al., [GPT-3 paper] Language Models are Few-Shot Learners
-
Pengfei Liu, Weizhe Yuan, Jinlan Fu, Zhengbao Jiang, Hiroaki Hayashi, Graham Neubig, Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing
-
Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed Chi, Quoc Le, Denny Zhou, Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
|
|
|
| Wed, Sep 11, 2024 |
|
|
|
|
HW1: Build a Text-Adventure Game (7%)
|
| Wed, Sep 11, 2024 |
Last day to drop without a W
|
|
|
|
|
| Thu, Sep 12, 2024 |
Foundation Models + Word Embeddings
(Module 1)
[slides]
|
|
-
Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean, [word2vec paper] Efficient Estimation of Word Representations in Vector Space
-
Piotr Bojanowski, Edouard Grave, Armand Joulin, Tomas Mikolov, [FastText paper] Enriching Word Vectors with Subword Information
-
Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova, BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
-
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J. Liu, [T5 paper] Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
|
|
|
| Tue, Sep 17, 2024 |
Campus Closed - No Class
|
|
|
|
|
| Thu, Sep 19, 2024 |
Neural Story Generation + Module 1 Paper Presentations
(Module 1)
[slides]
|
|
|
|
|
| Tue, Sep 24, 2024 |
Scripts and Events
(Module 2)
[slides]
|
Make Your Own Mini Script
|
-
Roger Schank, Robert Abelson, Scripts Plans Goals and Understanding: An Inquiry Into Human Knowledge Structures (Chapter 3: Scripts)
-
Karl Pichotta, Raymond Mooney, Learning Statistical Scripts with LSTM Recurrent Neural Networks
-
Lara J. Martin, Prithviraj Ammanabrolu, Xinyu Wang, William Hancock, Shruti Singh, Brent Harrison, Mark O. Riedl, Event Representations for Automated Story Generation with Deep Neural Nets
-
Nathanael Chambers and Dan Jurafsky, Unsupervised Learning of Narrative Schemas and their Participants
-
Keisuke Sakaguchi, Chandra Bhagavatula, Ronan Le Bras, Niket Tandon, Peter Clark, Yejin Choi, proScript: Partially Ordered Scripts Generation via Pre-trained Language Models
-
Abhilasha Sancheti, Rachel Rudinger, What do Large Language Models Learn about Scripts?
-
Marie-Laure Ryan, Fiction, Non-Factuals, and the Principle of Minimal Departure
-
Yidan Sun, Qin Chao, Boyang Li, Event Causality Is Key to Computational Story Understanding
|
|
|
| Thu, Sep 26, 2024 |
Understanding Procedures
(Module 2)
[slides]
|
|
-
Belinda Z. Li, Maxwell Nye, Jacob Andreas, Implicit Representations of Meaning in Neural Language Models
-
Qing Lyu, Li Zhang, Chris Callison-Burch, Goal-Oriented Script Construction
-
Li Zhang, Qing Lyu, Chris Callison-Burch, Reasoning about Goals, Steps, and Temporal Ordering with WikiHow
-
Li Zhang, Qing Lyu, Chris Callison-Burch, Intent Detection with WikiHow
-
Rowan Zellers, Yonatan Bisk, Roy Schwartz, Yejin Choi, SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inference
|
|
|
| Mon, Sep 30, 2024 |
|
|
|
|
Project Milestone 1: Proposal
|
| Tue, Oct 1, 2024 |
Guided Story Generation
(Module 2)
[slides]
|
|
-
Lili Yao, Nanyun Peng, Ralph Weischedel, Kevin Knight, Dongyan Zhao, Rui Yan, Plan-And-Write: Towards Better Automatic Storytelling
-
Hannah Rashkin, Asli Celikyilmaz, Yejin Choi, Jianfeng Gao, PlotMachines: Outline-Conditioned Generation with Dynamic Plot State Tracking
-
Pradyumna Tambwekar, Murtaza Dhuliawala, Lara J. Martin, Animesh Mehta, Brent Harrison, Mark O. Riedl, Controllable Neural Story Plot Generation via Reward Shaping
-
Shanshan Huang, Kenny Q. Zhu, Qianzi Liao, Libin Shen, Yinggong Zhao, Enhanced Story Representation by ConceptNet for Predicting Story Endings
-
Nasrin Mostafazadeh, Nathanael Chambers, Xiaodong He, Devi Parikh, Dhruv Batra, Lucy Vanderwende, Pushmeet Kohli, James Allen, A Corpus and Cloze Evaluation for Deeper Understanding of Commonsense Stories
|
|
|
| Thu, Oct 3, 2024 |
Module 2 Paper Presentations
(Module 2)
|
|
|
|
|
| Mon, Oct 7, 2024 |
|
|
|
|
HW2: Prompting and Fine-tuning (12%)
|
| Tue, Oct 8, 2024 |
Search
(Module 3)
[slides]
|
Search Algorithms for Action Castle
|
|
|
|
| Thu, Oct 10, 2024 |
Classical Planning + Story/Game Planning
(Module 3)
[slides]
|
|
-
Rogelio Cardona-Rivera, Arnav Jhala, Julie Porteous, R. Michael Young, The Story So Far on Narrative Planning
-
Michael Lebowitz, Story-Telling as Planning and Learning
-
Michael Lebowitz, Planning Stories
-
Stephen G. Ware, R. Michael Young, CPOCL: A Narrative Planner Supporting Conflict
-
Mark O. Riedl, R. Michael Young, Open-world planning for story generation
-
R. Michael Young, Stephen Ware, Brad Cassell, Justus Robertson, Plans and planning in narrative generation: a review of plan-based approaches to the generation of story, discourse and interactivity in narratives
-
Julie Porteous, Marc Cavazza, Controlling narrative generation with planning trajectories: The role of constraints
-
Stephen G. Ware, Cory Siler, Sabre: A Narrative Planner Supporting Intention and Deep Theory of Mind
-
Stephen G. Ware, R. Michael Young, Glaive: A State-Space Narrative Planner Supporting Intentionality and Conflict
-
Mihai Polceanu, Julie Porteous, Alan Lindsay, Marc Cavazza, Narrative Plan Generation with Self-Supervised Learning
-
Michael Mateas, Andrew Stern, Integrating Plot, Character and Natural Language Processing in the Interactive Drama Façade
-
Manu Sharma, Santiago Ontañón, Manish Mehta, Ashwin Ram, Drama Management and Player Modeling for Interactive Fiction Games
-
Stephen G. Ware, Edward T. Garcia, Alireza Shirvani, Rachelyn Farrell, Multi-Agent Narrative Experience Management as Story Graph Pruning
|
|
|
| Tue, Oct 15, 2024 |
LLM-based Story Planning
(Module 3)
[slides]
by Nisha Simon
|
|
-
Nisha Simon & Christian Muise, Want To Choose Your Own Adventure? Then First Make a Plan.
-
Yi Wang, Qian Zhou, David Ledo, StoryVerse: Towards Co-authoring Dynamic Plot with LLM-based Character Simulation via Narrative Planning
-
Evgeniia Razumovskaia, Joshua Maynez, Annie Louis, Mirella Lapata, Shashi Narayan, Little Red Riding Hood Goes Around the Globe: Crosslingual Story Planning and Generation with Large Language Models
-
Nisha Simon, Does Robin Hood Use a Lightsaber?: Automated Planning for Storytelling
-
Anbang Ye, Christopher Cui, Taiwei Shi, Mark O. Riedl, Neural Story Planning
|
|
|
| Thu, Oct 17, 2024 |
Commonsense Reasoning
(Module 4)
|
|
-
David Gunning, Machine Common Sense Concept Paper
-
Kathy Panton, Cynthia Matuszek, Douglas Lenat, Dave Schneider, Michael Witbrock, Nick Siegel, and Blake Shepard, Common Sense Reasoning – From Cyc to Intelligent Assistant
-
Shane Storks, Qiaozi Gao, Joyce Y. Chai, Commonsense Reasoning for Natural Language Understanding: A Survey of Benchmarks, Resources, and Approaches
-
Yejin Choi, Vered Shwartz, Maarten Sap, Antoine Bosselut, Dan Roth, ACL 2020 Commonsense Tutorial
-
Gabor Angeli & Chris Manning, NaturalLI: Natural Logic Inference for Common Sense Reasoning
|
|
|
|
|
|
|
|
|
| Mon, Oct 21, 2024 |
|
|
|
|
HW3: Guided Story Generation (12%)
|
| Tue, Oct 22, 2024 |
Façade Playthrough + Module 3 Paper Presentations
(Module 3)
|
|
|
|
|
| Mon, Oct 28, 2024 |
|
|
|
|
Final Project Milestone 2: Project Progress
|
| Tue, Oct 29, 2024 |
Knowledge Representations + Schemata
(Module 4)
|
|
-
Robyn Speer, Joshua Chin, Catherine Havasi, ConceptNet 5.5: An Open Multilingual Graph of General Knowledge
-
Martha Palmer, Claire Bonial, Jena Hwang, VerbNet: Capturing English verb behavior, meaning and usage
-
Christiane Fellbaum, WordNet
-
Nasrin Mostafazadeh, Aditya Kalyanpur, Lori Moon, David Buchanan, Lauren Berkowitz, Or Biran, Jennifer Chu-Carroll, GLUCOSE: GeneraLized and COntextualized Story Explanations
-
Maarten Sap, Ronan Le Bras, Emily Allaway, Chandra Bhagavatula, Nicholas Lourie, Hannah Rashkin, Brendan Roof, Noah A. Smith, Yejin Choi, ATOMIC: An Atlas of Machine Commonsense for If-Then Reasoning
-
Zhongyang Li, Xiao Ding, Ting Liu, J. Edward Hu, Benjamin Van Durme, Guided Generation of Cause and Effect
-
Peter Clark, Bhavana Dalvi, Niket Tandon, What Happened? Leveraging VerbNet to Predict the Effects of Actions in Procedural Text
-
Lei Shi & Rada Mihalcea, Putting Pieces Together: Combining FrameNet, VerbNet and WordNet for Robust Semantic Parsing
|
|
|
| Thu, Oct 31, 2024 |
Storytelling with Ontologies + Recap
(Module 4)
|
|
|
|
|
| Mon, Nov 4, 2024 |
|
|
|
|
HW4 (12%)
|
| Wed, Nov 6, 2024 |
Last day to withdraw from a course
|
|
|
|
|
| Tue, Nov 5, 2024 |
Intro to Dialogue + Dialogue for Interactive Fiction + Module 4 Paper Presentations
|
|
|
|
|
| Thu, Nov 7, 2024 |
Character-Based Generation
(Module 5)
|
|
-
Chris Callison-Burch, Gaurav Singh Tomar, Lara J. Martin, Daphne Ippolito, Suma Bailis, David Reitter, Dungeons and Dragons as a Dialogue Challenge for Artificial Intelligence
-
Annie Louis & Charles Sutton, Deep Dungeons and Dragons: Learning Character-Action Interactions from Role-Playing Game Transcripts
-
Maarten Sap, Marcella Cindy Prasettio, Ari Holtzman, Hannah Rashkin, Yejin Choi, Connotation Frames of Power and Agency in Modern Films
-
James Ryan, Curating Simulated Storyworlds
|
|
|
| Tue, Nov 12, 2024 |
Module 5 Paper Presentations
(Module 5)
|
|
-
Stephen Roller, Emily Dinan, Naman Goyal, Da Ju, Mary Williamson, Yinhan Liu, Jing Xu, Myle Ott, Eric Michael Smith, Y-Lan Boureau, Jason Weston, Recipes for Building an Open-Domain Chatbot
-
Daniel Adiwardana, Minh-Thang Luong, David R. So, Jamie Hall, Noah Fiedel, Romal Thoppilan, Zi Yang, Apoorv Kulshreshtha, Gaurav Nemade, Yifeng Lu, Quoc V. Le, Towards a Human-like Open-Domain Chatbot
-
Joao Sedoc, Daphne Ippolito, Arun Kirubarajan, Jai Thirani, Lyle Ungar, Chris Callison-Burch, ChatEval: A Tool for Chatbot Evaluation
|
|
|
| Thu, Nov 14, 2024 |
Peiqi "Patrick" Sui
(Module 6)
by Peiqi "Patrick" Sui
|
|
|
|
|
| Mon, Nov 18, 2024 |
|
|
|
|
HW5 (12%)
|
| Tue, Nov 19, 2024 |
Co-creating Storytelling Machines
(Module 6)
by Kory Mathewson
|
|
-
Piotr Mirowski, Juliette Love, Kory Mathewson, Shakir Mohamed, A Robot Walks into a Bar: Can Language Models Serve as Creativity SupportTools for Comedy? An Evaluation of LLMs’ Humour Alignment with Comedians
-
Kory W. Mathewson, et al., Communicative capital: a key resource for human–machine shared agency and collaborative capacity
-
Piotr Mirowski, Kory W. Mathewson, Jaylen Pittman, Richard Evans, Co-writing screenplays and theatre scripts with language models: Evaluation by industry professionals
|
|
|
| Thu, Nov 21, 2024 |
TBA
|
|
|
|
|
| Mon, Nov 25, 2024 |
|
|
|
|
Project Milestone 3: Final Report Draft
|
| Tue, Nov 26, 2024 |
Novel Interfaces for Creative Text Generation
(Module 6)
by Max Kreminiski
|
|
|
|
|
| Thu, Nov 28, 2024 |
Thanksgiving - No lecture
|
|
|
|
|
| Tue, Dec 3, 2024 |
Final Project In-Class Help
|
|
|
|
|
| Wed, Dec 31, 1969 |
|
|
|
|
Project Milestone 4: Final Submission
|
| Thu, Dec 5, 2024 |
Co-Creativity
(Module 6)
by Zhiyu Lin (林之雨)
|
|
|
|
|
| Tue, Dec 10, 2024 |
TBA
|
|
|
|
|
| Thu, Dec 12, 2024 |
Final Project Presentations, 10:30am - 12:30pm, SHER 150
|
|
|
|
|