| Thu, Aug 29, 2024 |
Intro to the class, Interactive Fiction, and Automated Story Generation
(Module 0)
[slides]
|
|
-
Peter A. Jansen, A Systematic Survey of Text Worlds as Embodied Natural Language Environments
-
Marc-Alexandre Côté, Ákos Kádár, Xingdi Yuan, Ben Kybartas, Tavian Barnes, Emery Fine, James Moore, Matthew Hausknecht, Ruo Yu Tao, Layla El Asri, Mahmoud Adada, Wendy Tay, and Adam Trischler, TextWorld: A Learning Environment for Text-based Games
-
Matthew Hausknecht, Prithviraj Ammanabrolu, Marc-Alexandre Côté, Xingdi Yuan, Interactive Fiction Games: A Colossal Adventure
|
|
|
| Tue, Sep 3, 2024 |
Neural Language Models + Attention
(Module 1)
[slides]
|
|
|
|
|
| Wed, Sep 4, 2024 |
Waitlist Deadline
|
|
|
|
|
| Thu, Sep 5, 2024 |
Waitlists Deactivated
|
|
|
|
|
| Thu, Sep 5, 2024 |
Transformers
(Module 1)
[slides]
|
|
-
Emily M. Bender, Timnit Gebru, Angelina McMillan-Major, Margaret Mitchell, On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?
-
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, Illia Polosukhin, [Transformer paper] Attention is All You Need
-
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, [GPT-2 paper] Language Models are Unsupervised Multitask Learners
-
Roy Schwartz, Jesse Dodge, Noah A. Smith, Oren Etzioni, Green AI
|
|
|
| Tue, Sep 10, 2024 |
Output
(Module 1)
[slides]
|
Generating Room Descriptions
|
-
Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, Yejin Choi, The Curious Case of Neural Text Degeneration
-
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, et al., [GPT-3 paper] Language Models are Few-Shot Learners
-
Pengfei Liu, Weizhe Yuan, Jinlan Fu, Zhengbao Jiang, Hiroaki Hayashi, Graham Neubig, Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing
-
Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed Chi, Quoc Le, Denny Zhou, Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
|
|
|
| Wed, Sep 11, 2024 |
|
|
|
|
HW1: Build a Text-Adventure Game (7%)
|
| Wed, Sep 11, 2024 |
Last day to drop without a W
|
|
|
|
|
| Thu, Sep 12, 2024 |
Foundation Models + Word Embeddings
(Module 1)
[slides]
|
|
-
Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean, [word2vec paper] Efficient Estimation of Word Representations in Vector Space
-
Piotr Bojanowski, Edouard Grave, Armand Joulin, Tomas Mikolov, [FastText paper] Enriching Word Vectors with Subword Information
-
Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova, BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
-
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J. Liu, [T5 paper] Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
|
|
|
| Tue, Sep 17, 2024 |
Campus Closed - No Class
|
|
|
|
|
| Thu, Sep 19, 2024 |
Neural Story Generation + Module 1 Paper Presentations
(Module 1)
[slides]
|
|
|
|
|
| Tue, Sep 24, 2024 |
Scripts and Events
(Module 2)
[slides]
|
Make Your Own Mini Script
|
-
Roger Schank, Robert Abelson, Scripts Plans Goals and Understanding: An Inquiry Into Human Knowledge Structures (Chapter 3: Scripts)
-
Karl Pichotta, Raymond Mooney, Learning Statistical Scripts with LSTM Recurrent Neural Networks
-
Lara J. Martin, Prithviraj Ammanabrolu, Xinyu Wang, William Hancock, Shruti Singh, Brent Harrison, Mark O. Riedl, Event Representations for Automated Story Generation with Deep Neural Nets
-
Nathanael Chambers and Dan Jurafsky, Unsupervised Learning of Narrative Schemas and their Participants
-
Keisuke Sakaguchi, Chandra Bhagavatula, Ronan Le Bras, Niket Tandon, Peter Clark, Yejin Choi, proScript: Partially Ordered Scripts Generation via Pre-trained Language Models
-
Abhilasha Sancheti, Rachel Rudinger, What do Large Language Models Learn about Scripts?
-
Marie-Laure Ryan, Fiction, Non-Factuals, and the Principle of Minimal Departure
-
Yidan Sun, Qin Chao, Boyang Li, Event Causality Is Key to Computational Story Understanding
|
|
|
| Thu, Sep 26, 2024 |
Understanding Procedures
(Module 2)
[slides]
|
|
-
Belinda Z. Li, Maxwell Nye, Jacob Andreas, Implicit Representations of Meaning in Neural Language Models
-
Qing Lyu, Li Zhang, Chris Callison-Burch, Goal-Oriented Script Construction
-
Li Zhang, Qing Lyu, Chris Callison-Burch, Reasoning about Goals, Steps, and Temporal Ordering with WikiHow
-
Li Zhang, Qing Lyu, Chris Callison-Burch, Intent Detection with WikiHow
-
Rowan Zellers, Yonatan Bisk, Roy Schwartz, Yejin Choi, SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inference
|
|
|
| Mon, Sep 30, 2024 |
|
|
|
|
Project Milestone 1: Proposal
|
| Tue, Oct 1, 2024 |
Guided Story Generation
(Module 2)
[slides]
|
|
-
Lili Yao, Nanyun Peng, Ralph Weischedel, Kevin Knight, Dongyan Zhao, Rui Yan, Plan-And-Write: Towards Better Automatic Storytelling
-
Hannah Rashkin, Asli Celikyilmaz, Yejin Choi, Jianfeng Gao, PlotMachines: Outline-Conditioned Generation with Dynamic Plot State Tracking
-
Pradyumna Tambwekar, Murtaza Dhuliawala, Lara J. Martin, Animesh Mehta, Brent Harrison, Mark O. Riedl, Controllable Neural Story Plot Generation via Reward Shaping
-
Shanshan Huang, Kenny Q. Zhu, Qianzi Liao, Libin Shen, Yinggong Zhao, Enhanced Story Representation by ConceptNet for Predicting Story Endings
-
Nasrin Mostafazadeh, Nathanael Chambers, Xiaodong He, Devi Parikh, Dhruv Batra, Lucy Vanderwende, Pushmeet Kohli, James Allen, A Corpus and Cloze Evaluation for Deeper Understanding of Commonsense Stories
|
|
|
| Thu, Oct 3, 2024 |
Module 2 Paper Presentations
(Module 2)
|
|
|
|
|
| Mon, Oct 7, 2024 |
|
|
|
|
HW2: Prompting and Fine-tuning (12%)
|
| Tue, Oct 8, 2024 |
Search
(Module 3)
[slides]
|
Search Algorithms for Action Castle
|
|
|
|
| Thu, Oct 10, 2024 |
Classical Planning + Story/Game Planning
(Module 3)
[slides]
|
|
-
Rogelio Cardona-Rivera, Arnav Jhala, Julie Porteous, R. Michael Young, The Story So Far on Narrative Planning
-
Michael Lebowitz, Story-Telling as Planning and Learning
-
Michael Lebowitz, Planning Stories
-
Stephen G. Ware, R. Michael Young, CPOCL: A Narrative Planner Supporting Conflict
-
Mark O. Riedl, R. Michael Young, Open-world planning for story generation
-
R. Michael Young, Stephen Ware, Brad Cassell, Justus Robertson, Plans and planning in narrative generation: a review of plan-based approaches to the generation of story, discourse and interactivity in narratives
-
Julie Porteous, Marc Cavazza, Controlling narrative generation with planning trajectories: The role of constraints
-
Stephen G. Ware, Cory Siler, Sabre: A Narrative Planner Supporting Intention and Deep Theory of Mind
-
Stephen G. Ware, R. Michael Young, Glaive: A State-Space Narrative Planner Supporting Intentionality and Conflict
-
Mihai Polceanu, Julie Porteous, Alan Lindsay, Marc Cavazza, Narrative Plan Generation with Self-Supervised Learning
-
Michael Mateas, Andrew Stern, Integrating Plot, Character and Natural Language Processing in the Interactive Drama Façade
-
Manu Sharma, Santiago Ontañón, Manish Mehta, Ashwin Ram, Drama Management and Player Modeling for Interactive Fiction Games
-
Stephen G. Ware, Edward T. Garcia, Alireza Shirvani, Rachelyn Farrell, Multi-Agent Narrative Experience Management as Story Graph Pruning
|
|
|
| Tue, Oct 15, 2024 |
LLM-based Story Planning
(Module 3)
[slides]
by Nisha Simon
|
|
-
Nisha Simon & Christian Muise, Want To Choose Your Own Adventure? Then First Make a Plan.
-
Yi Wang, Qian Zhou, David Ledo, StoryVerse: Towards Co-authoring Dynamic Plot with LLM-based Character Simulation via Narrative Planning
-
Evgeniia Razumovskaia, Joshua Maynez, Annie Louis, Mirella Lapata, Shashi Narayan, Little Red Riding Hood Goes Around the Globe: Crosslingual Story Planning and Generation with Large Language Models
-
Nisha Simon, Does Robin Hood Use a Lightsaber?: Automated Planning for Storytelling
-
Anbang Ye, Christopher Cui, Taiwei Shi, Mark O. Riedl, Neural Story Planning
|
|
|
| Thu, Oct 17, 2024 |
Commonsense Reasoning
(Module 4)
[slides]
|
|
-
Robyn Speer, Joshua Chin, Catherine Havasi, ConceptNet 5.5: An Open Multilingual Graph of General Knowledge
-
Martha Palmer, Claire Bonial, Jena Hwang, VerbNet: Capturing English verb behavior, meaning and usage
-
Christiane Fellbaum, WordNet
-
Maarten Sap, Ronan Le Bras, Emily Allaway, Chandra Bhagavatula, Nicholas Lourie, Hannah Rashkin, Brendan Roof, Noah A. Smith, Yejin Choi, ATOMIC: An Atlas of Machine Commonsense for If-Then Reasoning
-
Lei Shi & Rada Mihalcea, Putting Pieces Together: Combining FrameNet, VerbNet and WordNet for Robust Semantic Parsing
-
David Gunning, Machine Common Sense Concept Paper
-
Kathy Panton, Cynthia Matuszek, Douglas Lenat, Dave Schneider, Michael Witbrock, Nick Siegel, and Blake Shepard, Common Sense Reasoning – From Cyc to Intelligent Assistant
-
Shane Storks, Qiaozi Gao, Joyce Y. Chai, Commonsense Reasoning for Natural Language Understanding: A Survey of Benchmarks, Resources, and Approaches
-
Gabor Angeli & Chris Manning, NaturalLI: Natural Logic Inference for Common Sense Reasoning
|
|
|
|
|
|
|
|
|
| Tue, Oct 22, 2024 |
Class Cancelled
|
|
|
|
|
| Thu, Oct 24, 2024 |
Façade Playthrough + Module 3 Paper Presentations
(Module 3)
[slides]
|
|
|
|
|
| Mon, Oct 28, 2024 |
|
|
|
|
Final Project Milestone 2: Project Progress
HW3: Guided Generation (12%)
|
| Tue, Oct 29, 2024 |
Neurosymbolic Knowledge Base Systems
(Module 4)
[slides]
|
|
-
Jena D. Hwang, Chandra Bhagavatula, Ronan Le Bras, Jeff Da, Keisuke Sakaguchi, Antoine Bosselut, Yejin Choi, (COMET-)ATOMIC2020: On Symbolic and Neural Commonsense Knowledge Graphs
-
Nasrin Mostafazadeh, Aditya Kalyanpur, Lori Moon, David Buchanan, Lauren Berkowitz, Or Biran, Jennifer Chu-Carroll, GLUCOSE: GeneraLized and COntextualized Story Explanations
-
Zhongyang Li, Xiao Ding, Ting Liu, J. Edward Hu, Benjamin Van Durme, Guided Generation of Cause and Effect
-
Peter Clark, Bhavana Dalvi, Niket Tandon, What Happened? Leveraging VerbNet to Predict the Effects of Actions in Procedural Text
-
Peter West, Ronan Bras, Taylor Sorensen, Bill Lin, Liwei Jiang, Ximing Lu, Khyathi Chandu, Jack Hessel, Ashutosh Baheti, Chandra Bhagavatula, Yejin Choi, NovaCOMET: Open Commonsense Foundation Models with Symbolic Knowledge Distillation
|
|
|
| Thu, Oct 31, 2024 |
Storytelling with Ontologies + Recap
(Module 4)
[slides]
|
|
|
|
|
| Wed, Nov 6, 2024 |
Last day to withdraw from a course
|
|
|
|
|
| Tue, Nov 5, 2024 |
Class Cancelled - Election Day
|
|
|
|
|
| Thu, Nov 7, 2024 |
Module 4 Paper Presentations
(Module 4)
|
|
|
|
|
| Tue, Nov 12, 2024 |
Character-Based Generation
(Module 5)
[slides]
|
|
-
Jack Urbanek, Angela Fan, Siddharth Karamcheti, Saachi Jain, Samuel Humeau, Emily Dinan, Tim Rocktäschel, Douwe Kiela, Arthur Szlam, Jason Weston, Learning to Speak and Act in a Fantasy Text Adventure Game
-
Wai Man Si, Prithviraj Ammanabrolu, Mark O. Riedl, Telling Stories through Multi-User Dialogue by Modeling Character Relations
-
Shrimai Prabhumoye, Margaret Li, Jack Urbanek, Emily Dinan, Douwe Kiela, Jason Weston, Arthur Szlam, I love your chain mail! Making knights smile in a fantasy game world: Open-domain goal-oriented dialogue agents
-
Chris Callison-Burch, Gaurav Singh Tomar, Lara J. Martin, Daphne Ippolito, Suma Bailis, David Reitter, Dungeons and Dragons as a Dialogue Challenge for Artificial Intelligence
-
Maarten Sap, Marcella Cindy Prasettio, Ari Holtzman, Hannah Rashkin, Yejin Choi, Connotation Frames of Power and Agency in Modern Films
-
Anvesh Rao Vijjini, Faeze Brahman, Snigdha Chaturvedi, Towards Inter-character Relationship-driven Story Generation
-
Xuhui Zhou, Zhe Su, Tiwalayo Eisape, Hyunwoo Kim, Maarten Sap, Is this the real life? Is this just fantasy? The Misleading Success of Simulating Social Interactions With LLMs
-
Ben Samuel, James Ryan, Adam J. Summerville, Michael Mateas, Noah Wardrip-Fruin, Bad News: An Experiment in Computationally Assisted Performance
|
|
|
| Thu, Nov 14, 2024 |
Confabulation: What Could LLM Hallucinations Do For Storytelling?
(Module 6)
[slides]
[video]
by Peiqi "Patrick" Sui
|
|
|
|
|
| Mon, Nov 18, 2024 |
|
|
|
|
HW4 (12%): Creating Sabre Problems
|
| Tue, Nov 19, 2024 |
Co-creating Storytelling Machines
(Module 6)
[slides]
by Kory Mathewson
|
|
-
Kory W. Mathewson, Pablo Samuel Castro, Colin Cherry, George Foster, Marc G. Bellemare, Shaping the Narrative Arc: Information-Theoretic Collaborative Dialogue
-
Piotr Mirowski, Juliette Love, Kory Mathewson, Shakir Mohamed, A Robot Walks into a Bar: Can Language Models Serve as Creativity SupportTools for Comedy? An Evaluation of LLMs’ Humour Alignment with Comedians
-
Kory W. Mathewson, et al., Communicative capital: a key resource for human–machine shared agency and collaborative capacity
-
Piotr Mirowski, Kory W. Mathewson, Jaylen Pittman, Richard Evans, Co-writing screenplays and theatre scripts with language models: Evaluation by industry professionals
|
|
|
| Thu, Nov 21, 2024 |
Sai Vallurupalli
(Module 6)
by Sai Vallurupalli
|
|
|
|
|
| Mon, Nov 25, 2024 |
|
|
|
|
Project Milestone 3: Rough Draft
|
| Tue, Nov 26, 2024 |
Novel Interfaces for Creative Text Generation
(Module 6)
[slides]
[video]
by Max Kreminiski
|
|
-
John Joon Young Chung & Max Kreminski, Patchview: LLM-Powered Worldbuilding with Generative Dust and Magnet Visualization
-
Barrett R. Anderson, Jash Hemant Shah, Max Kreminski, Homogenization Effects of Large Language Models on Human Creative Ideation
-
John Joon Young Chung, Melissa Roemmele, Max Kreminski, Toyteller: Toy-Playing with Character Symbols for AI-Powered Visual Storytelling
-
John Joon Young Chung, Wooseok Kim, Kang Min Yoo, Hwaran Lee, Eytan Adar, Minsuk Chang, TaleBrush: Sketching stories with generative pretrained language models
-
Ann Yuan, Andy Coenen, Emily Reif, Daphne Ippolito, Wordcraft: story writing with large language models
-
Melissa Roemmele, Andrew S Gordon, Creative help: A story writing assistant
|
|
|
| Thu, Nov 28, 2024 |
Thanksgiving - No lecture
|
|
|
|
|
| Tue, Dec 3, 2024 |
Final Project In-Class Help
|
|
|
|
|
| Thu, Dec 5, 2024 |
Human-aware AI for Procedural Content Generation
(Module 6)
[slides]
[video]
by Zhiyu Lin (林之雨)
|
|
|
|
|
| Mon, Dec 9, 2024 |
|
|
|
|
HW5 (12%): COMET-ATOMIC Schema
|
| Tue, Dec 10, 2024 |
Module 5 Paper Presentations
(Module 5)
|
|
|
|
|
| Thu, Dec 12, 2024 |
Final Project Presentations, 10:30am - 12:30pm, SHER 150
|
|
|
|
Project Milestone 4: Final Submission
|