Project Milestone 3: Halfway Point
Welcome to the halfway point of your project!
For this milestone, you are showing that you’ve made some progress in your project. In particular you should:
- Update your paper based on the feedback the class staff left for you from the last milestone.
- Show any progress you have made, including preliminary results, methods, etc.
Document
Your document should include the following sections:
Title & Author Names: What are you calling your project? These are not graded but still important! (No section header for these bits)
- Project Description: This is the “what” and the “why” of your project.
- The “what”: Explain the main idea of your project and what you are trying to accomplish. It’s okay if these have changed since the project proposal.
- The “why”: If it’s a research project, what’s your research question (i.e., what are you trying to prove with this work)? If it’s an artifact that you’re creating, why are you creating it?
- Related Work: What previous research will you be using, building off of, or being inspired by? Tell a short “story” using what you learned from the papers.
- Methods: What are the steps to accomplish your project? This should describe both the steps you’ve done so far (data collection and system planning) and the ones you plan to do. This doesn’t have to be the final methods that you end up using, but writing out a plan out will help you figure out some details you might not have thought of otherwise!
- Data: Describe what your data is in detail. For example, what data have you decided to use? Where did you get it from, what does it look like, and what are some potential problems with it? If you are using few/zero shot prompting, what are some of your initial prompts? How have they been working?
- Evaluation Plan: What will you be using to evaluate your research question or that the components of your NLP system are working well?
- These can be things like accuracy, diversity metrics, perplexity, BLEU/ROUGE scores, success rate, human evaluation scores, etc. depending on your project.
- Preliminary Results: Describe any results you have so far. These can include results for intermediate steps that build toward your main project goal and don’t have to use your final evaluation metrics. If you haven’t gotten anything working successfully yet, negative results or plans for experiments to run are great to report too! This section should include tables, plots, and example system outputs where applicable.
- Attribution: For each of your team mates, write a couple sentences describing their main contributions to the project so far and what each person plans to do for the rest of the project.
What to Submit
Submit the following to Google Classroom:
group[#]-milestone3.pdf
which contains your updated project paper. To make grading easier, your proposal should include section headers corresponding to each of the bulleted points as well. While not required, we highly recommend that you use LaTeX and a conference template (ACL’s template). You will be required to use a conference template for the next milestone.
Grading
- Project Description: Make sure you do not only include a description of the project, but also a reason why this project is important (i.e. motivation) (3pts)
- Related Work: Do not just summarize previous work, but relate it to your project. (3pt)
- Methods: What have you completed up to now? What do you plan on doing? Write down a concrete plan of action. (3pt)
- Data: Do not just list the datasets, but describe them, and explain how you will use them. (3pt)
- Evaluation Plan: What evaluation metrics you chose and why? Are they applicable to your task? (3pt)
- Preliminary Results: What have you noticed so far when making/running your system? How are they performing? (3pt)
- Attribution: Do not forget to note which team member will do what. (1pt)