MA-INF 4115: INTRODUCTION TO NATURAL LANGUAGE PROCESSING

Winter Semester 2023 – 2024

Will be uploaded on eCampus.

• Credits:
  • Assignment 1 (10%): Word Operations
  • Assignment 2 (20%): Text Classification (Scikit-Learn)
  • Assignment 3 (20%): Word Vectors (SpaCy)
  • Assignment 4 (30%): Fine-tuning with LLMs (Hugging Face)
  • Assignment 5 (20%): Hidden Markov Model

• Deadlines: All assignments are due on Tuesday before the exercise class at 11:59 PM. All deadlines are listed in the schedule.
• Submission: Assignments should be submitted via eCampus. Further instructions are given in each assignment file. Please do not email us your assignments.
• Collaboration: Working on assignments in a group of 2 students is allowed. please name your file with both student names. File name: <FirstName_LastName>
• Grade/ Feedback: You will receive your graded assignment every week on eCampus.
  **NOTE:** You need to achieve at least 50% of the points to be allowed to take the exam.

• Project Types: Students choose one of the following project types
  • Default Project: Students choose one of the datasets we listed here (New “INTERESTING” datasets are welcome! - but you need to contact Vahid beforehand.), formulate a real-world problem (PF), and try to solve it (PS) by training a model or fine-tuning a pre-trained LLM.
    Submission: [Code + Report for final results]
  • Resource Creation Project: To answer this question: How to generate an NLP dataset from any internet source? Students design a pipeline to build and annotate a dataset. They should define at least one NLP downstream task for their dataset.
    Submission: [Crawling script + Dataset + Report for final results]
  • Robustness and Reproducibility Project: To measure the ability of a model or an NLP system to perform consistently and accurately across a wide range of inputs and conditions, students collect and annotate an evaluation set in a new domain with 100 – 200 instances and test at least two existing models (e.g., from GitHub) with the new evaluation set.
    Submission: [Crawling script + Code + Evaluation set + Report for final results]

• Project components:
  • Problem Formulation (PF) (10%)
    • [Overleaf Template for Default Project]
    • [Overleaf Template for Resource Creation Project]
    • [Overleaf Template for Robustness and Reproducibility Project]
  • Problem Solving (PS) (15%)
  • Project Poster (PP) (5%):
    • [Guideline for Poster]
  • Project Report (PR) (10%):
    • [Guideline for Default Project]
    • [Guideline for Resource Creation Project]
    • [Guideline for Robustness and Reproducibility Project]

• Submission: Depending on which project type the students choose, they submit each project component on eCampus in the following format:
  • PF: A PDF file with this name: Team_<Team number>.pdf
  • PP: A PDF file with this name: Team_<Team number>.pdf
  • PS + PR: A ZIP file containing all the necessary files with this name: Team_<Team number>.zip

• Deadlines: All deadlines for PF, PP, and PS + PR are listed in the schedule.
• Mentors: Every team has a mentor, who gives feedback and advice during the project.
• Computing resources:
  • CS Faculty: You can add your Student ID to this list.GSG will provide you with additional computing resources on behalf of the CAISA lab.
  • Saturn Cloud: You can use 150 hours a month free of 64GB RAM and GPU instances. Check this out.
  • Google Colaboratory: Colab is a hosted Jupyter Notebook service that provides free access to computing resources, including GPUs and TPUs. Check this out.
• Using external resources: You can use any machine learning or deep learning framework you like (Scikit-learn, PyTorch, TensorFlow, etc.). You may use any existing code, libraries, etc., and consult papers, books, online references, etc. for your project. However, you must cite your sources in your final project report.

• Team:
  • Team size: Students should do final projects in teams of 3 up to 5 people. Larger teams are expected to do correspondingly larger projects.
  • Building a team: You can either find your teammates on your own or ask us to find teammates for you. You may join the CS Master Bonn Discord Server.
  • Submission:
    • Please send us the list of your team members via itnlp.uni.bonn(at)gmail.com in the following format:
      Subject: ITNLP - WS2023 - <Matr. Nr.>
      Team Speaker:   <Name>, <Matr. Nr.>, <Mail Addr.>
      Team Members: <Name>, <Matr. Nr.>, <Mail Addr.>
      <Name>, <Matr. Nr.>, <Mail Addr.>
       
    • In case, you need a teammate, please mail us at itnlp.uni.bonn(at)gmail.com.
      Subject: ITNLP - WS2023 - Looking for a team
      <Name>, <Matr. Nr.>, <Mail Addr.>

• Deadline: is listed in the schedule.
• Contribution: In the final report we ask for a statement of what each team member contributed to the project. Team members will typically get the same grade, but we may differentiate in extreme cases of unequal contribution. You can contact us in confidence in the event of unequal contribution.

• Exam dates: will be announced as soon as we receive the rooms and dates from the examination office.
• Allowed material: Calculator is permitted.

• 3 + 1 SWS
• Master in Media Informatics: 6 ECTS credits
• Master in computer science at University of Bonn: MA-INF 4115 6 CP
• Students must register for the exam on POS/BASIS.