Skip to content

ACL 2025

Materials for the ACL 2025 Ethics Tutorial: Navigating Ethical Challenges in NLP: Hands-on strategies for students and researchers.

This repository archives the materials in a reusable form, related materials (ACL Stakeholder Survey) and also links to other contemporary resources. If you see things missing or needing maintenance, please file an issue or a pull request.

Authors:

Additional Contributors:

How to run your own tutorial or lesson?

We recommend using our base materials here and adapting them to your setting. Minimally, you need to create your own shortlinks and URL codes to your version of the materials before running, as the archived materials reference our ACL 2025 or EACL 2023 instances.

For our tutorial setting in an audience participatory style and approximately 20+ participants and 4 organisers, it was important to:

  • Restrict the number of groups so that each group can present within the session's time limit;

  • Designate a particular organiser to facilitate virtual participants;

  • Have live edit access to online documents, to allow participant leads to note-take and present.

Other formats might consider:

  • Lecture only: use and adapt the lecture materials from the first and seventh segments of the tutorial.

  • Experiential only: use and adapt Segments 2–6, which asks participants to read and critique abstracts that bring up common ethical issues in our community.

  • Student (Homework) Assignment: curate sources from the accompanying Ethics Reading List that the committee maintains, and ask participants to read and write their reflections on.

If you run a course, tutorial or other session based on these materials, we'd love to hear from you! Please get in contact with us, and we may also (with your permission) list your course or materials in the Resource segment. Also please do cite our tutorial abstract as a means of acknowledging the helpfulness of the materials. Thank you!

@inproceedings{benotti-etal-2025-navigating,
    TO BE UPDATED
}

Table of Contents

(these are internal links to the sections below)

Introduction

In 2024, the ACL Ethics Committee (AEC) decided to propose to run a tutorial on ethics and its impact on ethics in both authoring and reviewing aspects for the community of CL/NLP scholars and practitioners. As part of this process, the AEC Committee put together the proposal file and submitted it to the joint call for tutorial proposals.

The tutorial was accepted to run at ACL 2025 (Vienna, Austria, 27 July to 1 August) on Sundey, 27 July from 14:00 to 17:30hs in Hall M at the venue. The tutorial will be hybrid and we will have online moderators for the virtual participants.

The tutorial and its materials will be presented in English. It will be structured as per the proposal, in seven segments, each approximately 30 minutes long. It is participatory in nature, requiring the audience to work in groups on invented problematic abstracts written by the proposers that represent common ethical issues experienced by ethics review chairs. There will be a good facilitator-to-group ratio, to ensure all of the participants have a chance to reflect, contribute and be heard, and for the facilitators to keep the session on track.

Segment Topic Led By
1. Introduction and Foundations for Ethics Presenters
2. Case Studies: Problematic Ethical Research — First reading Participants
3. Structured Interaction / Dialogue Presenters,Participants
4. Case studies — Second reading (Rotation) Participants
5. Group Presentations Group Leads
6. Summary and Common Issues Presenters
7. Discussing and Troubleshooting Ethics and Further Resources Presenters

We conducted the tutorial in an active classroom style, where participants were self-organized into small groups (in our instance, 2 groups of about 10 participants each), electing leads for subsequent group presentation and worked through the exercises to record their reactions to the materials and identify the issues and conducive outcomes.

Tutorial Slides

TO BE UPDATED:

After introducing the organisers and the format and resources of the tutorial, the first segment featured two lecture segments, both focused on introductory and foundational material on ethics.

TO BE UPDATED Google Slides permalink for EACL 2023 tutorial: http://bit.ly/eacl23-ethics-slides

Segment 1A (Slides 6-39) covers the definition and scope of ethics; its origins; virtue, deontological and utilitarian forms of ethics; experiments and policy reactions to ethical violation (Nuremburg Trials and Code, Belmont Report). This segment was presented by Karën Fort.

Segment 1B (Slides 40-70) focuses on appropriate use and application, biases and evaluation, covering hypothetical and real instances of ethical problems in recent research (Chicken dilemma, IQ prediction, sexual orientation prediction -- the "Gaydar" paper, and how AI and NLP technology influences people both directly and indirectly. This segment was presented by Yulia Tsvetkov.

Segment 7A (Slides 86-99) reprised work from Benotti and Blackburn (2022) Ethical Consideration Sections in Natural Language Processing Papers, which examined such written ECS in NLP papers to analyze the issues covered in terms of 1) research benefits, 2) potential harms, and 3) vulnerable groups affected. It covers the differences between geographical region's reporting of such issues. This segment was presented by Luciana Benotti.

The remainder of the slides (Segment 7B) are framing materials to help introduce the tutorial, and set up the abstract critique exercise. This segment was presented by Min-Yen Kan and all presenters.

Activity

The hands-on activity in the tutorial starts with a 5-minute introduction of the activity and a short review of the individual abstracts, which are also described in the slides. Participants were grouped into random groups, which had to elect a scribe and a presenter. The scribe serves as a secretariat for typing in the notes from their group; and the presenter is delegated as the person in the group to present the findings to the entire tutorial audience. Each group was assigned one of the abstracts to read and critique.

The critique of the abstracts is run in two phases. In the first phase, groups discuss first to prepare a single slide for silent sharing with other groups (Segment 2). In this second phase (Segment 4), the groups could enlarge their thinking by reflecting on either additional abstracts, the single shared slide from each group, or both.

After both phases were finished, each group presented elements of their findings, with the faciltators structuring and probing for issues and clarity on different aspects.

Materials

TO BE UPDATED:

The activity was run using a scribe document where the organizers communicated information (the abstracts below and the instructions) and solicited the audience's feedback on the overall session.

However, for the group activities, we used an editable online presentation deck such that each group could create 1-3 slides (1 slide max in the first phease) in their respective subgroups.

We provide 6 abstracts below with a gloss of their topical concern. In our EACL 2023 instance, we ran only the first three, due to the smaller number of participants.

  1. Facial Recognition
  2. Social Media Dataset Collection
  3. Cost-prohibitive Language Models
  4. Language Resource Collection from Protected Groups
  5. Multilingual Sentiment and Crowdsourced Annotation
  6. Large language model use in healthcare

Resources

The tutorial (Slide 109) also concluded with a list of faculty courses (by our presenters, certainly there are more out there) that have also taught similar topics. For expediency we list them directly here:

  • (In French and English) Karën https://members.loria.fr/KFort/teaching/nancy-tours-etc/
  • (In English) Yulia https://courses.cs.washington.edu/courses/cse582/23sp/
  • (In Spanish) Benotti and Alonso Alemany. Ética Práctica para Ciencia de Datos. https://sites.google.com/view/etica-practica-cd/

All materials in this repo are CC-BY-4.0

Our presenters would also like to thank the entire ACL Ethics Committee (AEC) for their support and endorsement of the process.