First Call for NLP for Positive Impact Workshop

25 views
Skip to first unread message

textdetox-clef2024

unread,
May 27, 2024, 7:43:51 AMMay 27
to textdetox-clef2024
Dear all,

We are wishing you all the best to finalize your reports for CLEF-2024!

Meanwhile, I believe, you might be interested to continue explore more possibilities to support NLP for Social Good topic.

We are delighted to invite you for submission to the Third Workshop on NLP for Positive Impact!

Workshop website:  https://sites.google.com/view/nlp4positiveimpact 

Submission method: ACL Rolling Review (ARR)

Important Dates 

We align our paper acceptance with the ARR cycles:


Submission deadline: June ARR, i.e., June 15, 2024, 11:59pm AoE


Commitment deadline to the Workshop: August 20, 2024


Notification of Acceptance: September 20, 2024


Camera-Ready Papers Due: October 3, 2024

Workshop Date: co-located with EMNLP 2024 in November, Miami (exact date to be announced)


All deadlines are 11:59 PM (Anywhere on Earth)

Summary 

The widespread and indispensable use of language-oriented AI systems presents new opportunities to have a positive social impact. NLP technologies are starting to mature to the point where they could have an even broader impact, supporting the UN sustainability goals by helping to address big problems such as poverty, hunger, healthcare, education, inequality, COVID-19 and climate change. 

Our workshop aims to promote innovative NLP research that will positively impact society, focusing on responsible methods and new applications. We will encourage submissions from areas including (but not limited to)


  • Work that grounds the impact of NLP: Beyond developing a better-performing NLP model, can we make a step further to connect the model to actual social impact? Example directions include: case studies of real-world deployments; or improving the deployment and maintenance of NLP models in practice.

  • In addition to commonly recognized NLP for social good areas such as NLP for healthcare, mental well-being, and many others, we also call for work on neglected areas such as NLP for poverty, hunger, energy, climate change, among others.
     

  • We also highly value work that builds on interdisciplinary expertise, and encourages submissions of case studies or worked examples that seek to expand the social impact of NLP through collaboration with other fields (e.g., philanthropy, social science, political science, economics, HCI). 


Special theme: This year, we would like to encourage submission providing solutions or concepts to address digital violence. Digital violence encompasses various forms of violence that utilize digital tools and media, such as cell phones, apps, internet applications, and emails, and occurs within digital spaces like online portals and social platforms. We aim to explore how modern NLP and AI technologies can contribute to enhancing safety in digital environments. At the workshop, you will have an opportunity to connect and share your results with NGO representatives from this field!


Submission types:

Thus, we would appreciate to see various types of works on this (but not only) topic like:

  • automatic identification of various social needs, their corresponding sizes and demographics of people affected;

  • position papers to propose promising new tasks or directions that the field should pursue;

  • literature review of a subfield; 

  • philosophical discussions of what how positive impact can be achieved with NLP methods; 

  • approaches to interdisciplinary collaboration; 

  • user study designs, user surveys; 

  • ethical considerations, and other related topics.

 

Note that we want submissions to our workshop to have some distinctive features of social good implications, beyond a general paper on NLP. We will require each submission to discuss the ethical and societal implications of their work, and encourage a discussion of what "positive impact" means in the work.  


Papers Format

Both long and short paper submissions should follow all of the ARR submission requirements, including:



Organizers 


Zhijing Jin (Max Planck Institute & ETH Zurich)


Daryna Dementieva (Technical University of Munich)


Steven Wilson (Oakland University)


Oana Ignat (University of Michigan)

Jieyu Zhao (University of Maryland, College Park)


Joel Tetreault (Dataminr, Inc.)


Rada Michaela (University of Michigan)


Contact Email



All positive regards,
Daryna Dementieva

刀下留人

unread,
May 29, 2024, 9:02:44 AMMay 29
to textdetox-clef2024
Dear Organizer.
     Thank you for your invitation; we would love to participate in the discussion on addressing digital violence in society. In the process of writing the paper, we would like some questions, and we hope you can give us some guidance.
    1) We are trying to explore some new approaches. However, we need to learn how to evaluate and compare our results with other results. We are curious to know if the evaluation platform can support the submission of new results and give the evaluation results. We are willing to pay the evaluation fee if it is required.
   2) In addition, can the detailed results of the evaluation, e.g., the result files of all the participating teams, and the results of the evaluation metrics (e.g., whether it is poisonous, whether it preserves the original meaning, whether it conforms to the grammatical norms, etc.) of each sentence in the result files be made public? These data would be very beneficial to the research of text detoxification. It will help the participating teams to learn from each other, learn from each other, and compare each other.
We look forward to your guidance.

Best,
Jiangao Peng (nickname: cake, user: d1n910)

Foshan University
School of Electronic Information Engineering

textdetox-clef2024 <textdetox...@googlegroups.com> 于2024年5月27日周一 19:43写道:
--
You received this message because you are subscribed to the Google Groups "textdetox-clef2024" group.
To unsubscribe from this group and stop receiving emails from it, send an email to textdetox-clef2...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/textdetox-clef2024/477d015b-5311-4f51-ac32-a7784c268e43n%40googlegroups.com.

textdetox-clef2024

unread,
May 29, 2024, 9:09:05 AMMay 29
to textdetox-clef2024
Dear Jiangao,

1) In terms of automatic evaluation, the absolutely same leaderboard is still fully open at Codalab:
so you still can continue the automatic evaluation of your approaches.

Moreover, all our metrics are opensourced:
and for the dev part of our dataset, human references are also available already for the public usage:
so, now you can calculate ChrF1 score for the dev part even by yourself.

In terms of manual evaluation of the test part, of course, for us it is quite challenging to run such separate requests. However, with our task report, we will opensource all the tasks instructions.

2) We will try to think about how we can also opensource all the detailed metrics per each language. In our task report, for sure, we will have all 9 separate table per language with all 4 metrics -- STA, SIM, Chrf1, and J. 

Best,
Daryna

среда, 29 мая 2024 г. в 15:02:44 UTC+2, wyd1...@gmail.com:

刀下留人

unread,
May 30, 2024, 12:03:43 PMMay 30
to textdetox-clef2024
Dear Dr. Daryna Dementieva,
Thank you for your prompt and detailed response! I have read through many of your articles and we have had some communication before. I believe we have reached a consensus that machine evaluation cannot replace human evaluation at present. Our team is able to run the code for machine evaluation, and we are very grateful for your work. Human evaluation is an important means to check whether our model has truly improved. We are eagerly looking forward to your task report. I wish you all the best in your work. We will also continue to strive. Hope we can jointly utilize NLP to bring more positive impacts to our society.
Best,
Jiangao Peng



textdetox-clef2024 <textdetox...@googlegroups.com> 于2024年5月29日周三 21:09写道:
Reply all
Reply to author
Forward
0 new messages