"On the Calibration of Generative Question-Answering Models", Catarina Belém (UCI)

[Diogo Pernes]

Dear all,

Next Tuesday, 17 May, Catarina Belém, a Ph.D. candidate at the University of California Irvine (UCI), will discuss the challenges toward the calibration of generative question-answering models at 1 PM (WEST) (zoom link: https://us02web.zoom.us/j/82687125565?pwd=WnhtdlNoQjJuZVpOTzNnbGIzN3ZMUT09).

You can register for this event and keep watch on future seminars below:

https://www.eventbrite.pt/e/on-the-calibration-of-generative-question-answering-models-tickets-334399145847

We look forward to having you join us!

Kind regards,
Diogo Pernes

Priberam Labs
http://labs.priberam.com/

Priberam is hiring!

If you are interested in working with us please consult the available positions at priberam.com/careers.

PRIBERAM SEMINARS   —  Zoom 899 5171 4782

__________________________________________________

Priberam Machine Learning Lunch Seminar
Speaker: Catarina Belém (UCI)
Venue: https://us02web.zoom.us/j/82687125565?pwd=WnhtdlNoQjJuZVpOTzNnbGIzN3ZMUT09

Date: Tuesday, May 17, 2022
Time: 13:00 

Title:

On the calibration of generative question-answering models

Abstract:

Nowadays, generative question-answering models (e.g., UnifiedQA) achieve state-of-the-art performance in various datasets. Despite their remarkable performance, these models still produce wrong answers with high confidence scores. The responsible use of such systems in high-risk applications, like healthcare, requires some guarantees in terms of the correlation of the model scores and the output’s correctness. One potential approach toward these guarantees is calibration. Despite the vast research on calibration for K-ary classification in machine learning, calibration for textual-based systems imposes additional challenges that range from a combinatorial output space to the many definitions of correctness. In this talk, we will discuss the challenges towards the calibration of generative question-answering systems, as well as the current state-of-the-art approaches to address it.

Short Bio:

Catarina Belém is a first-year Ph.D. candidate in Computer Science at the University of California Irvine (UCI). Currently, she is working under the supervision of professors Sameer Singh and Padhraic Smyth on the calibration of generative question-answering models.

Prior to joining UCI, Catarina worked as a research data scientist at the Responsible AI (FATE) group at Feedzai, where she developed a keen interest in fairness, explainability, and evaluation in AI. Catarina holds an integrated master’s degree (BSc+MSc) in Computer Engineering obtained from Instituto Superior Tecnico in 2019. Her main research interests include Machine Learning and Natural Language Processing with a particular focus on Responsible AI.

More info: http://labs.priberam.com/Academia-Partnerships/Seminars.aspx

Eventbrite:

https://www.eventbrite.pt/e/on-the-calibration-of-generative-question-answering-models-tickets-334399145847

[Diogo Pernes]

Dear all,

Today, 17 May, Catarina Belém, a Ph.D. candidate at the University of California Irvine (UCI), will discuss the challenges toward the calibration of generative question-answering models at 1 PM (WEST) (zoom link: https://us02web.zoom.us/j/82687125565?pwd=WnhtdlNoQjJuZVpOTzNnbGIzN3ZMUT09).