Call For Submission: AMIA AI Evaluation Showcase 2023 (Stage I Deadline: Dec 9, 2022)
Sabrina Hsueh
American Medical Informatics Association (AMIA) Artificial Intelligence Evaluation Showcase 2023
Stage I Submission is now open: Submit Here. (Deadline: Dec 9, 2022)
Website: https://amia.org/education-events/amia-2023-artificial-intelligence-evaluation-showcase
Artificial Intelligence (AI) is moving and shaping health and healthcare at lightning speed. The benefits of AI are multifold, but informatics research and practice are needed for the systematic and comprehensive evaluation of AI tools. AI in health and healthcare must be safely and effectively deployed in healthcare settings. Such evaluation includes technical performance studies, usability and workflow, and health impact.
Regulators, researchers, and clinical practitioners have all been exploring how to best evaluate the different phases of the health AI deployment lifecycle. In the AMIA AI Evaluation Showcase Series, we aim to select and present the current use cases in the field and form a community to help build consensus around the best practice. The formed community and the curated best practice examples are expected to help strengthen the industrial standard understanding and setting.
You can submit the work as a poster, podium abstract, or full paper. Quality submission will be invited to publish in a forthcoming book or an informatics journal (to be announced).
Stage I Submission is expected to have a system description results from a study of AI/ML model performance, and an outline of the methods of the full evaluation plan (for Stage II and III).
*For model performance evaluation, the teams are encouraged to report on the evaluation metrics that would be useful to assess not only the model’s discrimination ability but also its reliability in different settings. We would encourage the teams to also report on their bias detection and mitigation strategy.
Please also visit the AI Showcase 2023 website for more information and the recording of the informational webinar.
Three Stages
The American Medical Informatics Association (AMIA) AI Evaluation Showcase Series consists of three stages:
Stage I - Technical Performance Studies
Stage II - Usability and Workflow Studies
Stage III - Health Impact Studies
Submissions will be presented at three AMIA meetings:
AMIA 2023 Annual Symposium
Call for Submission
The proposal process for Stage 1 is now open. Submission deadline: Dec 9, 2022.
Stage I presentation will be hosted during the AMIA 2023 Informatics Summit
==============================================
Scientific Program Committee (SPC) Co-Chair
Li Zhou, MD, PhD, FACMI, FIAHSI, FAMIA
Pei-Yun (Sabrina) Hsueh, PhD, FAMIA
Advisor Board
Gretchen Purcell Jackson, MD, PhD, FACS, FACMI, FAMIA
Genevieve B. Melton, MD, PhD, FACMI, FACS, FASCRS
Luke Rasmussen, MS
Scott Nelson, PharmD, MS, FAMIA, ACHIP
Deepti Pandita, MD, FACP, FAMIA
Yuan Luo, PhD, FAMIA
Kate Fultz Hollis, MS, MBI, FAMIA