PhysioNet Challenge 2025: Scores released
46 views
Skip to first unread message
PhysioNet Challenge
Sep 24, 2025, 4:55:25 PM (2 days ago) Sep 24
to physionet-challenges
Dear Challengers,
Thank you for joining us for a truly interesting and relevant Challenge this year. We were happy to see so many of you this year in São Paulo, Brazil, and we hope to see even more of you next year in Madrid, Spain.
This announcement has important information about the scores on your scores and papers (which you need to implement to be ranked). Please read it carefully.
Scores
Teams that satisfied the Challenge eligibility criteria were ranked by the Challenge scoring metric on the test set using the mean score across the three data sources in the test set; these ranks determined the winners. Please report the scores and ranks from this table in your papers, and please report other scores as space allows to contextualize the performance of your entries.
Please contact us by Monday, 29 September 2025 at noon EDT if you believe that your team is not ranked but should be ranked (or is ranked but should not be ranked), or if you believe that any of the information about your team (except for your team members and title, which we will update from the conference program) is incorrect. We will update the results afterwards. Please note that your team may move from an official entry to an unofficial entry if you do not adhere to the instructions below on finalizing and uploading your papers by the deadline.
Final papers and final paper deadlines
Please update your four-page conference papers to include the test scores, update your discussion and conclusions, and address any issues with your preprint. Please upload your updated papers on Softconf by Thursday, 2 October 2025 by 23:59 (your local time):
https://www.softconf.com/n/cinc2025/
You may have noticed that CinC has a final paper upload deadline of Friday, 10 October 2025. The Challenge has an earlier deadline to give us time to review your papers and to share feedback with you, and to give you time to upload an updated version of your paper that addresses this feedback before the CinC deadline. Most of our feedback simply addresses items on this checklist, so if you satisfy all of the issues on the checklist, then we will have minimal feedback. However, many, if not most, papers need corrections before they can be accepted for publication, so please check this checklist carefully and submit your paper early:
https://physionetchallenges.org/2025/papers/cinc_paper_checklist.pdf
If you did not receive a score on the above result page, please be clear about that in your paper. Articles that refer to a “local” score as if it were the final metric by which to be judged will not be eligible for publication.
We review each paper and frequently need to ask teams to make corrections that we’ve already requested! Please read the paper template for instructions, including the following items:
Focus Issue and Another Shot at the Hidden Data
We are working to announce a focus issue for the Challenge that will give you another shot at the test set for approaches that build on the many lessons learned from the conference – please stay tuned!
Parting Thoughts
Congratulations to the winners, thank you all for participating in one of the most interesting Challenges to-date, and we hope that you will participate again in the next Challenge!
Best,
The Challenge Team
https://PhysioNetChallenges.org/
https://PhysioNet.org/
Please post questions and comments in the forum. However, if your question reveals information about your entry, then please email challenge at physionet.org. We may post parts of our reply publicly if we feel that all Challengers should benefit from it. We will not answer emails about the Challenge to any other address. This email is maintained by a group. Please do not email us individually.
Thank you for joining us for a truly interesting and relevant Challenge this year. We were happy to see so many of you this year in São Paulo, Brazil, and we hope to see even more of you next year in Madrid, Spain.
This announcement has important information about the scores on your scores and papers (which you need to implement to be ranked). Please read it carefully.
Scores
We have posted preliminary scores and rankings on the hidden data:
Congratulations to the winning teams!
Teams that satisfied the Challenge eligibility criteria were ranked by the Challenge scoring metric on the test set using the mean score across the three data sources in the test set; these ranks determined the winners. Please report the scores and ranks from this table in your papers, and please report other scores as space allows to contextualize the performance of your entries.
Please contact us by Monday, 29 September 2025 at noon EDT if you believe that your team is not ranked but should be ranked (or is ranked but should not be ranked), or if you believe that any of the information about your team (except for your team members and title, which we will update from the conference program) is incorrect. We will update the results afterwards. Please note that your team may move from an official entry to an unofficial entry if you do not adhere to the instructions below on finalizing and uploading your papers by the deadline.
Final papers and final paper deadlines
Please update your four-page conference papers to include the test scores, update your discussion and conclusions, and address any issues with your preprint. Please upload your updated papers on Softconf by Thursday, 2 October 2025 by 23:59 (your local time):
https://www.softconf.com/n/cinc2025/
You may have noticed that CinC has a final paper upload deadline of Friday, 10 October 2025. The Challenge has an earlier deadline to give us time to review your papers and to share feedback with you, and to give you time to upload an updated version of your paper that addresses this feedback before the CinC deadline. Most of our feedback simply addresses items on this checklist, so if you satisfy all of the issues on the checklist, then we will have minimal feedback. However, many, if not most, papers need corrections before they can be accepted for publication, so please check this checklist carefully and submit your paper early:
https://physionetchallenges.org/2025/papers/cinc_paper_checklist.pdf
If you did not receive a score on the above result page, please be clear about that in your paper. Articles that refer to a “local” score as if it were the final metric by which to be judged will not be eligible for publication.
We review each paper and frequently need to ask teams to make corrections that we’ve already requested! Please read the paper template for instructions, including the following items:
- Cite the Challenge description and data correctly using the references on this page: https://physionetchallenges.org/2025/papers/
- We ask you to cite these articles so that we can measure the impact of the Challenge and report this to those that sponsor us. If you fail to cite this reference article, our impact is under-reported and funding for future Challenges are much less likely. We appreciate your help with this. It also prevents authors from incorrectly describing the data (a problem we often see).
- Do not cite the Challenge websites, and avoid citing websites in general.
- Format your other references correctly. Check the PDF to be sure!
- Present your results in your abstract and results table in the same way we did in the CinC template for consistency with other teams. This makes comparisons easier and ensures you don’t miss key information.
- Be clear about your data set. Include your scores and rankings on the hidden test set – you don't strictly need to provide training or cross validation scores, but if you do, make sure you identify them next to the real hidden data so there’s no misinterpretation. If you did not receive scores on the test set, then say so. Do not describe your “local test set”, which is just confusing. The only test set in the context of the Challenge is the one on which we ran your final code submission.
- Do not make misleading or inaccurate statements about your results. In particular, do not claim an inaccurate ranking, or report inaccurate statistics. If your team did not meet the eligibility criteria, the code is not ranked, and you should just say you were not ranked. Do not say where you ‘would’ have been, had you been ranked. This is misleading and confusing.
Focus Issue and Another Shot at the Hidden Data
We are working to announce a focus issue for the Challenge that will give you another shot at the test set for approaches that build on the many lessons learned from the conference – please stay tuned!
Parting Thoughts
Congratulations to the winners, thank you all for participating in one of the most interesting Challenges to-date, and we hope that you will participate again in the next Challenge!
Best,
The Challenge Team
https://PhysioNetChallenges.org/
https://PhysioNet.org/
---
Reply all
Reply to author
Forward
0 new messages