Abstract

[Gisela Clemente]

Dear all,

I am writing to inquire about the Abstract. I have been reading the recommendations provided for its writing, and it is advised that it should be structured, including the following sections: objectives, methods, results, and conclusion. Regarding the results, should I present the performance (Challenge score, AUROC, AUPRC, Accuracy, and F-measure) that my team obtained from submitting the last evaluated entry in the unofficial phase, using the model we created but with our own training and testing data? I understand that the complete performance from the validation data is not reported by the Challenge team.

Best regards,
Gisela

[PhysioNet Challenge]

Dear Gisela,

Thanks for the good and timely questions (the end of the unofficial phase is 9 April 2025, and the abstract submission deadline is 15 April 2025, and both dates are rapidly approaching).

As you wrote, we do provide guidance for writing an abstract:
https://physionetchallenges.org/2025/#abstracts

To answer your specific question, please report the Challenge score that you receive on the hidden validation set in your abstract. You can also report the cross-validated Challenge score and other scores on the public training set, but there's not much room in your abstract, and we're not concerned about high scores at this point. (There's also no "local" validation or test set; everyone would have a different "local" set, they would have all of the labels for the set, and they would all be different from the actual validation and test sets.)

To answer the broader question, we're much more interested in your current and planned approaches. Be specific about your methods, including what you're currently doing, what you're planning to do, and why. Can you describe specific challenges presented by this task, and do you have specific ideas about addressing them? We know that it's still early in the Challenge, and we know that your approach will evolve and improve over the coming months, so you want to tell the reviewers about the start that you've made and the good work yet to come in concrete terms.

Relatedly, please continue to provide feedback in the coming weeks to help us to improve the Challenge for the official phase. We have some good changes coming, and we welcome your feedback for more of them.

Best,
Matt

(On behalf of the Challenge team.)

Please post questions and comments in the forum. However, if your question reveals information about your entry, then please email info at physionetchallenge.org. We may post parts of our reply publicly if we feel that all Challengers should benefit from it. We will not answer emails about the Challenge to any other address. This email is maintained by a group. Please do not email us individually.