Dataset release and Updating dates

[Sefika Efeoglu]

Dear,

We are working on your challenge and aim to address it. However, the dataset has not been released yet.

I would like to ask if you will also change the other dates, such as the open and stop submission dates on Codalab.

Thanks in advance, 

Best regards.

[Debayan Banerjee]

Hi Sefika,

Apologies for the delay. We will release the dataset over the weekend. We will accordingly extend the submission deadlines. 

--
You received this message because you are subscribed to the Google Groups "scholarly-qald-2024" group.
To unsubscribe from this group and stop receiving emails from it, send an email to scholarly-qald-...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/scholarly-qald-2024/5c865870-c2e4-479c-add0-c8fcd7ce0c2cn%40googlegroups.com.

--

Regards,

Debayan Banerjee

[Debayan Banerjee]

Hi folks,

we have released the dataset and the challenge is now live at https://codalab.lisn.upsaclay.fr/competitions/19140. Please let me know if you face any problems.

--

Regards,

Debayan Banerjee

[Sefika Efeoglu]

Hi, 

The test dataset consists of citation-related questions and answers. There is no information about the number of citations, the h-index, and the i10-index on the knowledge graph, but it includes the Google Scholar citation page. Therefore, our answers might change depending on when we apply web scraping. Will you update the test dataset later? 

Thanks in advance, 

Best.

[Tilahun A]

Hi, 

Thank you for the message!

"Information about the number of citations, the h-index, the i10-index,..." is obtained from the SemOpenAlex KG. No need to scrap the web. The answer will be different. 

For accessing the SemOpenALex triples you can query https://semoa.skynet.coypu.org/sparql.

I hope this answers your question. If not please let us know.

Sincerely,

Tilahun

[Debayan Banerjee]

Hi Sefika,

you can see the attached image (sorry for poor resolution) for some assistance. This shows the relations present in the different sources used to create the dataset.

To view this discussion on the web visit https://groups.google.com/d/msgid/scholarly-qald-2024/edaf79b5-c6ba-46aa-936e-18cfd91ae382n%40googlegroups.com.

--

Regards,

Debayan Banerjee

[Şefika EFEOĞLU]

Hi Debayan and Tilahun,

Thanks for the information about the data resources! This will help us make progress on the project.

Best regards.

To view this discussion on the web visit https://groups.google.com/d/msgid/scholarly-qald-2024/CAMPgBOc4ZzuyThC44bQ0J5yL43p3XULotzvtQemBYF8d-ODy3A%40mail.gmail.com.

[Sefika Efeoglu]

Hi, 

The DBLP endpoint is not available since yesterday. Could you have a look at this?

We could not continue our work.

Thanks for your help.

Best regards.

[Sefika Efeoglu]

Thanks for restarting the service again, Debayan and Tilahun.  

Best,

[Sefika Efeoglu]

Hello again, 

SemOpenAlex sparql service is not available now.

Could you have a look at this?

Thanks in advance.

Best regards.

[Debayan Banerjee]

Hi Sefika,

sorry about that. Please check again. 

To view this discussion on the web visit https://groups.google.com/d/msgid/scholarly-qald-2024/523dccbe-26df-4d14-8c50-547a98036ed5n%40googlegroups.com.

--

Regards,

Debayan Banerjee

[Sefika Efeoglu]

Thanks. It is available now.

Best regards.

[Sefika Efeoglu]

Dear, 

Could you provide me with more details about the data format of test_prediction in the submission? 

Right now, my data format:

{"id": d086b012-ca96-402f-856d-afce74fce8fc , "answer": "...."}

{"id": "d3aa86e9-f6f8-47a4-821b-6bf35d68415d" , "answer": "...."}

Best regards

[Sefika Efeoglu]

I saw the format on codalab.

Best regards

[Sefika Efeoglu]

Hello again, 

We would like to submit more than one results, but the codalab sending error message.

Could you help us with this?

Thanks.

Best regards.