About Test Data attribute "atricle_url"

41 views
Skip to first unread message

huan liu

unread,
May 25, 2021, 10:37:17 AM5/25/21
to MMSys'21 Grand Challenge on Detecting Cheapfakes
Hi, 
In the public test set, I observed that in "article_url" there are more than 810 snopes, and they are all oocs. Is this also true in hidden test data?

shivangi.tum

unread,
May 25, 2021, 11:14:31 AM5/25/21
to MMSys'21 Grand Challenge on Detecting Cheapfakes
We can't tell you what the hidden test looks like since that would be unfair.
But do ignore the article_url attribute to develop your algorithm, since it is only provided for reference to read the entire story about how/when/where/why the image was circulated and should not be used to make your decision. 
Also, a simple Ctrl+F for keyword snopes in the test file returns 485 matches, not sure how you're getting 810, please double check

Pro Tip: Your method would fail on hidden test set if you'd use article_url while developing your method, coz images can come from a lot of sources. 
Message has been deleted

shivangi.tum

unread,
May 26, 2021, 5:20:40 AM5/26/21
to MMSys'21 Grand Challenge on Detecting Cheapfakes
Hi,
you were given the dataset for research and you're aren't allowed to share dataset snapshots here since this group is publicly accessible so I have to delete your message. 

On Wednesday, May 26, 2021 at 9:53:22 AM UTC+2 huan liu wrote:
Hi,
As you can see in the figure below, after Ctrl+F in the file test_data.json, I found 818 snopes
WeChatffb5b72268148188b83b0d1949faeabc.png

Reply all
Reply to author
Forward
0 new messages