Re: Google Scholar Problems

71 views
Skip to first unread message

Ian Goodfellow

unread,
Jun 22, 2018, 12:25:39 PM6/22/18
to Yash Sharma, cleverhans dev
Since the CleverHans 2.1 tech report isn't getting indexed by Google Scholar, I wonder if it might make sense to update the arxiv paper again and change the title more.

Currently the title is "cleverhans v2.1.0: an adversarial machine learning library".
I wonder if we should change this to something like "Technical Report on the CleverHans v2.1.0 Adversarial Example Library." The larger change may trigger a re-indexing.

Is everyone OK with that? Yash, if no one objects or suggests a better title, go ahead and upload the change in a day or two.

On Sun, Jun 10, 2018 at 2:34 PM Yash Sharma <yshar...@gmail.com> wrote:
Hi Ian, 

Sorry to bother, but can nothing further really be done? Why do you suspect Cleverhans 2.1 update wasn't detected? Cleverhans 2.0 was, and was accredited to the authors (Carlini wasn't an original author, but was an author on 2.0, and the crawler attributed him credit on Google Scholar). 

Sorry, this is just a bit frustrating, particularly as I drafted the update (7 pgs -> 12 pgs, due to the addition of descriptions for all implemented attacks). I understand that expecting the crawler to find all citations of a work is unreasonable, but at least finding all works I felt was reasonable. 

Hope something can be done. 

Regards, 

Yash Sharma

On Tue, Jun 5, 2018 at 7:35 PM, Yash Sharma <yshar...@gmail.com> wrote:
Thanks. 

On Tue, Jun 5, 2018 at 7:31 PM, Ian Goodfellow <goodfel...@gmail.com> wrote:
I filed a bug report internally but I can't do anything to edit scholar results directly

On Tue, Jun 5, 2018 at 3:52 PM, Yash Sharma <yshar...@gmail.com> wrote:
Hi Ian, 

Cleverhans 2.1 was submitted on May 17th, but it still hasn't been indexed by Google Scholar. Can anything be done about this? Anyone that can be contacted?

Regards, 

Yash Sharma



Nicholas Carlini

unread,
Jun 22, 2018, 12:28:18 PM6/22/18
to Ian Goodfellow, Yash Sharma, cleverhans dev
I'm all in favor of google re-indexing the arxiv paper, but is this
a sustainable practice? What do we do when it's 2.2? (or 3.0?)
> --
> You received this message because you are subscribed to the Google Groups "cleverhans dev" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to cleverhans-de...@googlegroups.com.
> To post to this group, send email to cleverh...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/cleverhans-dev/CAPXn81qqZ9Qenf3TJMEU7anC%3Dra0J2LnMsZKMqnovpaBA9gt1g%40mail.gmail.com.
> For more options, visit https://groups.google.com/d/optout.

Ian Goodfellow

unread,
Jun 22, 2018, 1:01:19 PM6/22/18
to Nicholas Carlini, Yash Sharma, cleverhans dev
In the long run, hopefully we can get the Google Scholar indexing working better. This is just a short term solution to get this version indexed sooner.
--
Sent from Gmail Mobile

Nicholas Carlini

unread,
Jun 22, 2018, 1:59:50 PM6/22/18
to Ian Goodfellow, Yash Sharma, cleverhans dev
Okay. I would be wary of doing this without a plan for how to
move forwards -- is there some action we can take to make
google scholar index the paper better in the future? Or do
we just have to hope it gets fixed?

Nicolas Papernot

unread,
Jun 22, 2018, 2:48:10 PM6/22/18
to Nicholas Carlini, Ian Goodfellow, Yash Sharma, cleverhans dev
The index can take several weeks to update so I wouldn't be worried about it, it should eventually fix itself.

Yash Sharma

unread,
Jun 22, 2018, 3:14:13 PM6/22/18
to Nicolas Papernot, Nicholas Carlini, Ian Goodfellow, cleverhans dev
Nicolas, how confident are you in that? Have you had an experience like that with Scholar before?

> > To unsubscribe from this group and stop receiving emails from it, send an email to cleverhans-dev+unsubscribe@googlegroups.com.
> > To post to this group, send email to cleverhans-dev@googlegroups.com.

> > To view this discussion on the web visit https://groups.google.com/d/msgid/cleverhans-dev/CAPXn81qqZ9Qenf3TJMEU7anC%3Dra0J2LnMsZKMqnovpaBA9gt1g%40mail.gmail.com.
> > For more options, visit https://groups.google.com/d/optout.
>
> --
> Sent from Gmail Mobile

--
You received this message because you are subscribed to the Google Groups "cleverhans dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cleverhans-dev+unsubscribe@googlegroups.com.
To post to this group, send email to cleverhans-dev@googlegroups.com.

Nicolas Papernot

unread,
Jun 22, 2018, 4:29:17 PM6/22/18
to Yash Sharma, Nicholas Carlini, Ian Goodfellow, cleverhans dev
I don't remember exactly how many weeks but I know that sometimes I've received notifications that there is a new article in my publications long after we released the article.

> > To unsubscribe from this group and stop receiving emails from it, send an email to cleverhans-de...@googlegroups.com.
> > To post to this group, send email to cleverh...@googlegroups.com.

> > To view this discussion on the web visit https://groups.google.com/d/msgid/cleverhans-dev/CAPXn81qqZ9Qenf3TJMEU7anC%3Dra0J2LnMsZKMqnovpaBA9gt1g%40mail.gmail.com.
> > For more options, visit https://groups.google.com/d/optout.
>
> --
> Sent from Gmail Mobile

--
You received this message because you are subscribed to the Google Groups "cleverhans dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cleverhans-de...@googlegroups.com.
To post to this group, send email to cleverh...@googlegroups.com.

Ian Goodfellow

unread,
Jun 22, 2018, 5:02:42 PM6/22/18
to Nicolas Papernot, Nicholas Carlini, Yash Sharma, cleverhans dev
Other articles on arxiv.org newer than the 2.1 tech report are already indexed. I don’t actually know how Google Scholar works but I would expect it to crawl most new articles in the same domain relatively simultaneously. If we were on a different domain I would agree we should wait for the crawler but in this situation I think it’s more likely the article got crawled and de-duped.

Moustafa F. Alzantot

unread,
Jun 22, 2018, 5:07:01 PM6/22/18
to Ian Goodfellow, Yash Sharma, cleverhans dev
A potential problem with updating the title is the fragmentation if citations in the index. I.e papers that cite v2.0, may appear as citing other paper than this that cite v2.1

Thanks,
 Moustafa

Nicolas Papernot

unread,
Jun 22, 2018, 7:02:28 PM6/22/18
to Moustafa F. Alzantot, Ian Goodfellow, Yash Sharma, cleverhans dev
I don't have any objections with uploading a new report with a slightly modified title if it's important to have the report crawled before the next version increment. I don't think it will change anything to the citations because the different versions already show up as different articles unless merged manually on author profiles as far as I can tell.

Yash Sharma

unread,
Jun 23, 2018, 2:25:43 PM6/23/18
to Nicolas Papernot, Moustafa F. Alzantot, Ian Goodfellow, cleverhans dev
Ian, so should we make the update?

To unsubscribe from this group and stop receiving emails from it, send an email to cleverhans-dev+unsubscribe@googlegroups.com.
To post to this group, send email to cleverhans-dev@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "cleverhans dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cleverhans-dev+unsubscribe@googlegroups.com.
To post to this group, send email to cleverhans-dev@googlegroups.com.

Ian Goodfellow

unread,
Jun 27, 2018, 10:21:19 AM6/27/18
to Yash Sharma, Nicolas Papernot, m.alz...@gmail.com, cleverhans dev
Yeah, go ahead.

To unsubscribe from this group and stop receiving emails from it, send an email to cleverhans-de...@googlegroups.com.
To post to this group, send email to cleverh...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "cleverhans dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cleverhans-de...@googlegroups.com.
To post to this group, send email to cleverh...@googlegroups.com.

Yash Sharma

unread,
Jul 7, 2018, 5:04:15 PM7/7/18
to Ian Goodfellow, Nicolas Papernot, cleverhans dev
It still hasn't been noticed, while papers submitted around July 4th already have been. Oh well.  

Yeah, go ahead.

To unsubscribe from this group and stop receiving emails from it, send an email to cleverhans-dev+unsubscribe@googlegroups.com.
To post to this group, send email to cleverhans-dev@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "cleverhans dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cleverhans-dev+unsubscribe@googlegroups.com.
To post to this group, send email to cleverhans-dev@googlegroups.com.

Ian Goodfellow

unread,
Jul 9, 2018, 6:59:46 PM7/9/18
to Yash Sharma, Nicolas Papernot, cleverhans dev
I met with some people from Google Scholar today and they say that it definitely will be indexed eventually.

Yeah, go ahead.

To unsubscribe from this group and stop receiving emails from it, send an email to cleverhans-de...@googlegroups.com.
To post to this group, send email to cleverh...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "cleverhans dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cleverhans-de...@googlegroups.com.
To post to this group, send email to cleverh...@googlegroups.com.

Yash Sharma

unread,
Jul 9, 2018, 7:10:47 PM7/9/18
to Ian Goodfellow, Nicolas Papernot, cleverhans dev
Awesome! Thanks Ian. 

Yeah, go ahead.

To unsubscribe from this group and stop receiving emails from it, send an email to cleverhans-dev+unsubscribe@googlegroups.com.
To post to this group, send email to cleverhans-dev@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "cleverhans dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cleverhans-dev+unsubscribe@googlegroups.com.
To post to this group, send email to cleverhans-dev@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages