Some docs not visible on the site

[Katie O'Dowd]

Hi, 

Library has been great to use, thank you! I've run into an issue where I don't see some documents on the site/they don't show up in search, but they are in the Google folder when I click through. The only thing I can think is that maybe this is happening to documents that are saved in multiple Google folders.

Thanks in advance! 

Katie 

[Joe Germuska]

Katie:

 

We were running into this problem with Knight Lab’s Library instance several weeks ago. Unfortunately, I don’t know exactly what solved it, but we upgraded the version of the Library software we were using to the current version, and the issue went away.

 

Do you know what version of the Library software you’re running?

 

Joe

 

--
Joe Germuska (he/his) • joege...@northwestern.edu • @JoeGermuska
Chief Nerd, Knight Lab • https://KnightLab.Northwestern.edu • @KnightLab

--
You received this message because you are subscribed to the Google Groups "NYT Library Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nyt-library-comm...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/nyt-library-community/65558d11-78cd-4538-b108-c24cb89394e5%40googlegroups.com.

[Katie O'Dowd]

Thanks, Joe. We're running 1.2. What version are you running? 

On Tuesday, November 19, 2019 at 5:45:26 PM UTC-5, Joe Germuska wrote:

Katie:

 

We were running into this problem with Knight Lab’s Library instance several weeks ago. Unfortunately, I don’t know exactly what solved it, but we upgraded the version of the Library software we were using to the current version, and the issue went away.

 

Do you know what version of the Library software you’re running?

 

Joe

 

--
Joe Germuska (he/his) • joege...@northwestern.edu • @JoeGermuska
Chief Nerd, Knight Lab • https://KnightLab.Northwestern.edu • @KnightLab

 

 

From: <nyt-librar...@googlegroups.com> on behalf of Katie O'Dowd <odo...@gmail.com>
Date: Tuesday, November 19, 2019 at 4:00 PM
To: NYT Library Community <nyt-librar...@googlegroups.com>
Subject: [NYT Library] Some docs not visible on the site

 

Hi, 

Library has been great to use, thank you! I've run into an issue where I don't see some documents on the site/they don't show up in search, but they are in the Google folder when I click through. The only thing I can think is that maybe this is happening to documents that are saved in multiple Google folders.

 

Thanks in advance! 

Katie 

--
You received this message because you are subscribed to the Google Groups "NYT Library Community" group.

To unsubscribe from this group and stop receiving emails from it, send an email to nyt-library-community+unsub...@googlegroups.com.

[Joe Germuska]

When the issue came up, we were running 1.0.something? 

 

I don’t recall now if I recreated the issue locally using older code; I think I hadn’t had a local copy of the core repo on my machine, and didn’t think about version matching, so I think my first local attempt, on 1.2.0, didn’t manifest the problem, leading me to look into upgrading the deployed codebase.

To unsubscribe from this group and stop receiving emails from it, send an email to nyt-library-comm...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/nyt-library-community/65558d11-78cd-4538-b108-c24cb89394e5%40googlegroups.com.

--

You received this message because you are subscribed to the Google Groups "NYT Library Community" group.

To unsubscribe from this group and stop receiving emails from it, send an email to nyt-library-comm...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/nyt-library-community/ff50821e-1412-409d-a07e-7af6cf53caf2%40googlegroups.com.

[Fischer, Andrew]

Whoops, looping back in the google group... 

Regarding the missing documents, it is totally possible that there is an issue with our shared folder crawling logic. Unlike with team drives, google doesn't provide a way to list all files at the same time, so we need to recursively crawl the folder structure. 

I don't think we will need to update the customization repo very often and I wouldn't imagine we would need to make large changes to the repo's layout, so I wouldn't be nervous about merging upstream changes. Depending on how you have your customizations set up, you might be able to run git diff origin/master to see what changes you have made.

-Andrew

───

Andrew Fischer

Associate Engineer, Story Foundations

andrew....@nytimes.com

On Thu, Nov 21, 2019 at 10:39 AM Joe Germuska <JoeGe...@northwestern.edu> wrote:

Andrew:

 

I think this went just to me, not the group (cf https://groups.google.com/forum/?utm_medium=email&utm_source=footer#!msg/nyt-library-community/36zQK3HL4lI/XS7ayAoSBQAJ )

 

Yes, Knight Lab is using shared folder.

 

As for customizations, we have modest style things but pretty sure nothing else.  (Do you happen to know the git-fu to more readily see the differences between our customization repo and the upstream master?  Should I be nervous about merging in upstream changes? I didn’t do the customization, so I’m not clear on where our actual customization lives and how that relates to the base customization example repo.

 

Joe

 

 

--
Joe Germuska (he/his) • joege...@northwestern.edu • @JoeGermuska
Chief Nerd, Knight Lab • https://KnightLab.Northwestern.edu • @KnightLab

 

 

From: Andrew Fischer <andrew....@nytimes.com>
Date: Thursday, November 21, 2019 at 8:44 AM
To: Joe Germuska <JoeGe...@northwestern.edu>
Subject: Re: [NYT Library] Some docs not visible on the site

 

Hi All,

 

Sorry to hear you’re having issues with Library!

 

Joe, is the Knight Lab using a shared folder as well? 

 

Also, what (if any) customizations do your library instances have?

 

Best,

Andrew Fischer

 

Associate Developer, The New York Times

To view this discussion on the web visit https://groups.google.com/d/msgid/nyt-library-community/6683E762-6491-4A40-AD62-88ED9DF71370%40northwestern.edu.