force reimport on failed docs

23 views
Skip to first unread message

Bob Weston

unread,
Aug 23, 2018, 3:57:45 PM8/23/18
to overview-users

Hey folks,

We have a large document dump on documentcloud and tried importing them to overview. But we had about 1400 documents fail. The problem was an issue on the documentcloud side. The failed docs were in a stuck "processing" state on dcloud.

Unfortunately, we didn't know that when we imported to overview. Those docs, unsurprisingly, failed to import to overview. We've worked with the dcloud folks and the docs have finished processing. But apparently, overview isn't reimporting these failed docs. I'm not seeing any way to force that reimport.

So my question is, how can we deal with this issue (obviously, making sure the docs are complete on documentcloud before importing is a good start). I'm just wondering the best way to deal with current situation.

Thanks for your help and suggestions.

-Bob

Jonathan Stray

unread,
Aug 24, 2018, 11:31:54 AM8/24/18
to overvie...@googlegroups.com
Hi Bob. Unfortunately there's no easy way to reimport just failed documents. Your best bet is just to reimport everything again. Sorry.

   - Jonathan


--
You received this message because you are subscribed to the Google Groups "overview-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to overview-user...@googlegroups.com.
To post to this group, send email to overvie...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Bob Weston

unread,
Aug 25, 2018, 1:24:33 PM8/25/18
to overvie...@googlegroups.com
Hi Jonathan,

Would that process meaning exporting from a different documentcloud project? 

I've tried to reanalyze the documents in overview from the dcloud side and it still doesn't import the documents. 

I tried going from Overview and pulling them in from Documentcloud.

-Bob

Jonathan Stray

unread,
Aug 25, 2018, 7:00:54 PM8/25/18
to overvie...@googlegroups.com
It sounded like the problem was originally on the documentcloud side — are you saying that the documents are no longer “stuck” on documentcloud but that they still won’t import to Overview?

Bob Weston

unread,
Sep 5, 2018, 2:03:48 PM9/5/18
to overview-users
Jonathan,

That is correct. The documents are no longer stuck in documentcloud. But they won't import in Overview.

Jonathan Stray

unread,
Sep 12, 2018, 1:54:29 PM9/12/18
to overvie...@googlegroups.com
Ok, we'll take a look. Is the documentcloud project public by any chance? Also, is your Overview installation up to date? You should be running overview-local these days, which has an update script.

  - Jonathan


--
Reply all
Reply to author
Forward
0 new messages