dli downloaders broken.

विश्वासो वासुकिजः (Vishvas Vasuki)

unread,

Mar 11, 2016, 12:54:30 AM3/11/16

to sanskrit-programmers, Shriramana श्रीरमणशर्मा होता, Ajit अजितकृष्णसूनुः होता, Kumar Shankara

shrIramaNa's dli-avaropa.sh does not work for me anymore, and I suppose neither will ajita's py in the same repo.

Problem:

While trying to download http://www.dli.gov.in/cgi-bin/DBscripts/allmetainfo.cgi?barcode=1990020047473

I observe that urls like http://www.new.dli.gov.in/data/upload/0047/478/PTIFF/00000387.tif dont work anymore (though I observe such urls here: http://imgur.com/RiUXbxO ).

Any help?

--

--
Vishvas /विश्वासः

Ajit Krishnan

unread,

Mar 11, 2016, 9:01:56 AM3/11/16

to विश्वासो वासुकिजः (Vishvas Vasuki), sanskrit-programmers, Shriramana श्रीरमणशर्मा होता, Kumar Shankara

I'm not able to reproduce the problem with dli.py. Note that the imgur screenshot shows the images on www.dli.gov.in, and not www.new.dli.gov.in.

Simply use dli.py [barcode], and it will do the rest.

विश्वासो वासुकिजः (Vishvas Vasuki)

unread,

Mar 11, 2016, 11:46:54 AM3/11/16

to Ajit Krishnan, sanskrit-programmers, Shriramana श्रीरमणशर्मा होता, Kumar Shankara

2016-03-11 6:01 GMT-08:00 Ajit Krishnan <ajit.k...@gmail.com>:

I'm not able to reproduce the problem with dli.py.

Simply use dli.py [barcode], and it will do the rest.

Ah! silly me. I was trying to use some other py script in my repo (without a clear idea of how to invoke it too.)

Note that the imgur screenshot shows the images on www.dli.gov.in, and not www.new.dli.gov.in.

Oh! ok. Fixed shrIramaNa's script with that pointer.

--

Ajit Krishnan

unread,

Mar 11, 2016, 12:23:09 PM3/11/16

to विश्वासो वासुकिजः (Vishvas Vasuki), sanskrit-programmers

+ sanskrit-programmers.

On Fri, Mar 11, 2016 at 9:19 AM, Ajit Krishnan <ajit.k...@gmail.com> wrote:

> Oh! ok. Fixed shrIramaNa's script with that pointer.

Unfortunately, each of the servers has a partial catalog. Sometimes, they point to images on the local server, and sometimes to images on other DLI server. i.e. hardcoding any particular server isn't going to work.

dli.py has the logic to chase the references on every single server and to find one that actually hosts the images. Once the images are downloaded, it also deals with some malformed tiff images that libtiff has trouble with. The servers are also ordered by the fastest most available ones (based on my experience).

My suggestion is to use dli.py unless you have a specific need to use the other downloaders ... it has logic to deal with all the edge cases I've run into.

विश्वासो वासुकिजः (Vishvas Vasuki)

unread,

Mar 11, 2016, 12:29:30 PM3/11/16

to Ajit Krishnan, sanskrit-programmers

2016-03-11 9:22 GMT-08:00 Ajit Krishnan <ajit.k...@gmail.com>:

Unfortunately, each of the servers has a partial catalog. Sometimes, they point to images on the local server, and sometimes to images on other DLI server. i.e. hardcoding any particular server isn't going to work.

dli.py has the logic to chase the references on every single server and to find one that actually hosts the images. Once the images are downloaded, it also deals with some malformed tiff images that libtiff has trouble with. The servers are also ordered by the fastest most available ones (based on my experience).

My suggestion is to use dli.py unless you have a specific need to use the other downloaders ... it has logic to deal with all the edge cases I've run into.

तदिदमधुनैव ज्ञातम्। साधु सूचिता वयम्। सर्वमिदं सञ्चिकाया आदावपि वाच्यम्।

विश्वासो वासुकिजः (Vishvas Vasuki)

unread,

Mar 11, 2016, 3:58:22 PM3/11/16

to Ajit Krishnan, sanskrit-programmers

2016-03-11 9:29 GMT-08:00 विश्वासो वासुकिजः (Vishvas Vasuki) <vishvas...@gmail.com>:

My suggestion is to use dli.py unless you have a specific need to use the other downloaders ... it has logic to deal with all the edge cases I've run into.

तदिदमधुनैव ज्ञातम्। साधु सूचिता वयम्। सर्वमिदं सञ्चिकाया आदावपि वाच्यम्।

तथा मम प्रतिकृतौ कृतम्। अपि चानेकपुस्तकावरोपणाय dli_multi.sh इत्यपि सृष्टम्।

Reply all

Reply to author

Forward