esriAscii

[Frederic Leclercq]

Dear all,

Is there a way to speed up the response in an .esriAscii request. The speed difference between a .nc and .esriAscii output format is huge. I have an example dataset where the ascii output is taking ~30 minutes before the download starts, where the .nc request is starting after ~6 seconds...   
Source file is a .nc file (~2.5Gb) - 5 parameters. The request is 1 parameter full BBOX....

Any ideas why this takes to long?

All help is appreciated.

Best regards,
Fred.

--

Frederic Leclercq

Project Manager

IT division

Vlaams Instituut voor de Zee vzw InnovOcean Campus, Jacobsenstraat 1 8400 Oostende, België T +32 (0)59-33 61 07 / M +32 (0)498-35 26 71 www.vliz.be

[Roy Mendelssohn - NOAA Federal]

HI Fred:

I doubt I have the knowledge to answer this, but for starters can you tell us which version of ERDDAP you are using and a sample URL. Also, have you looked in the logs for any messages related to that request. If there are messages, sharing those would also help.

Thanks,

-Roy

> On Jul 13, 2023, at 5:47 AM, Frederic Leclercq <frederic...@vliz.be> wrote:
>
> Dear all,
>
> Is there a way to speed up the response in an .esriAscii request. The speed difference between a .nc and .esriAscii output format is huge. I have an example dataset where the ascii output is taking ~30 minutes before the download starts, where the .nc request is starting after ~6 seconds...
> Source file is a .nc file (~2.5Gb) - 5 parameters. The request is 1 parameter full BBOX....
>
> Any ideas why this takes to long?
>
> All help is appreciated.
>
> Best regards,
> Fred.
>
>
>
> --
> Frederic Leclercq
> Project Manager
> IT division
>

> <KPqXypvh60A8AjMS.png>

>
> Vlaams Instituut voor de Zee vzw
> InnovOcean Campus, Jacobsenstraat 1
> 8400 Oostende, België
>
> T +32 (0)59-33 61 07 / M +32 (0)498-35 26 71
> www.vliz.be
>

> --
> You received this message because you are subscribed to the Google Groups "ERDDAP" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to erddap+un...@googlegroups.com.
> To view this discussion on the web, visit https://groups.google.com/d/msgid/erddap/1e08eae2-a812-2e80-17b1-9a52900bd15f%40vliz.be.

**********************
"The contents of this message do not reflect any position of the U.S. Government or NOAA."
**********************
Roy Mendelssohn
Supervisory Operations Research Analyst
NOAA/NMFS
Environmental Research Division
Southwest Fisheries Science Center
***Note new street address***
110 McAllister Way
Santa Cruz, CA 95060
Phone: (831)-420-3666
Fax: (831) 420-3980
e-mail: Roy.Men...@noaa.gov www: https://www.pfeg.noaa.gov/

"Old age and treachery will overcome youth and skill."
"From those who have been given much, much will be expected"
"the arc of the moral universe is long, but it bends toward justice" -MLK Jr.

[Frederic Leclercq]

Dear Roy,

I can reproduce this both on a 2.18 and 2.22 instance.  I think you can reproduce this on every ERDDAP instance actually, eg: nc output takes some time as well, but esriAscii takes significant more time (didn't wait to see the result, but clearly a lot longer - it might even throw a proxy error/timeout)

https://coastwatch.pfeg.noaa.gov/erddap/griddap/nceiPH53sstd1day.esriAscii?sea_surface_temperature%5B(2023-03-31T12:00:00Z):1:(2023-03-31T12:00:00Z)%5D%5B(89.979):1:(-89.979)%5D%5B(-179.979):1:(179.979)%5D
vs
https://coastwatch.pfeg.noaa.gov/erddap/griddap/nceiPH53sstd1day.nc?sea_surface_temperature%5B(2023-03-31T12:00:00Z):1:(2023-03-31T12:00:00Z)%5D%5B(89.979):1:(-89.979)%5D%5B(-179.979):1:(179.979)%5D

Best regards and thanks!
Fred.

[Frederic Leclercq]

Hi Roy, all,

I forgot to mention I could not see any related errors in the logs.

Best regards,
Fred.

To view this discussion on the web, visit https://groups.google.com/d/msgid/erddap/ce9794c3-07b3-4e9b-6a14-5e7e62eabe3b%40vliz.be.

[Roy Mendelssohn - NOAA Federal]

Thanks. I have been playing with this and have some ideas but let me run them by Chris and Bob and wait till w hav something more definite.

-Roy

> To view this discussion on the web, visit https://groups.google.com/d/msgid/erddap/86e127c3-6205-b9cc-10b0-7cabd20e9a70%40vliz.be.

[Chris John - NOAA Affiliate]

Thanks for letting me know about this, I'll be looking into it soon.

Chris

To view this discussion on the web, visit https://groups.google.com/d/msgid/erddap/4E312DD7-5699-493D-B7E8-6174EAF3C58A%40noaa.gov.