file access with EDDTableFromErddap?

[mauric...@gmail.com]

hello
I noticed that when giving acces to a dataset from a distant erddap server with EDDTableFromErddap
we do not have acces to files?

is that a volunteer  feature? and why? or is there a workaround to give access to files from a distant serddap server?

thanks

Maurice

exemple on:

https://erddap.emso.eu/erddap/tabledap/index.html?page=1&itemsPerPage=1000

<dataset type="EDDTableFromErddap" datasetID="Emso_Western_Ligurian_Albatross_Aquadopp_NetCDF_2014" a
ctive="true">
    <sourceUrl>https://erddap.osupytheas.fr/erddap/tabledap/Emso_Western_Ligurian_Albatross_Aquadopp_
NetCDF_2014.html</sourceUrl>

</dataset>

[bobsimons2.00]

It is not intentional. If it's true, I am surprised. The source dataset has to make its /files available, but in this case I see that it does. Chris John, can you please check on this?

I note that the documentation for EDDTableFromErddap 

https://coastwatch.pfeg.noaa.gov/erddap/download/setupDatasetsXml.html#EDDTableFromErddapSkeletonXML

doesn't include <accessibleViaFiles> (which it should) whereas EDDGridFromErddap's documentation does. Chris, can you please fix that?

Best wishes.

[mauric...@gmail.com]

ok let me know how it goes, 

since indeed in my case the source dataset  have made the files accessible... exemple below:

the erddap source gives the files accessibles from : https://erddap.osupytheas.fr/erddap/files/Emso_Western_Ligurian_MII_Microcat_NetCDF_2017/

and the distant erddap server doesnt show the files https://erddap.emso.eu/erddap/tabledap/Emso_Western_Ligurian_MII_Microcat_NetCDF_2017.graph

we need this feature on an European erddap network where flies from different regional facilities are centralized (many thanks for erddap to exist :-)

thanks let me know if there is a workaround or a patch ?

Maurice

[Roy Mendelssohn - NOAA Federal]

Hi Maurice:

Can you please send me the xml snippet that sets up  https://erddap.emso.eu/erddap/tabledap/Emso_Western_Ligurian_MII_Microcat_NetCDF_2017.graph  Please be certain to sanitize if needed before sending .

Thanks.

-Roy

-- 
You received this message because you are subscribed to the Google Groups "ERDDAP" group.
To unsubscribe from this group and stop receiving emails from it, send an email to erddap+un...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/erddap/9cc736be-e65d-459a-927e-5510bd22f336n%40googlegroups.com.

[bobsimons2.00]

I should have said: when ERDDAP reloads a dataset, it determines whether the /files/ system will be available for that dataset. If it won't be available, ERDDAP should print a diagnostic message to log.txt that starts with 

   accessibleViaFiles=

then has the reason it failed. 

It is worth looking in log.txt to see if the error message was logged.

[mauric...@gmail.com]

Le vendredi 3 novembre 2023 à 23:07:58 UTC+1, roy.men...@noaa.gov a écrit :

Hi Maurice:

Can you please send me the xml snippet that sets up  https://erddap.emso.eu/erddap/tabledap/Emso_Western_Ligurian_MII_Microcat_NetCDF_2017.graph  Please be certain to sanitize if needed before sending .

Thanks.

yes.. here are the lines  below , on the "central" server

# cat osupytheas/Emso_Western_Ligurian_MII_Aquadopp_NetCDF_2017.xml

<dataset type="EDDTableFromErddap" datasetID="Emso_Western_Ligurian_MII_Aquadopp_NetCDF_2017" active="true">
    <sourceUrl>https://erddap.osupytheas.fr/erddap/tabledap/Emso_Western_Ligurian_MII_Aquadopp_NetCDF_2017</sourceUrl>
    <defaultGraphQuery> time%2CPRES%2C&amp;time&gt;2023-10-09T00%3A00%3A00Z&amp;time&lt;2023-10-16T00%3A00%3A00Z&amp;DE
PH=2436.0&amp;.draw=linesAndMarkers&amp;.marker=3|5&amp;.color=0x000000&amp;.colorBar=|||||&amp;.bgCo
lor=0xffccccff </defaultGraphQuery>
</dataset>

and the file in attachment from the erddap "source"  side (https://erddap.osupytheas.fr/erddap)

I don't see if there is something to sanitize

I want to add that, I relate the problem from my own files, but on our central server, none of the datasets from other regional facilities, display the files

https://erddap.emso.eu/erddap/info/index.html?page=1&itemsPerPage=1000

thanks for the diagnosis

Maurice

[mauric...@gmail.com]

ok we will have a look in the log files and let you know

nevertheless I dont' really understand what you mean Bob, since from "client" side, on the "source" erddap server, the files are accessibles and displayed .. So from the "client" side the files system is available
and how the distant "central" erddap server, should know whether the files are to be displayed ?

I guess the file accessibility should come from the client erddap server, and communicated to the distant central server  ?

I don't know and understand how it works

Maurice

[Roy Mendelssohn - NOAA Federal]

Hi Maurice:

I will try to see if I can find a workaround. A short explanation of what I think is happening is that for any type of page in ERDDAP, say an .html or .graph file, based on the type of dataset that is being displayed (say EDDTableFromErddap), there is a "skeleton" that describes what is on that page. Bob's email suggested that "file access" is not in the skeleton for EDDTableFromErddap , while it is for EDDGridFromErddap. If that is what is going on, then it is a "bug" (I mean things are working as the code says it should, it is just not in the code) and we will try to add a more permanent fix down the line. In the meantime I will see if I can find a kludge solution. It will likely be a few days before I can get to this - but will keep you informed.

Thanks,

-Roy

> On Nov 6, 2023, at 2:44 AM, mauric...@gmail.com <mauric...@gmail.com> wrote:
>
> I gave the wrong snippet in the example above , but I think it doesn't matter, since they all have the same problem of not displaying fils on the central server
>
> <dataset type="EDDTableFromErddap" datasetID="Emso_Western_Ligurian_MII_Microcat_NetCDF_2017" active="true">
> <sourceUrl>https://erddap.osupytheas.fr/erddap/tabledap/Emso_Western_Ligurian_MII_Microcat_NetCDF_2017</sourceUrl>
> <defaultGraphQuery> time,TEMP&amp;.draw=linesAndMarkers&amp;.marker=6|3&amp;.color=0x000000&amp;.colorBar=|||||&amp;.bgColor=0xffccccff&amp;time&gt;2023-10-09T00:00:00Z&amp;time& lt;2023-10-10T00:00:00Z&amp;.timeRange=1,day(s) </defaultGraphQuery>
> </dataset>

> To view this discussion on the web, visit https://groups.google.com/d/msgid/erddap/59e77036-a9c8-45f9-9fe4-96a2becdf00an%40googlegroups.com.

**********************
"The contents of this message do not reflect any position of the U.S. Government or NOAA."
**********************
Roy Mendelssohn
Supervisory Operations Research Analyst
NOAA/NMFS
Environmental Research Division
Southwest Fisheries Science Center
***Note new street address***
110 McAllister Way
Santa Cruz, CA 95060
Phone: (831)-420-3666
Fax: (831) 420-3980
e-mail: Roy.Men...@noaa.gov www: https://www.pfeg.noaa.gov/

"Old age and treachery will overcome youth and skill."
"From those who have been given much, much will be expected"
"the arc of the moral universe is long, but it bends toward justice" -MLK Jr.

[mauric...@gmail.com]

ok thanks for your investigation

you're the man

tell me if I can do something for you, tests or what else

Maurice