Major LoadDatasets hanging

[Ellen Koukel - NOAA Affiliate]

Hi,

The past couple of days I (and other members of my team) have been having a strange problem where my ERDDAP is not loading any datasets. I first encountered this when I added multiple new datasets at once and the major loadDatasets seemed to stall, lasting up to an hour before restarting again yet never actually finishing. I'm using the XInclude SAX parser, if that matters, and had been on version 2.28_1, which was working completely fine the day before.

I set to false and then later wholly removed all of the new datasets, which didn't work. I've since updated my ERDDAP as well as completely reinstalled it, which also did not work. The datasets.xml that comes with a new installation of datasets did work, but when I removed those and added my own datasets in the loadDatasets failed again.

I would add this as a bug to the ERDDAP github except that I can find no actual error in any of the logs, so I'm not sure what's actually wrong. Do you have any suggestions on how to fix this?

Thanks!

Best,

Ellen

[Roy Mendelssohn - NOAA Federal]

Hi Ellen:

Sorry you are having problems. Often loading a new dataset can take a long time, and there are setting in datasets.xml that set how long to try reloading and how long between loads. If the loading hasn’t finished before this time, the load will restart again and therefore never complete. You also should be seeing some datasets load as you go, unless something is really wrong.

If you are willing, as this could really slow things down, could you do the following:

1. Go back to your datasets.xml before you added the new datasets.

2. Stop ERDDAP™, erase the contents of your bigERDDAP directory, up the time to do reloads, restart ERDDAP™.

3. If that doesn’t work, then please go to the status page (which flushes info to the logs), and send me what the status page shows as well as the log a sanitized version of your setup.xml

4. If that does work, add say one file at a time. Note that this doesn’t require a restart, just modify the datasets.xml, and touch the datasetID in bigERDDAP/flag. If it works, add another, if it doesn’t work, again go to the status page, and then send me the same info.

And to be clear, you are still on version 2.28_1, correct? Any chance having you update to version 2.29 as long as you are stopping your ERDDAP™ for a bit? That would help us because I test using 2.29 as does Chris, so it makes it easier for us to reproduce problems.

Thanks,

-Roy

> --
> You received this message because you are subscribed to the Google Groups "ERDDAP" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to erddap+un...@googlegroups.com.
> To view this discussion, visit https://groups.google.com/d/msgid/erddap/012c9372-af51-4acf-969a-ed4f9383df32n%40googlegroups.com.

[Roy Mendelssohn - NOAA Federal]

And remember if you do update to version 2.29 you need Java 25.

Thanks,

-Roy

[Roy Mendelssohn - NOAA Federal]

And put the new datasets at the end of datasets.xml

-Roy

[Ellen Koukel - NOAA Affiliate]

Hi,

I went back to a prior version of my datasets.xml from before I added those new datasets. I upgraded to v2.29 yesterday (and Java 25). I stopped ERDDAP, increased the reload time to 240, removed everything inside the bigERDDAP directory, and started ERDDAP again. It's been nearly an hour, and the attached screenshot is the status page. As you can see, no datasets have loaded. If you need, I can screenshot the entire status page.

I've attached the log.txt and a cleaned version of my setup.xml. 

--

Ellen Koukel | ellen....@noaa.gov

Data Curator

Science Data Integration Group

NOAA | PMEL & University of Washington | CICOES