IP address keeps getting blocked, and bad permissions on ssh files - https://data.hycom.org

[Patrick Tripp]

I run a non-parallel python script to download daily hycom forecast data from https://data.hycom.org/, and have been doing so for years. 

The current problems started around 2025-03-21 18:00 UTC. My IP address keeps getting blacklisted. I have renewed and obtained a new IP address 3 times. Downloads work fine for a few files, but the IP is eventually blocked. I even added some pauses in the script in case that was triggering it.

I noticed that the _ssh.nc files have incorrect permissions on your web server causing a 403 permission denied error message. I suspect that the server is automatically blocking my IP address after several permission denied errors.

I verified this error using a web browser on a different machine and the following URL:

https://data.hycom.org/datasets/ESPC-D-V02/data/forecasts/US058GCOM-OPSnce.espc-d-031-hycom_fcst_glby008_2025032412_t0000_ssh.nc

"Forbidden

You don't have permission to access this resource."

I download t0000 - t0180 every 12th hour, and 5 fields. It's not a ton of data.

url: https://data.hycom.org/datasets/ESPC-D-V02/data/forecasts/US058GCOM-OPSnce.espc-d-031-hycom_fcst_glby008_2025032412_t0000_ssh.nc 

url: https://data.hycom.org/datasets/ESPC-D-V02/data/forecasts/US058GCOM-OPSnce.espc-d-031-hycom_fcst_glby008_2025032412_t0000_s3z.nc

url: https://data.hycom.org/datasets/ESPC-D-V02/data/forecasts/US058GCOM-OPSnce.espc-d-031-hycom_fcst_glby008_2025032412_t0000_t3z.nc

url: https://data.hycom.org/datasets/ESPC-D-V02/data/forecasts/US058GCOM-OPSnce.espc-d-031-hycom_fcst_glby008_2025032412_t0000_u3z.nc

url: https://data.hycom.org/datasets/ESPC-D-V02/data/forecasts/US058GCOM-OPSnce.espc-d-031-hycom_fcst_glby008_2025032412_t0000_v3z.nc

Thanks,

Patrick

[Michael McDonald]

Patrick,
Sorry to hear you are having trouble accessing hycom.org resources.
Please private message me your public-facing IPv4 address, and I will
check the fail2ban logs for any blocks.

> --
> --
> You received this message because you are a member of HYCOM.org
> To ask a question, send an email to fo...@hycom.org
>


--
Michael McDonald
HYCOM.org Administrator