I'm trying to install RClimDex as a package and its returning a warning that the version isn't available for my version.
I tried searching for probable updates to my version, but no updates available.
There is a package called climdex.pcic from the same institute which is more updated. I guess you can find functions in rclimdex.r in that package
-project.org/web/packages/climdex.pcic/index.html
However the word "ETCCDI" is never used. It is possible for these indices to be made official ETCCDI indices? For example, there are some differences: the percentile threshold calculations (for the TX/N10/90p indices) are subject to bootstrapping (which is the major time factor when calculating with the ETCCDI software) -- and I am not aware that such bootstrapping is done when using the CDO functions. Perhaps some collaboration between the CDO team and the ETCCDI team could help. I don't think much work would need to be done for these CDO operators have the same implementation as official ETCCDI software. The main advantage is that CDO will probably be faster; and thus would help enormously for CMIP6.
i personally do not expect this to be a minor change to the software. I cannot even download the R-package (RClimDex). I think there is currently no time to do this. Maybe with some external funding ;-)
In the most basic cases, a single CDO operator is required. For example rx1day (maximum daily rainfall per year) is cdo yearmax ifile.nc ofile.nc. In other cases, some piping is needed. For example cdd (consecutive dry days) is: cdo yearmax -consects -lec,1 ifile.nc ofile.nc
There is already specialised R software for calculating the ETCCDI indices, like RClimDex as you mentioned, or Climpact2. Although these software work, they are: non-trivial to install; slow compared to CDO; cannot be used in the command line like CDO. And with the CMIP6 suite of model runs coming out soon, computation time with the R software will become even more of a bottleneck. One can leverage the work already done in CDO over the years to calculate all the indices fairly easily (the most challenging might be the bootstrapping for TX/N10/90p indices). However, it would be nice if these indices were made "officially" part of CDO for ease of use. I recommend 27 new operators. Could be used like:
I'm starting to integrate ETCCDI indices definitions in CDOs. First, I compare percentile-based indices, which were calculated using CDOs and Rclimdex. Thank you for your offer, if necessary I will come back to it.
I finished my analysis and could show that the results of the climdex package for "absolute" and "threshold" indices can be created with CDOs. txx, txn, tnx, tnn, dtr, prcptot are missing in the spectrum of eca_* operators but can be easily produced with statistical operators. The duration and percentile indices on the other hand cannot be calculated with CDOs. I summarized the results on slides:
Besides the 6 missing eca_* operators for ETCCDI indices, an argument for 27 new operators is that their names can show that they use the methods recommended by ETCCDI. Also, enabling ETCCDI methods for operators for the percentile indices with an option will not be user friendly.
If these 27 new operators do not replace the eca_* operators (maybe because they are essential for some users) but rather are additional operators, we will have lots of operators of which 9 produce the same results as the old 9. This could lead to confusion. Another aspect is that ETCCDI operators may be not as modular as the eca_* operators. For example, the rclimdex package delets the 29th of feb. in leap years. Will we adopt this method and use it everytime?
If you have information about meta data standards for these clima indices in any projects, I would be glad if you can inform me about that. Discussing meta data will be one of the next steps.
Best regards,
Fabi
etccdi is only the name of a group of climate indices. the operators of that group use etccdi as prefix. you can check all operators from the group with
cdo -h etccdiNAME etccdi_tx90p, etccdi_tx10p, etccdi_tn90p, etccdi_tn10p, etccdi_r95p, etccdi_r99p - ETCCDI conform index for a reference periode calculated with bootstrappingSYNOPSIS ,n,startboot,endboot[,m] infile1 infile2 infile3 outfileDESCRIPTION This module enables to compute Climate Extremes Indices according to the method recommended by the Expert Team on Climate Change Detection and Indices. It differs from the corresponding eca_* indices by applying bootstrapping for a reference period (see Zhang et al. 2005) given by startboot and endboot and using the R-type 8 method for percentile calculation. A requirement for correct percentile calculation is that CDO_PCTL_NBINS>=window*(endboot-startboot+1)*(sizeof(double)/sizeof(int))+2 This demands for high working storage since the entire data of the bootstrapping interval need to be hold in storage. Otherwise, a histogram is used to calculate the percentile. infile2 (infile3) contains the daily minimum (maximum) of the bootstrapping interval. If m=m, the output variable will be saved monthly, otherwise with yearly frequency.OPERATORS etccdi_tx90p Percentage of Days when Daily Maximum Temperature is Above the 90th Percentile etccdi_tx10p Percentage of Days when Daily Maximum Temperature is Below the 10th Percentile etccdi_tn90p Percentage of Days when Daily Minimum Temperature is Above the 90th Percentile etccdi_tn10p Percentage of Days when Daily Minimum Temperature is Below the 10th Percentile etccdi_r95p Annual Total Precipitation when Daily Precipitation Exceeds the 95th Percentile of Wet Day Precipitation etccdi_r99p Annual Total Precipitation when Daily Precipitation Exceeds the 99th Percentile of Wet Day PrecipitationPARAMETER n INTEGER Window days, number of timesteps startboot INTEGER First year of bootstrapping interval endboot INTEGER Last year of bootstrapping interval m CHARACTER Output frequencyENVIRONMENT CDO_PCTL_NBINS Sets the number of histogram bins. The default number is 101.
The error message is a bit misleading. Unfortunately, the operator etccdi_r95p cannot be combined with other operators. This CDO command must therefore be split into three parts:
cdo ydrunmin,5 file.nc drunmin.nccdo ydrunmax,5 file.nc drunmax.nccdo etccdi_r95p,1979,2008 file.nc drunmin.nc drunmax.nc r95p.nc