PyCPT Error

8 views
Skip to first unread message

Benjamin Kwenda

unread,
Oct 25, 2022, 3:02:29 AM10/25/22
to pycpt-esa
image.png

Greetings colleagues

I have tried to generate forecasts for other subseasons such as DJF and JFM. When I try to run this, I am getting an error from the Multi-Model Ensemble cell.

Anyone who has also encountered the same problem? How have you solved it?

Regards
--
Benjamin M Kwenda
Agriculture Meteorologist
Long Range Forecasting
Meteorological Services Department
Belvedere, Harare
Skype: bkwenda_1

Scientists of today think deeply instead of clearly. One must be sane to think clearly, but one can think deeply and be quite insane!!!!- Nikola Tesla

Celio Matuele

unread,
Oct 25, 2022, 5:05:14 AM10/25/22
to Benjamin Kwenda, pycpt-esa
Hi everyone!

Hey Benjamin, I am facing the same problem while running DJF and JFM!
The error is at the Multi-Model Ensemble cell.
Please see it in attached screenshots.
image.png 
image.png

Best regards,
Celio.

--
You received this message because you are subscribed to the Google Groups "pycpt-esa" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pycpt-esa+...@iri.columbia.edu.
To view this discussion on the web visit https://groups.google.com/a/iri.columbia.edu/d/msgid/pycpt-esa/CAEEVC%2BiKyyoQZndO8Z%3DGdfjifVS5%3DdcXzFq_TC6p0_jTDZVLtQ%40mail.gmail.com.
For more options, visit https://groups.google.com/a/iri.columbia.edu/d/optout.

Andrew Robertson

unread,
Oct 25, 2022, 8:03:41 AM10/25/22
to Celio Matuele, Benjamin Kwenda, pycpt-esa
HI Benjamin & Celio,

Thanks for sharing! Please always attach the Jupyter Notebook for debugging. This will help others (hopefully) quickly isolate the problem. Make sure that the model hindcasts from all the models are available for the training period you’ve chosen - might solve it in this case.

Best,
Andrew

On Oct 25, 2022, at 05:05, 'Celio Matuele' via pycpt-esa <pycp...@iri.columbia.edu> wrote:

Hi everyone!

Hey Benjamin, I am facing the same problem while running DJF and JFM!
The error is at the Multi-Model Ensemble cell.
Please see it in attached screenshots.
<image.png> 
<image.png>

Best regards,
Celio.

Benjamin Kwenda

unread,
Oct 25, 2022, 3:59:27 PM10/25/22
to Andrew Robertson, Celio Matuele, pycpt-esa
Dear Andy

Thank you for your email.

I have attached my notebook so you can check it out.

Regards
pycpt-operational- Benjy.ipynb

Benjamin Kwenda

unread,
Oct 25, 2022, 4:43:52 PM10/25/22
to Andrew Robertson, Celio Matuele, pycpt-esa
This one as well is giving me a similar error for SST predictands


pycpt-operational- Benjy-Copy1.ipynb

Andrew Robertson

unread,
Oct 26, 2022, 1:36:50 PM10/26/22
to Kyle Hall, Celio Matuele, pycpt-esa, Benjamin Kwenda
Hi Kyle,

I looked into this and I believe there is indeed a bug: for a JFM target season, ‘first_year’ and ‘final_year’ for the obs download need to be incremented by 1 year because the hindcasts are initialized at the end of the previous year. 
Is this best handled in the Jupyter Notebook or in CPT-DL?

There’s probably a related problem with DJF and NDJ target seasons, although the use of seasonalAverage might just mean the training time series in shortened by 1 year.  Ben did find a problem w/DJF too.

Best,
Andy


<pycpt-operational- Benjy.ipynb>

Andrew Robertson

unread,
Oct 26, 2022, 1:44:01 PM10/26/22
to Kyle Hall, Benjamin Kwenda, Celio Matuele, pycpt-esa
Thanks Kyle! We’ll try workarounds from within the notebook.

On Oct 26, 2022, at 13:40, Kyle Hall <hall...@gmail.com> wrote:

I have found this error during the course of my own work; it is a quirk of the Ingrid “seasonalAverage” function. It would be better to address in CPT-DL but you can write workarounds from within the notebook. 

Best
Kyle 

Benjamin Kwenda

unread,
Oct 26, 2022, 3:51:17 PM10/26/22
to Andrew Robertson, Kyle Hall, Celio Matuele, pycpt-esa
Dear Andy

I had suspected that this could be the source of the error but I wasn't sure because I wasn't getting a similar error for NDJ. And I also discovered that the individual forecasts from the various predictands were not giving me such an error but got it when it came to the MME.

Regards

Andrew Robertson

unread,
Oct 28, 2022, 8:58:46 AM10/28/22
to Benjamin Kwenda, Kyle Hall, Celio Matuele, pycpt-esa
Hi Ben,

Status update: I was able to solve the dates problem, but there is still an issue with missing data being generated in the deterministic hindcasts (though input datasets look fine). I’m still trying to track that down and will keep you posted.

Best,
Andy

Screenshot 2022-10-27 at 23.27.41.png

Benjamin Kwenda

unread,
Oct 28, 2022, 10:47:43 AM10/28/22
to Andrew Robertson, Kyle Hall, Celio Matuele, pycpt-esa
Great, thanks for the update! Will be waiting patiently.

Regards
Screenshot 2022-10-27 at 23.27.41.png
Reply all
Reply to author
Forward
0 new messages