GDX data files for message-macro baseline scenario

54 views
Skip to first unread message

ima1...@gmail.com

unread,
Apr 18, 2019, 1:37:48 PM4/18/19
to message_ix
Hi guys,

I am trying to run the baseline scenario in the message-macro model directly from GAMS, as I feel comfortable working with GAMS directly rather than Python or R. I have two questions:

1. Are the GDX data files to run the 'MESSAGE-MACRO_run' GAMS IDE file to completely reproduce your reference scenario results publicly available or the user is intended to gather/buy the necessary data files?

2. In case the complete GDX files that include all the necessary parameters for message-macro are publically available, is there a way to obtain them without Python or R? I am aware that you have the ixmp, which acts as a data warehouse, but I am not sure if it contains the data files to reproduce your baseline scenario using message-macro. I looked at your tutorials and it seems that ixmp is used to organize data, which the user should obtain from somewhere else, into the message format. I couldn't find a tutorial for retrieving the gdx files from your online databases to reproduce the baseline scenario in message-macro, but I might also be wrong and these data are confidential. 

Thanks.

Ibrahim

hupp...@iiasa.ac.at

unread,
Apr 23, 2019, 4:26:44 AM4/23/19
to message_ix
Hi Ibrahim, thanks for using MESSAGEix!

Re 1) - we are working towards making the data for the global MESSAGEix-GLOBIOM model publicly available, but we are not there yet. See https://github.com/tum-ewk/message_ix_south_africa for the first example of how we envision the workflow of a fully open MESSAGEix model - open-access manuscript together with an open-source repository containing all data and scripts necessary to replicate the assessment and build on it for future work.

Re 2) - As you correctly observe, the ixmp Python and R interfaces actually access a Java core in the background and connect to a database for storing scenario input and results. The ixmp framework does a lot of the housekeeping for you (data version control, etc.), writing the data plus additional mapping sets to gdx, and reading the solution from gdx into the underlying database. So working with a gdx file directly is not recommended, because this might not work as expected.

Best regards,
Daniel

ima1...@gmail.com

unread,
Apr 23, 2019, 5:22:54 AM4/23/19
to message_ix
Thanks Daniel. I am looking forward to the full database concerning the global MESSAGEix-GLOBIOM model. Meanwhile, I will have a look at the example on South Africa.

Ibrahim


On Tuesday, April 23, 2019 at 10:26:44 AM UTC+2, hupp...@iiasa.ac.at wrote:
Hi Ibrahim, thanks for using MESSAGEix!

Re 1) - we are working towards making the data for the global MESSAGEix-GLOBIOM model publicly available, but we are not there yet. See https://github.com/tum-ewk/message_ix_south_africa for the first example of how we envision the workflow of a fully open MESSAGEix model - open-access manuscript together with an open-source repository containing all data and scripts necessary to replicate the assessment and build on it for future work.

Re 2) - As you correctly observe, the ixmp Python and R interfaces actually access a Java core in the background and connect to a database for storing scenario input and results. The ixmp framework does a lot of the housekeeping for you (data version control, etc.), writing the data plus additional mapping sets to gdx, and reading the solution from gdx into the underlying database. So working with a gdx file directly is not recommended, because this might not work as expected.

Best regards,
Daniel

clara.o...@gmail.com

unread,
Apr 29, 2019, 4:11:06 AM4/29/19
to message_ix
Dear Ibrahim, 

if you prefer a non-scientific programming language workflow for creating message models, you might fing our data-to-ixmp (d2ix) framework helpful. You can find it on github (https://github.com/tum-ewk/d2ix) and read up on it on the published technical description (https://www.mdpi.com/1996-1073/12/8/1483).

Best regards,
Clara

Am Donnerstag, 18. April 2019 19:37:48 UTC+2 schrieb ima...@gmail.com:

Priyanka Laha

unread,
Apr 29, 2019, 4:44:12 AM4/29/19
to message_ix
Hi guys,
 To run Message_ix do I need to buy the license for GAMS? Is there is any other open source alternative?
Regards,
Priyanka

HUPPMANN Daniel

unread,
Apr 29, 2019, 6:35:06 AM4/29/19
to Priyanka Laha, message_ix
Hi Priyanka,

Thank you for using MESSAGEix!

Yes, you currently need a GAMS license to solve model instances larger than the free GAMS trial license. But we made an effort to ensure that the first set of tutorials are within this size limit so that every user can get started and play around with the framework to see its benefits.

We are discussing implementing an open-source alternative, but there is no timeline when this will be ready for release.

Best regards,
Daniel



Dr. Daniel Huppmann
Research Scholar, Energy Program (ENE)

International Institute for Applied Systems Analysis (IIASA)
Schlossplatz 1, A-2361 Laxenburg, Austria
hupp...@iiasa.ac.at
+43(0) 2236 807-572
www.iiasa.ac.at/staff/huppmann
> --
> You received this message because you are subscribed to the Google Groups "message_ix" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to message_ix+...@googlegroups.com.
> To post to this group, send email to messa...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/message_ix/CADseGNCZyxqEUE%3D5tXQ0r%2BpridpT25pT1CM0g5HnjQKOOb5%3Drg%40mail.gmail.com.
> For more options, visit https://groups.google.com/d/optout.



Priyanka Laha

unread,
Apr 29, 2019, 6:48:07 AM4/29/19
to HUPPMANN Daniel, message_ix
Hi Daniel,
    Thank you for your reply. Hope you get to an open source alternative soon. It will be very helpful for research students. 

--
Regards,
Priyanka
Indian Institute of Technology Kharagpur
Reply all
Reply to author
Forward
0 new messages