Upper limit on GDX file size?

[Dewayne Delk]

We have a model that creates a gdx file for each year of the run.  We typically run this model for 20 years, so we have 20 gdx files.  I would like to create one gdx file that contains all the years.   I have hit an issue with gdxmerge in that I am running out of RAM to do the merge as the gdx files get bigger -- since gdxmerge has to hold the files in RAM to do the merge. 

 

However, I could create a parameter which collects each year's information and then unload that parameter to a gdx file all at once.  Since I will have lots of parameters I might want to do this with, is there a physical lmit on the size of a gdx file?

 

Our current gdx file for one year is @100 Meg so we could be looking at a final gdx file size of about 2 Gig (note not all the variables/sets would be collected each year so likely the 2 Gig is the very largest size we would ever encounter).

 

Thanks,

Dewayne

 

Dewayne Delk
Senior Analyst
Global Coal Market Research

 

T  +1 410 295 4213
F  +1 410 295 4301
E  dewayn...@woodmac.com

 

Wood Mackenzie
One Park Place
Suite 575                       T  +44 (0)131 243 4400 
Annapolis, MD 21401    E  ene...@woodmac.com   
United States                 W www.woodmac.com

Global Offices

Australia - Brazil - Canada - China - India - Japan - Malaysia - Russia - Singapore - South Korea - United Arab Emirates - United Kingdom - United States

 

P Consider the environment and business costs. Please don't print this e-mail unless you really need to.

 

 

 

This e-mail transmission is strictly confidential. It is intended solely for the
addressee. If you are not the addressee, please delete the e-mail and notify us
by return email or by contacting our systems administrator on +44 131 243 4444
forthwith. 
 
Moreover if you are not the addressee, you must not copy, use, act or rely on,
disclose or distribute this e-mail. Wood Mackenzie Limited accepts no
responsibility or liability for any harm to your, or any third party's, system
or data caused by this e-mail or its attachments or any viruses or similar
contained in it.  
 
Wood Mackenzie Limited may monitor and record e-mails and their content passing
through its network.