International Energy Agency (IEA) using PyPSA for hourly modelling
108 views
Skip to first unread message
Tom Brown
Apr 24, 2024, 10:41:45 AMApr 24
to openmod list
Dear open-minded modellers,
The International Energy Agency (IEA) is now using open tools (PyPSA and
atlite in this case) for some of their analysis of hourly-to-annual
flexibility needs, see here:
https://www.iea.org/reports/managing-the-seasonal-variability-of-electricity-demand-and-supply
Some of this analysis already fed their flagship World Energy Outlook
2023, check out the documentation here:
https://iea.blob.core.windows.net/assets/ff3a195d-762d-4284-8bb5-bd062d260cc5/GlobalEnergyandClimateModelDocumentation2023.pdf
Maybe we need to start keeping lists of institutions *not* using open
source...
Jokes aside, the tools are one thing, it would be a great step forward
if the data used to feed the models were also published so we could get
full transparency.
Best wishes,
Tom
--
Tom Brown (he/him)
Professor of Digital Transformation in Energy Systems
Institute of Energy Technology
Technische Universität Berlin
Group website: https://www.tu.berlin/en/ensys
Personal website: https://nworbmot.org/
Visitor Address:
Einsteinufer 25 (TA 8)
10587 Berlin
The International Energy Agency (IEA) is now using open tools (PyPSA and
atlite in this case) for some of their analysis of hourly-to-annual
flexibility needs, see here:
https://www.iea.org/reports/managing-the-seasonal-variability-of-electricity-demand-and-supply
Some of this analysis already fed their flagship World Energy Outlook
2023, check out the documentation here:
https://iea.blob.core.windows.net/assets/ff3a195d-762d-4284-8bb5-bd062d260cc5/GlobalEnergyandClimateModelDocumentation2023.pdf
Maybe we need to start keeping lists of institutions *not* using open
source...
Jokes aside, the tools are one thing, it would be a great step forward
if the data used to feed the models were also published so we could get
full transparency.
Best wishes,
Tom
--
Tom Brown (he/him)
Professor of Digital Transformation in Energy Systems
Institute of Energy Technology
Technische Universität Berlin
Group website: https://www.tu.berlin/en/ensys
Personal website: https://nworbmot.org/
Visitor Address:
Einsteinufer 25 (TA 8)
10587 Berlin
Robbie Morrison
Apr 24, 2024, 12:00:18 PMApr 24
to Tom Brown, openmod list
Hi Tom, all
We need to talk about the almost complete EU Cyber Resilience Act (CRA)
as well. That statute is on its last loop through the legislative
process, now being translated into national languages before almost
certainly entering into law later this year.
The CRA divides the software production universe into manufacturers and
upstream software — with special considerations for open source
projects. Indeed, significant open source projects, who are not also
manufacturers, can — at their discretion — appoint software stewards to
assist with the required quality assurance processes when and where
their software contributes to manufactured products. These final
products will need to be carefully engineered and will duly receive a
European CE mark in recognition. Manufacturers are necessarily
for‑profit.
I've been trying to scope the various issues in relation to open source
energy systems frameworks and related activities. This is a space that
needs to be navigated with considerable care, particularly when
limited‑liability for‑profit companies are involved. For instance, Open
Energy Transition GmbH.
Even if not required by law to have suitable quality assurance systems
and processes in place, larger projects, such as the PyPSA codebase,
might like to formalize these processes in relation to the CRA, in order
to assist downstream manufacturers with their mandatory due diligence
activities.
It seems, based on early discussions, that providing a web‑interface to
your open source framework and model while remaining strictly non‑profit
should not trip the CRA. But if engaged in for‑profit consulting and
simultaneously supplying your client with a copy of your model will
likely trigger the CRA. Straight black‑box consulting, however, will
probably not — as no software‑related product is present.
I plan to blog about the intersection between the CRA and open modeling
on the openmod forum in the next month or so. So this is just a brief
heads‑up.
Also to note that the CRA is the first time open source software
development has been acknowledged in legislation anywhere in the world.
On the question of being easier to list intuitions not using open source
energy systems frameworks than otherwise, open source code makes up
about 80% of the software stack in most consumer products, including
vehicles. This is a revolution that has largely gone unnoticed and
unreported: the sharing of source code on an industrial scale.
Congratulations to the PyPSA crew and to other like‑minded projects for
their trailblazing in the context of transparent public policy support.
with best wishes, Robbie
---
Robbie Morrison
Schillerstraße 85, 10627 Berlin, Germany
We need to talk about the almost complete EU Cyber Resilience Act (CRA)
as well. That statute is on its last loop through the legislative
process, now being translated into national languages before almost
certainly entering into law later this year.
The CRA divides the software production universe into manufacturers and
upstream software — with special considerations for open source
projects. Indeed, significant open source projects, who are not also
manufacturers, can — at their discretion — appoint software stewards to
assist with the required quality assurance processes when and where
their software contributes to manufactured products. These final
products will need to be carefully engineered and will duly receive a
European CE mark in recognition. Manufacturers are necessarily
for‑profit.
I've been trying to scope the various issues in relation to open source
energy systems frameworks and related activities. This is a space that
needs to be navigated with considerable care, particularly when
limited‑liability for‑profit companies are involved. For instance, Open
Energy Transition GmbH.
Even if not required by law to have suitable quality assurance systems
and processes in place, larger projects, such as the PyPSA codebase,
might like to formalize these processes in relation to the CRA, in order
to assist downstream manufacturers with their mandatory due diligence
activities.
It seems, based on early discussions, that providing a web‑interface to
your open source framework and model while remaining strictly non‑profit
should not trip the CRA. But if engaged in for‑profit consulting and
simultaneously supplying your client with a copy of your model will
likely trigger the CRA. Straight black‑box consulting, however, will
probably not — as no software‑related product is present.
I plan to blog about the intersection between the CRA and open modeling
on the openmod forum in the next month or so. So this is just a brief
heads‑up.
Also to note that the CRA is the first time open source software
development has been acknowledged in legislation anywhere in the world.
On the question of being easier to list intuitions not using open source
energy systems frameworks than otherwise, open source code makes up
about 80% of the software stack in most consumer products, including
vehicles. This is a revolution that has largely gone unnoticed and
unreported: the sharing of source code on an industrial scale.
Congratulations to the PyPSA crew and to other like‑minded projects for
their trailblazing in the context of transparent public policy support.
with best wishes, Robbie
---
Robbie Morrison
Schillerstraße 85, 10627 Berlin, Germany
Peter Fairley
Apr 24, 2024, 12:09:11 PMApr 24
to Tom Brown, openmod list
Very cool.
The WEO documentation mentions use of the Open Source Spatial Electrification Tool (OnSSET) from KTH and the Aviation Integrated Model (AIM) from UCL.
Peter Fairley ⚡ Journalist
US +14152300075 / Canada & Apps +12505146248 / Portfolio / LinkedIn / Bluesky / Twitter
US +14152300075 / Canada & Apps +12505146248 / Portfolio / LinkedIn / Bluesky / Twitter
"What gets us into trouble is not what we don't know, but what we know for sure that just ain't so." - Samuel Clemens. Or Josh Billings. Or Will Rogers. Or ...
--
You received this message because you are subscribed to the Google Groups "openmod initiative" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openmod-initiat...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/openmod-initiative/b2c35341-244f-404b-8bc1-1935247c19c6%40tu-berlin.de.
Mark Howells
Apr 25, 2024, 6:31:10 AMApr 25
to Peter Fairley, Tom Brown, openmod list
Terrific news Tom et al (!!) Actually, the World Energy Outlook started with
OnSSET in 2014 (!) Cool to see how a comparative edge with respect to advanced development is very embracable ...
From: openmod-i...@googlegroups.com <openmod-i...@googlegroups.com> on behalf of Peter Fairley <peter....@gmail.com>
Sent: 24 April 2024 17:08
To: Tom Brown <t.b...@tu-berlin.de>
Cc: openmod list <openmod-i...@googlegroups.com>
Subject: Re: [openmod-initiative] International Energy Agency (IEA) using PyPSA for hourly modelling
Sent: 24 April 2024 17:08
To: Tom Brown <t.b...@tu-berlin.de>
Cc: openmod list <openmod-i...@googlegroups.com>
Subject: Re: [openmod-initiative] International Energy Agency (IEA) using PyPSA for hourly modelling
To view this discussion on the web, visit
https://groups.google.com/d/msgid/openmod-initiative/CAOgrh9_u4oW-VtaL9jdrgfUyCT8kZK26YvGJHQUUDCf3j7CzCQ%40mail.gmail.com.
Robbie Morrison
Apr 25, 2024, 8:00:38 AMApr 25
to Mark Howells, openmod list
Hello Mark, Tom, all
For those wanting some background, both OnSSET and PyPSA are covered on
wikipedia:
• https://en.wikipedia.org/wiki/Open_energy_system_models#OnSSET
• https://en.wikipedia.org/wiki/Open_energy_system_models#PyPSA
The Grenoble openmod workshop held recently in late‑March was,
interestingly, about 70% first time attendees. And one of the comments
I heard several times was that a keynote on the first day covering the
energy modeling landscape would be really useful, together with a short
primer on open source and open science. Worth remembering that not
everybody has been doing this stuff for years or decades.
Also, projects might want to add or update their wikipedia entries — as
above. Gentle hint! The page views on wikipedia far exceed any other
form of public outreach — with daily average views of around 25 and an
all‑in total of 67k so far.
While I'm here, a heads‑up for the excellent Polish Instrat webinar
yesterday, presented by Patryk Kubiczek (and don't be put off by the
length):
• PyPSA-PL-mini: an exploratory model of the Polish energy system
• 24 April 2024, YouTube (01:17:27)
• https://www.youtube.com/watch?v=PuIxfz5mg6k
The video shows how Jupyter Notebooks running on the Google Colab
platform (until your session expires, oops) can be used to distribute
your model and enable users to experiment and compare scenarios by
simply tweaking sliders. In addition, an excellent reminder of the
difference between model land and reality — and a nice treatment of the
subtle dynamics in real systems and how they might arise in your
simplified — in this case, intentionally very simplified — take on that
future reality.
with best wishes, Robbie
---
Robbie Morrison
Schillerstraße 85, 10627 Berlin, Germany
>
> FROM: openmod-i...@googlegroups.com
> SENT: 24 April 2024 17:08
> TO: Tom Brown <t.b...@tu-berlin.de>
> CC: openmod list <openmod-i...@googlegroups.com>
> SUBJECT: Re: [openmod-initiative] International Energy Agency (IEA)
> LinkedIn [8] / Bluesky [9] / Twitter [10]
>
> _"What gets us into trouble is not what we don't know, but what we
> know for sure that just ain't so." - __Samuel Clemens. Or Josh
> Billings. Or Will Rogers. Or ..._
>> Personal website: https://nworbmot.org/ [4]
> [11].
> [12].
>
>
> Links:
> ------
> [1]
> https://www.iea.org/reports/managing-the-seasonal-variability-of-electricity-demand-and-supply
> [2]
> https://iea.blob.core.windows.net/assets/ff3a195d-762d-4284-8bb5-bd062d260cc5/GlobalEnergyandClimateModelDocumentation2023.pdf
> [3] https://www.tu.berlin/en/ensys
> [4] https://nworbmot.org/
> [5]
> https://groups.google.com/d/msgid/openmod-initiative/b2c35341-244f-404b-8bc1-1935247c19c6%40tu-berlin.de
> [6]
> https://www.energy.kth.se/energy-systems/completed-projects/open-source-spatial-electrification-toolkit-onsset-1.940024
> [7] http://profile.fairley.ca/
> [8] https://ca.linkedin.com/in/peterfairley
> [9] https://bsky.app/profile/pfairley.bsky.social
> [10] https://twitter.com/pfairley
> [11]
> https://groups.google.com/d/msgid/openmod-initiative/CAOgrh9_u4oW-VtaL9jdrgfUyCT8kZK26YvGJHQUUDCf3j7CzCQ%40mail.gmail.com?utm_medium=email&utm_source=footer
> [12]
> https://groups.google.com/d/msgid/openmod-initiative/DB7PR04MB4409261162098CE3087A9533F8172%40DB7PR04MB4409.eurprd04.prod.outlook.com?utm_medium=email&utm_source=footer
For those wanting some background, both OnSSET and PyPSA are covered on
wikipedia:
• https://en.wikipedia.org/wiki/Open_energy_system_models#OnSSET
• https://en.wikipedia.org/wiki/Open_energy_system_models#PyPSA
The Grenoble openmod workshop held recently in late‑March was,
interestingly, about 70% first time attendees. And one of the comments
I heard several times was that a keynote on the first day covering the
energy modeling landscape would be really useful, together with a short
primer on open source and open science. Worth remembering that not
everybody has been doing this stuff for years or decades.
Also, projects might want to add or update their wikipedia entries — as
above. Gentle hint! The page views on wikipedia far exceed any other
form of public outreach — with daily average views of around 25 and an
all‑in total of 67k so far.
While I'm here, a heads‑up for the excellent Polish Instrat webinar
yesterday, presented by Patryk Kubiczek (and don't be put off by the
length):
• PyPSA-PL-mini: an exploratory model of the Polish energy system
• 24 April 2024, YouTube (01:17:27)
• https://www.youtube.com/watch?v=PuIxfz5mg6k
The video shows how Jupyter Notebooks running on the Google Colab
platform (until your session expires, oops) can be used to distribute
your model and enable users to experiment and compare scenarios by
simply tweaking sliders. In addition, an excellent reminder of the
difference between model land and reality — and a nice treatment of the
subtle dynamics in real systems and how they might arise in your
simplified — in this case, intentionally very simplified — take on that
future reality.
with best wishes, Robbie
---
Robbie Morrison
Schillerstraße 85, 10627 Berlin, Germany
On 25.04.2024 12:30, Mark Howells wrote:
> Terrific news Tom et al (!!) Actually, the World Energy Outlook
> started with OnSSET in 2014 [6] (!) Cool to see how a comparative edge
> Terrific news Tom et al (!!) Actually, the World Energy Outlook
> with respect to advanced development is very embracable ...
>
> -------------------------
>
>
> FROM: openmod-i...@googlegroups.com
> SENT: 24 April 2024 17:08
> TO: Tom Brown <t.b...@tu-berlin.de>
> CC: openmod list <openmod-i...@googlegroups.com>
> SUBJECT: Re: [openmod-initiative] International Energy Agency (IEA)
> using PyPSA for hourly modelling
>
> ** THIS MESSAGE ORIGINATED OUTSIDE LOUGHBOROUGH UNIVERSITY **
>
> ** Be wary of links or attachments, especially if the email is
> unsolicited or you don't recognise the sender's email address. **
>
> Very cool.
>
> The WEO documentation mentions use of the Open Source Spatial
> Electrification Tool (OnSSET) from KTH and the Aviation Integrated
> Model (AIM) from UCL.
>
> Peter Fairley ⚡ Journalist
> US +14152300075 / Canada & Apps +12505146248 / Portfolio [7] /
>
> ** THIS MESSAGE ORIGINATED OUTSIDE LOUGHBOROUGH UNIVERSITY **
>
> ** Be wary of links or attachments, especially if the email is
> unsolicited or you don't recognise the sender's email address. **
>
> Very cool.
>
> The WEO documentation mentions use of the Open Source Spatial
> Electrification Tool (OnSSET) from KTH and the Aviation Integrated
> Model (AIM) from UCL.
>
> Peter Fairley ⚡ Journalist
> LinkedIn [8] / Bluesky [9] / Twitter [10]
>
> _"What gets us into trouble is not what we don't know, but what we
> know for sure that just ain't so." - __Samuel Clemens. Or Josh
> Billings. Or Will Rogers. Or ..._
>
> On Wed, Apr 24, 2024 at 7:41 AM 'Tom Brown' via openmod initiative
> <openmod-i...@googlegroups.com> wrote:
>
>> Dear open-minded modellers,
>>
>> The International Energy Agency (IEA) is now using open tools
>> (PyPSA and
>> atlite in this case) for some of their analysis of hourly-to-annual
>>
>> flexibility needs, see here:
>>
>>
> https://www.iea.org/reports/managing-the-seasonal-variability-of-electricity-demand-and-supply
>> [1]
> On Wed, Apr 24, 2024 at 7:41 AM 'Tom Brown' via openmod initiative
> <openmod-i...@googlegroups.com> wrote:
>
>> Dear open-minded modellers,
>>
>> The International Energy Agency (IEA) is now using open tools
>> (PyPSA and
>> atlite in this case) for some of their analysis of hourly-to-annual
>>
>> flexibility needs, see here:
>>
>>
> https://www.iea.org/reports/managing-the-seasonal-variability-of-electricity-demand-and-supply
>>
>> Some of this analysis already fed their flagship World Energy
>> Outlook
>> 2023, check out the documentation here:
>>
>>
> https://iea.blob.core.windows.net/assets/ff3a195d-762d-4284-8bb5-bd062d260cc5/GlobalEnergyandClimateModelDocumentation2023.pdf
>> [2]
>> Some of this analysis already fed their flagship World Energy
>> Outlook
>> 2023, check out the documentation here:
>>
>>
> https://iea.blob.core.windows.net/assets/ff3a195d-762d-4284-8bb5-bd062d260cc5/GlobalEnergyandClimateModelDocumentation2023.pdf
>>
>> Maybe we need to start keeping lists of institutions *not* using
>> open
>> source...
>>
>> Jokes aside, the tools are one thing, it would be a great step
>> forward
>> if the data used to feed the models were also published so we could
>> get
>> full transparency.
>>
>> Best wishes,
>>
>> Tom
>>
>> --
>> Tom Brown (he/him)
>> Professor of Digital Transformation in Energy Systems
>> Institute of Energy Technology
>> Technische Universität Berlin
>>
>> Group website: https://www.tu.berlin/en/ensys [3]
>> Maybe we need to start keeping lists of institutions *not* using
>> open
>> source...
>>
>> Jokes aside, the tools are one thing, it would be a great step
>> forward
>> if the data used to feed the models were also published so we could
>> get
>> full transparency.
>>
>> Best wishes,
>>
>> Tom
>>
>> --
>> Tom Brown (he/him)
>> Professor of Digital Transformation in Energy Systems
>> Institute of Energy Technology
>> Technische Universität Berlin
>>
>> Personal website: https://nworbmot.org/ [4]
>>
>> Visitor Address:
>> Einsteinufer 25 (TA 8)
>> 10587 Berlin
>>
>> --
>> You received this message because you are subscribed to the Google
>> Groups "openmod initiative" group.
>> To unsubscribe from this group and stop receiving emails from it,
>> send an email to openmod-initiat...@googlegroups.com.
>> To view this discussion on the web, visit
>>
> https://groups.google.com/d/msgid/openmod-initiative/b2c35341-244f-404b-8bc1-1935247c19c6%40tu-berlin.de
>> [5].
>> Visitor Address:
>> Einsteinufer 25 (TA 8)
>> 10587 Berlin
>>
>> --
>> You received this message because you are subscribed to the Google
>> Groups "openmod initiative" group.
>> To unsubscribe from this group and stop receiving emails from it,
>> send an email to openmod-initiat...@googlegroups.com.
>> To view this discussion on the web, visit
>>
> https://groups.google.com/d/msgid/openmod-initiative/b2c35341-244f-404b-8bc1-1935247c19c6%40tu-berlin.de
>
> --
> You received this message because you are subscribed to the Google
> Groups "openmod initiative" group.
> To unsubscribe from this group and stop receiving emails from it,
> send an email to openmod-initiat...@googlegroups.com.
> To view this discussion on the web, visit
> https://groups.google.com/d/msgid/openmod-initiative/CAOgrh9_u4oW-VtaL9jdrgfUyCT8kZK26YvGJHQUUDCf3j7CzCQ%40mail.gmail.com
> --
> You received this message because you are subscribed to the Google
> Groups "openmod initiative" group.
> To unsubscribe from this group and stop receiving emails from it,
> send an email to openmod-initiat...@googlegroups.com.
> To view this discussion on the web, visit
> [11].
>
> --
> You received this message because you are subscribed to the Google
> Groups "openmod initiative" group.
> To unsubscribe from this group and stop receiving emails from it,
> send an email to openmod-initiat...@googlegroups.com.
> To view this discussion on the web, visit
> https://groups.google.com/d/msgid/openmod-initiative/DB7PR04MB4409261162098CE3087A9533F8172%40DB7PR04MB4409.eurprd04.prod.outlook.com
> --
> You received this message because you are subscribed to the Google
> Groups "openmod initiative" group.
> To unsubscribe from this group and stop receiving emails from it,
> send an email to openmod-initiat...@googlegroups.com.
> To view this discussion on the web, visit
> [12].
>
>
> Links:
> ------
> [1]
> https://www.iea.org/reports/managing-the-seasonal-variability-of-electricity-demand-and-supply
> [2]
> https://iea.blob.core.windows.net/assets/ff3a195d-762d-4284-8bb5-bd062d260cc5/GlobalEnergyandClimateModelDocumentation2023.pdf
> [3] https://www.tu.berlin/en/ensys
> [4] https://nworbmot.org/
> [5]
> https://groups.google.com/d/msgid/openmod-initiative/b2c35341-244f-404b-8bc1-1935247c19c6%40tu-berlin.de
> [6]
> https://www.energy.kth.se/energy-systems/completed-projects/open-source-spatial-electrification-toolkit-onsset-1.940024
> [7] http://profile.fairley.ca/
> [8] https://ca.linkedin.com/in/peterfairley
> [9] https://bsky.app/profile/pfairley.bsky.social
> [10] https://twitter.com/pfairley
> [11]
> https://groups.google.com/d/msgid/openmod-initiative/CAOgrh9_u4oW-VtaL9jdrgfUyCT8kZK26YvGJHQUUDCf3j7CzCQ%40mail.gmail.com?utm_medium=email&utm_source=footer
> [12]
> https://groups.google.com/d/msgid/openmod-initiative/DB7PR04MB4409261162098CE3087A9533F8172%40DB7PR04MB4409.eurprd04.prod.outlook.com?utm_medium=email&utm_source=footer
Reply all
Reply to author
Forward
0 new messages