ENTSO-E Transparency Platform Survival Kit

25 views
Skip to first unread message

Matteo De Felice

unread,
Jul 29, 2022, 9:12:21 AMJul 29
to openmod initiative
Dear all,
I took advantage of the summer to finally share some thoughts and data on the ENTSO-E Transparency Platform. I use its data very often and in the last months I have started saving all the daily snapshots of the AggregatedGeneration dataset in order to analyse when and how the data is updated.

A small markdown and two very tiny scripts are here: https://github.com/energy-modelling-toolkit/entsoe-tp-survival-kit
The used dataset (1.5 GB) is available on Zenodo in Feather format: https://zenodo.org/record/6939101

Feel free to comment and give me a feedback, I hope you can find it useful,
Best regards,

Matteo


François Lacombe

unread,
Jul 31, 2022, 11:10:48 AMJul 31
to Matteo De Felice, openmod initiative
Hi Matteo !

I've been wishing for times to write something about ENTSOE TP but didn't take the time to so far.
Thank you for providing such thoughts and tools.

Transparency platform is a great achievement that should be reinforced.
Some of its weaknesses and the amount of supplementary work they encourage downstream cause a little harm.

The short term continuous updates you mention in your readme is a direct consequence of 543/2013 policy.
In 16th article, §2 states that required information are published at after x or strictly after x. It encourages operators to provide data at their own pace (in France, every 15 minutes, in Switzerland, D+5)
We need a more robust protocol to expect data at precise times (and I really like every 15 minutes => electricitymap).

"The platform has been created with the aim of providing timely information to markets and not to provide a consistent and reliable source of information for analysts and scientists".
I may like to add "and from a policy perspective, not from data governance practice" to your readme.
I may also disagree about this strict opposition between market and scientists.
As any data usage, it improves data quality with consumers (including scientists and third parties) stumbling at every step, even if initially designed for markets.

Furthermore, the TP lacks of consistency in regard of the policy itself.
I currently spend my time discussing with several operators in different countries because of their lack of required data.
Some generation units are missing in this section: https://transparency.entsoe.eu/generation/r2/actualGenerationPerGenerationUnit/show, I just don't understand why.
That's really time consuming to compare between generation units list and this section, report to operators then (not to mention on my free time sometimes)
But that's really simple to do as well. ENTSOE should actually observe data, expect inconsistencies and automatically report them to operators.

I hope this initiative could make the use of platform better and free more data about generation actual data.

Best regards

François Lacombe


--
You received this message because you are subscribed to the Google Groups "openmod initiative" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openmod-initiat...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/openmod-initiative/8aa73395-2226-4555-b597-dbdee4d3759cn%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages