Renewables columns in DISPATCHREGIONSUM

16 views
Skip to first unread message

Matthew Davis

unread,
Jul 21, 2025, 6:08:39 AMJul 21
to NEMOSIS-discuss
Hi,

I'm trying to understand the columns in DISPATCHREGIONSUM. AEMO's descriptions aren't entirely clear to me.

My objective is to find some metric for the total inertial generation (coal + gas + hydro + distillate). I know I can download DISPATCHLOAD, and join each generator's power to the list of fuel type of each generator, then aggregate by fuel type. But that table is huge, so working with it is a bit of a pain. (e.g. I have to manually register a 20GB swapfile on my laptop so that nemosis can convert the CSV to parquet.)

So I'm wondering whether DISPATCHREGIONSUM already has some metric for total wind + solar. The schema is here on AEMO's website and here in the nemosis wiki.

- DISPATCHABLEGENERATION - does this include or exclude semi-dispatchable generation (wind, solar) ? The name is dispatchABLE but AEMO's documentation says "dispatchED generation". So if a 100MW generator is dispatched at 70%, will that appear as 70MW or 100MW? 100MW is able to be dispatched, but only 70MW was dispatched.
- EXCESSGENERATION - What does this refer to? (AEMO's documentation says "MW quantity of excess", which is not particularly helpful.)
- INITIALSUPPLY and CLEAREDSUPPLY - I assume this is all scheduled generation (gas + coal + wind + gridscale solar etc)
- TOTALINTERMITTENTGENERATION - The column name sounds unambiguous, but AEMO's description is "Allowance made for non-scheduled generation in the demand forecast (MW)." I'm not sure what they mean by "Allowance". The reference to demand forecasts makes me suspect this is about only rooftop solar.
- UIGF - AEMO says "Regional aggregated Unconstrained Intermittent Generation Forecast of Semi-scheduled generation (MW)." - My guess is that this is a forecast of wind and gridscale solar (excluding rooftop solar). Is this correct?
- SEMISCHEDULE_CLEAREDMW = "Regional aggregated Semi-Schedule generator Cleared MW" - My guess is that this is the planned target at the end of the interval for all wind and gridscale solar (excluding rooftop solar, and excluding unscheduled wind). Is this correct?

So for my purposes, I guess CLEAREDSUPPLY - SEMISSCHEDULED_CLEAREDMW will give me the total (target) MW for the sum of gas, coal, hydro, distillate. Does that sound right?
Or do I need to also adjust by import export? (i.e. subtracting NETINTERCHANGE)

Thanks,
Matt

Josh Hurley

unread,
Jul 22, 2025, 9:15:27 AMJul 22
to Matthew Davis, NEMOSIS-discuss
Some thoughts below.


On Mon, 21 Jul 2025 at 18:08, Matthew Davis <davis...@gmail.com> wrote:
Hi,

I'm trying to understand the columns in DISPATCHREGIONSUM. AEMO's descriptions aren't entirely clear to me.

My objective is to find some metric for the total inertial generation (coal + gas + hydro + distillate). I know I can download DISPATCHLOAD, and join each generator's power to the list of fuel type of each generator, then aggregate by fuel type. But that table is huge, so working with it is a bit of a pain. (e.g. I have to manually register a 20GB swapfile on my laptop so that nemosis can convert the CSV to parquet.)
Consider using this method for a short time period to check if the below works 
Also, could check it against the fuel tab here: AEMO | NEM data dashboard

So I'm wondering whether DISPATCHREGIONSUM already has some metric for total wind + solar. The schema is here on AEMO's website and here in the nemosis wiki.

- DISPATCHABLEGENERATION - does this include or exclude semi-dispatchable generation (wind, solar) ? The name is dispatchABLE but AEMO's documentation says "dispatchED generation". So if a 100MW generator is dispatched at 70%, will that appear as 70MW or 100MW? 100MW is able to be dispatched, but only 70MW was dispatched.
 I interpret this as all generation
- EXCESSGENERATION - What does this refer to? (AEMO's documentation says "MW quantity of excess", which is not particularly helpful.)
Could be excess of demand or excess for the region 
- INITIALSUPPLY and CLEAREDSUPPLY - I assume this is all scheduled generation (gas + coal + wind + gridscale solar etc)
I take this as all generation 
- TOTALINTERMITTENTGENERATION - The column name sounds unambiguous, but AEMO's description is "Allowance made for non-scheduled generation in the demand forecast (MW)." I'm not sure what they mean by "Allowance". The reference to demand forecasts makes me suspect this is about only rooftop solar.
 That's my understanding but it could potentially include small amounts of non renewables
- UIGF - AEMO says "Regional aggregated Unconstrained Intermittent Generation Forecast of Semi-scheduled generation (MW)." - My guess is that this is a forecast of wind and gridscale solar (excluding rooftop solar). Is this correct?
This is correct 
- SEMISCHEDULE_CLEAREDMW = "Regional aggregated Semi-Schedule generator Cleared MW" - My guess is that this is the planned target at the end of the interval for all wind and gridscale solar (excluding rooftop solar, and excluding unscheduled wind). Is this correct?
Also, my understanding 

So for my purposes, I guess CLEAREDSUPPLY - SEMISSCHEDULED_CLEAREDMW will give me the total (target) MW for the sum of gas, coal, hydro, distillate. Does that sound right?
Or do I need to also adjust by import export? (i.e. subtracting NETINTERCHANGE)
This could work, otherwise DISPATCHABLEGENERATION for total generation; SEMISCHEDULE_CLEAREDMW for renewables; TOTALINTERMITTENTGENERATION for rooftop; BDU_CLEAREDMW_GEN / LOAD for batteries; then the remainder should be scheduled thermal generation
Or if using CLEAREDSUPPLY, may need to include NETINTERCHANGE as it includes import

Thanks,
Matt

--
You received this message because you are subscribed to the Google Groups "NEMOSIS-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nemosis-discu...@googlegroups.com.
To view this discussion, visit https://groups.google.com/d/msgid/nemosis-discuss/cbf0900f-3387-419f-ac9f-694dfe107579n%40googlegroups.com.
Message has been deleted

Matthew Davis

unread,
Jul 29, 2025, 5:38:21 PMJul 29
to NEMOSIS-discuss
Thanks Joshua, but it's still not clear to me.

> Could be excess of demand or excess for the region

What does that mean? Does excess refer to supply minus demand, i.e. net export adjusted for losses? Or over-generation compared to targets?

What do you mean by "all generation"? Typically AEMO excludes rooftop solar generation when talking about generation, unless stated otherwise. Are you including rooftop solar when you refer to "all generation"?

Thanks,
Matt

Josh Hurley

unread,
Jul 30, 2025, 9:22:46 AMJul 30
to Matthew Davis, NEMOSIS-discuss
Hi Matt,

EXCESSGENERATION
> Could be excess of demand or excess for the region
What does that mean? Does excess refer to supply minus demand, i.e. net export adjusted for losses? Or over-generation compared to targets?
> Reading again I am guessing this is supply minus demand for the region and would perhaps equal NETINTERCHANGE, or it could be compared to targets...

What do you mean by "all generation"? Typically AEMO excludes rooftop solar generation when talking about generation, unless stated otherwise. Are you including rooftop solar when you refer to "all generation"?
> I had thought TOTALINTERMITTENTGENERATION being 'Allowance made for non-scheduled generation in the demand forecast (MW)' included rooftop generators but doing a bit of searching I don't believe it does any more

Best to download a table and sum up a few of the columns to see what happens.

Cheers,
Josh

Reply all
Reply to author
Forward
0 new messages