Latest forum discussions

EMI retirement and Electricity Authority data and insights hub

2025-09-29T03:05:50.5470000

The Authority will soon begin to decommission the EMI platform. A new ‘Data & insights’ hub on the Authority website will replace EMI and become the single place to go for electricity market data, tools, and insights on New Zealand’s electricity markets. See also a recent news item about the new Data & insights hub.

The Data & insights hub can be accessed directly from the menu items across the top of the Authority website.

Some EMI content is already available on the new Data & insights hub; we will migrate the rest across in the coming weeks:

APIs
Datasets
Instructions on how to programmatically obtain datasets

Other content from the website has been relocated to the new Data & insights hub:

Trading conduct reports – keep informed about how the markets are performing in our weekly and quarterly reports
Market reviews – explore in-depth reviews into unusual events or outcomes
Eye on electricity explainers – learn how electricity and the sector works to keep the lights on
Security of supply snapshots – understand how secure our electricity supply is every week.

Today we have disabled the ability to create an EMI login and we've begun to decommission the EMI forum. It will no longer be possible to create a discussion on the forum. We will also soon decommission the EMI mailbox.

If you have any feedback or suggestions on the ‘Data & insights’ hub, we would love to hear from you! Please email info@ea.govt.nz.

We will continue to update this post with further information and the timing of upcoming changes.

Missing NRSS Datasets

2025-09-09T01:47:19.6630000

Hi,

Does anyone know why NRSS is missing in August 2024?

https://www.emi.ea.govt.nz/Wholesale/Datasets/ForecastPrices/NRSS/2024

Cheers,

Isaac

Cleared energy and offer stacks

2025-08-21T21:55:10.7370000

2 Queries:

I looked at the Wholesale Price trend and the cleared offer stack for New Zealand on 21/08/2025. (Can't insert images because I get the message "This content is blocked. Contact the site owner to fix the issue."). For example, if I take a single TP, TP30, the demand has cleared in the $0-$10/MWh band for 5252.61MW demand. But, in the Wholesale Price trend, the price is $189.09/MWh. I find this difference in the cleared offers for every trading period, and I can't find the reason.
In the "Energy and Offer stack" 's More Information section, it is mentioned that I can drill down to the individual node level but can only work out the island-level data.

Full historical wholesale final prices for a single node

2025-08-18T01:02:12.1600000

I found that the dataset here covers dataset back to 2020 only.

Would you be able to guide me how to get full range datasets for historical wholesale prices?

Many thanks

Generation - Pukenui Solar Farm

2025-08-14T21:47:48.1970000

Poking around the volumes, generation datasets, I can't seem to locate anything for Pukenui Solar Farm (Far North Solar Farm's latest - node KOE1101). Any advice if it is meant to be there or not?

Resources for understanding the electricity trading market

2025-08-12T09:10:48.6170000

Hi, I'm working on a project & need to fully understand how trading works. I can see the trading files available at https://www.emi.ea.govt.nz/ - wondering if anyone can point me to some documentation to understand how they relate to each other, the rules for trading etc. Basically any kind of "this is how the market works" technical resource. Help much appreciated, thank you.

Where did the spans go?

2025-08-11T02:34:37.1630000

Heya! I remember a couple of years ago I was able to get really detailed transmission line span data, I came back looking for it for a new project and i am not able to find it anywhere in the datasets or anywhere else - Am I looking in the wrong place or is this gone now? Thanks

I also remember data that had information on all the nodes, distrubtor etc - I belive this was in the same place but also cant find it

Branch Constraints

2025-07-10T01:20:01.2930000

I was looking through the vSDP outputs folder and found the excelsheet documenting the branch constraints. File is named BrConstraintResults_TP

The headers of the table are:

DateTime BranchConstraint LHS (MW) Sense (-1:<=, 0:=, 1:>=) RHS (MW) Price ($/MWh)

Am I correct in thinking that the branch constraints are the capacities of said branches and the LHS, RHS are the direction of power flow (i.e. from Huntly to Benmore and vice versa). So that we can calculate the change in capacity consumption given a change in demand.

UFE report not updated

2025-07-03T10:03:53.2930000

Seems the UFE dataset doesn't go beyond September 2024.

I've been tracking networks with negative UFE as this impacts Solarzero custmers charged for losses on a volumetric basis rather than within the energy kWh rate.

Reconciled Injections and Offtake file is missing Island for HTU0331

2025-06-12T21:52:04.7800000

Hi,

the latest Reconciled Injections and Offtake file is missing the Island for PointOfConnection = HTU0331, are you able to supply new file?
https://www.emi.ea.govt.nz/Wholesale/Datasets/Volumes/Reconciliation/2025 file: ReconciledInjectionAndOfftake_202505_20250609_161909.csv.gz

Many thanks,

Mike

Demand forecasts - historical data

2025-06-11T04:24:14.1170000

Hi there,

Very much appreciate the work you do on keeping the databases up to date.

I'm looking for the NRSS and NRSL historical load forecasts. The data I can see appears to be only price in $/kWh - is that correct? And if so, please could you point me in the direction of the data that em6 is using to make it's "predicted node by load (MW)" graphs.

Thank you

Minor change to ICP API v2 result set

2025-06-09T02:53:53.7570000

Until today, the ICP API would return records for meter components that have been flagged as removed, yet the date field showing when the meter was actually removed was not in the result set. This had the potential to confuse API users into believing the meter remained installed and active when it was neither.

Such records are now being filtered out of the result set; all meter component records can reliably be assumed to pertain to currently active meters.

Cheers

Phil

GEM Mathematical Formulation

2025-05-16T00:33:23.6830000

Hello,

Kia Ora. I'm looking for the mathematical formulation document of GEM. Could someone please share or point to its location on the web?

Best Regards,

Naren

Reconciling differences in ClearedMW from Cleared Offers and offers obtained from SPD case files

2025-05-13T03:59:26.5300000

Hi team,

We've found a few instances of a plant having ClearedMW in the Cleared Offers file which is incompatible with the offers submitted for the plant for that given time period.

Example:

7/05/2025 12:00:00 pm
THI2201 THI1 cleared 59MW with an offer of one tranche of 25MW at 0.01 and 75MW at 5000.

Help with clarifying our misunderstanding here is much appreciated.

Regards,

Perry

Hedge Disclosure

2025-05-07T02:36:15.8600000

Hi. Are ASX traded contracts included in the Hedge Disclosures data? If they are, then how do we know which ones are ASX contracts as there's no column indicating if they are ASX traded contracts or not.

Final Price data for April 2025

2025-05-07T01:52:09.0970000

There doesn't appear to be any April 2025 final prices, March is there and May todate is there, just no April. Please see screen shot in attached file

Ashley Wall

NodalPricesAndVolumes data - Missing latest

2025-05-01T01:10:47.8070000

The NodalPricesAndVolumes data is missing the last 2 days and some (last run seems to be on 30/4 for 29/4 data which is partially there). Can someone please advise if this is expected?

Dispatch Notification Load

2025-04-27T23:23:00.0930000

I have some questions re Dispatch Notification Load (DNL):

Is anyone currently participating in the wholesale market via DNL?
If they are, would this appear in the 'Bids' wholesale dataset?
If so, is there any way to differentiate DNL vs DD in the bids data?

Thanks!

Bream Bay Node missing from Generation Trends report

2025-04-16T01:05:37.3830000

Kia ora,

The Generation Trends report looks to have not been updated to include the Bream Bay node, which with Meridian's new battery is a generation node once again. Could this be added to the report please?

Cheers, Keith

DST issue

2025-04-06T20:51:02.4400000

Hi team,

The data for the 06-04-2025 stops at TP6 in here https://www.emi.ea.govt.nz/Wholesale/Datasets/DispatchAndPricing/NodalPricesAndVolumes/2025

Could you please take a look and fix?

Regards,

Gislain

Offers data - IsLatestYesNo Column

2025-03-31T23:59:32.0300000

Hi team,

I'm currently looking at the offers data (https://www.emi.ea.govt.nz/Wholesale/Datasets/BidsAndOffers/Offers/) and am wondering how the IsLatestYesNo column is populated as I can find several instances where for a given plant/unit/TP combination there is no row with that column set to Y. Can someone advise how this works?

Regards,

Perry

Metered Data - General Info + Schema information

2025-02-02T18:41:28.4830000

Hello, new to the platform. Is there any intention to update the information that comes under Wholesale/Metered data?

Ideally I could get a bit of information about the schemas and how these datasets were created.

Water values

2025-01-29T20:47:33.2900000

I know I should embrace change but what happened to water values? Is it my imagination or did you start calculating and publishing them and then you just stopped doing them and removed them from the website? And can you tell me the story about them if you did?

EIEP14 questions

2025-01-26T04:28:46.6400000

Hi,

I'm looking for some clarification regarding EIEP14 format.

1) Register content code - spefication states that this field is conditional and can be empty (null) for non-fixed or non-delivered tariff components. I'm looking at case where the same tariff applies to more than one (or more commonly all) register content codes. Is it possible to leave this empty (null) for all register content codes? I assume it's not possible to use more codes in this field as it would clash with period of availability.
2) Period of availability - similar question as above - in case all register content codes with all possible availabilities are covered by this tariff, can this field be empty?
3) Is it possible to state multiple periods of availability for the same content code - eg. same tariff applies to CN15, CN16, CN17, CN18, CN19, CN20?

Any clarification would be appreciated.

Tom

Installed distributed generation "other" fuel type

2025-01-20T01:50:35.8100000

I'm looking to estimate the total number of distributed fossil generators, and wondered if there are any further insights into breakdown of fuel types in the "Other" catergory for installed distributed generation ICP count?

The "Other" fuel type catergory includes any process that doesn't fit neatly into another catergory including multiple generators of different fuel types.

There are a lot of ICPs (over 2700) with small (less than or equal to 10kW) generator capacity in this catergory and around 2200 are in Canterbury, and to a lesser extent in Marlborough and Auckland. Most of these are residential ICPs. Could many of the ICPs with "Other" distributed generation in Canterbury be solar, (the growth trend seems to match solar)?

Reconciled Injections and Offtake file is missing Island for WAI0331

2025-01-14T19:36:19.4470000

Hi,

the latest Reconciled Injections and Offtake file is missing the Island for PointOfConnection = WAI0331, are you able to supply new file?
https://www.emi.ea.govt.nz/Wholesale/Datasets/Volumes/Reconciliation/2024 file: ReconciledInjectionAndOfftake_202412_20250114_143228.csv.gz

Many thanks,

MIke

Pre-dispatch quantities

2024-12-15T22:47:58.6800000

Hello,

I am trying to understand how to get pre-dispatch data.

If I understand correctly, pre-dispatch prices and quantities are obtained after running the SPD model using pre-dispatch offers and bids data. (and other information)

Pre-dispatch prices seem to be available here: ForecastPrices.

Is the data for pre-dispatch quantities available?

Thank you,

Erwann

Energy shortfall and resolve in vSPD

2024-12-08T21:29:46.1000000

Hi,

In vSPD, if energy shortfall check fails then the model is resolved. Sometimes, after several resolves, the solver finds a solution but vSPD freezes when reading the solution. What is the purpose of the energy shortfall and what causes vSPD to freeze when reading the solution?

Regards,

Ziming

Are generation and demand on EA website forecast or actual?

2024-12-03T20:04:19.2530000

Hi,

In the nodal price and volume files at Electricity Authority - EMI (market statistics and tools), the rundatetime is usually one minute before the intervaldatetime. Does this mean that the generation and demand in a case are forecast instead of actual for the time period in the case?

Regards,

Ziming

Output GDX files for vSPD

2024-11-17T20:34:57.6900000

Hi there

On the main vSPD page it says "vSPD output is generated as a collection of GDX and CSV files". However, when I run vSPD in GAMS Studio, it appears that only CSV files are added to the Output folder. I require GDX files for more efficient analysis of the output data. Can you please indicate where the GDX output files are, or provide instructions on how they can be created?

Thanks

GDX files for Oct 21 and 22, 2024 not available

2024-11-07T22:55:03.4070000

Hi,

The gdx files for Oct 21 and 22, 2024 are not available for download on the webpage at Electricity Authority - EMI (market statistics and tools) I wonder when they will be availabe. Thank you.

Regards,

Ziming

"Try it out" not working for me

2024-10-30T03:28:47.3970000

Hi there,

Newbie here, trying to wrangle these APIs using Python. I wasn't getting much luck with my Python code, so I went here to try it out there:

https://developer.electricityinfo.co.nz/WITS/documentation/market-prices#/Market%20Prices/get_nodes

At the top of that page I signed into the client_id and client_secret as per what I have registered for OAuth on the developer portal.

Though I note that I didn't fill in "redirect_uris" parameter - what should this be?

I was trying to get a list of Schedules, here is the response

401:

 cache-control: max-age=0, no-cache, no-store  content-length: 12  expires: Wed, 30 Oct 2024 03:25:03 GMT  pragma: no-cache

This is not using my code but on the "Try it out" button, no additional parameters needed.

Can sombody tell me what I'm doing wrong?

Best regards,

Hemon

Period 48 missing in Demand Trends

2024-10-23T01:19:54.8000000

HI there

It appears the 48th period 23.30 - 00.00 is consistently missing in this report:

Can it be looked it?

Expected Water Values: Reservoir levels data

2024-10-02T21:26:11.2830000

Hi,

I am intested in the units for data in the "reservoirs.csv" file in the Expected water values dataset. The file itself does not detail any units, the dataset description (here) does note "reservoir levels"/"observed reservoir levels" , however it does not specifically mention any units in particular. (I have added some screenshots of the file I am refering to below).

I was wondering if you would be able to provide the units for the reservoir levels?

Additionally any context you can provide around the sourcing and nature of the reservoir levels data would also be much appreciated.

Cheers,

Matthew

Residential Consumption Trends Main Centres

2024-08-20T22:25:17.8100000

Hi,

Just a quick question - can you confirm that the household consumption figures published are net ie electricity imported (to household) less any household export from solar for example? Thanks

Question on Retailers' Obligations to Provide General Tariff Data

2024-08-06T21:55:56.6700000

Hi everyone,

I need some help regarding the clarification on the Electricity Industry Participation Code Amendment (Access to Retail Tariff Information) 2015.

When I asked a retailer for their general tariff data, they directed me to their website. However, the website requires entering a specific address to see tariffs for different regions.

Is this approach compliant with the amendment, or should the retailer provide a consolidated list of all tariffs without needing to input an address? Additionally, can the retailer charge a fee for providing this information if they argue a consolidated list of tariff data is not their normal format for providing tariff information?

Thanks for your help!

Best regards,

Evon

Batteries in Installed distributed generation trends

2024-07-29T06:05:02.3830000

I noticed that in the installed distributed generation trends report it now includes solar with and without battery. Can you please tell me how this is determined and therefore how accurate a measure this may be. Thanks

vSPD-online failing to create jobs

2024-07-23T14:10:09.8530000

Hello,

I tried twice to create a job in vSPD just for a couple of days without any override and both times the job failed to solve. I also noticed that this has been the case for all recent attempts from other users. Is there any particular reason for that?

Thank you in advance!

Bids/Offers and Final Energy Prices

2024-07-23T08:51:12.6200000

Hello,

I try to understand how the demand and supply schedule, hence the price formation, are related to the Bids and Offers files found at this link: Electricity Authority - EMI (market statistics and tools) (ea.govt.nz)

What puzzles me is that while for each trading period of each day a final price for every node (242 nodes) is calculated (as can be seen at Electricity Authority - EMI (market statistics and tools) (ea.govt.nz)), the respective Bids and Offers files do not contain buy and sell orders for all the nodes for the same day.

Moreover, the Bids and Offers files do not contain the same nodes, I assume this happens because generators submit offers for Grix Injection Points while buyers submit bids for Grid Exit Points. However, even if this is the case, how are prices formatted if we do not have both supply and demand for each node?

Thanks in advance.

ICP Connection API V2 is unavailable

2024-07-15T04:40:59.0470000

As at 16:37 15 July 2024 the developer portal at

https://emi.developer.azure-api.net/api-details#api=ICP-connection-data-v2

is returning a 500 Internal Server Error with

{
    "Code": 500,
    "Message": "API is currently unavailable to process this request. (R)"
}

Is there a status page we can consult to determine if the API is up?

Regards

Henry Maddocks

Wholesale category / Datasets Wholesale market volumes Reconciled injections and offtake

2024-07-10T21:19:39.0400000

The file ReconciledInjectionAndOfftake_202406_20240706_121016.csv contain missing value for Island for PointOfConnection: TAB0331, Network: HAWK. Can you take a look and resolve?

Thanks.

Demand override when working in vSPD 3.10 and GAMS

2024-06-25T01:54:38.5500000

Kia ora koutou, I'm new to vSPD and haven't used GAMS since the 90s but have been impressed with what I have seen so far workign with vSPD and GAMS in the last couple of months. I'm wondering if there is an example of the format for demand override GDX file? We exported i_tradePeriodNodeDemand into Excel, removed the columns for the nodes we weren't changing, changed the values for the nodes we were changing and then imported this data as ovrd_tradePeriodNodeDemand into a new GDX file. We pointed to this using vSPDsettings.inc but are getting errors:

Symbol not in GDX

I think I'm misunderstanding how to specify overrides so any help is very welcome. Nga mihi nui in advance for any help! Noho ora mai, Mike

Date selection issue in Market Share trends data

2024-06-23T21:17:34.0670000

When I select 1 Apr - 30 Apr 2024 in the market share trends dataset, it displays the data for 31/3/2024 aswell as the April data.

ICP API Offline (503)

2024-05-17T09:18:01.7000000

I just noticed the ICP aPI is offline: https://emi.portal.azure-api.net/

It returns:

Service Unavailable

HTTP Error 503. The service is unavailable.

Pricing 20240417 and 29 gdx file not available

2024-05-14T20:26:55.5700000

Hi Phil,

I wonder when the pricing 20240417 and 20240429 gdx files will be made available.

Regards,

Ziming

Data missing from reserve prices

2024-05-06T22:34:57.6400000

Hi,

I noticed this dataset is missing 4 datapoints.

Date                            Interval Number
Sunday, 2 April 2023            7
Sunday, 2 April 2023            8
Sunday, 24 September 2023       47
Sunday, 24 September 2023       48

cheers

jamie

Something wrong with the switch summary dataset

2024-04-29T03:06:24.9430000

Looks like the switch number is not correct today? Is there anything wrong with the dataset from backend? There is no way for around 10K ICP losses for all three big companies in Novemeber. Can someone look this up?

Residential consumption trends - time scale

2024-03-30T01:58:06.6830000

I recently accessed the Residential Consumption trends report, having not done so for a few years. As I recall, and the notes to the report suggest this is still possible, you used to be able to select at least "monthly" and "annual" as the time scale for the data. I cannot see a timescale choice.

I want annual data but cannot readily just aggregate monthly data as I am interested in the annual results for the various percentiles, and a monhly sum is not accurate for this purpose (for example adding up 12 months of 5th perentile consumptions does not give the 5th percentile annual consumption - it will almost certainly be too low.

Is the report stil supposed to support time scale choice?. If so, how do I make that happen? If not, the percentile reporting is inaccurate if aggregated.

Market Share Snapshot Breakdown by Regional Council not working

2024-03-28T02:41:18.0030000

When I use the market share snapshot report and try to breakdown by regional council for December it tells me there is no data available.

GAMS cloud service and Gurobi to solve vSPD 5.0

2024-03-27T19:45:50.3670000

Hi,

GAMS provides a cloud service Engine SaaS but it is a Linux system. Has anyone used this cloud service to solve vSPD 5.0? Also, has anyone used Gurobi solver instead of Cplex solver in solving vSPD 5.0?

Regards,

Ziming

ICP connection data v2 - Meter Type 'Undetermined'

2024-03-27T03:25:12.3600000

When attempting to access ICP connection data via the EMA API, some results return with Meter Type 'Undetermined'. I know that several of these are smart meters. What is the reason for the 'Undetermined' category?

Thanks for your help

Pricing 20240312 gdx file not available

2024-03-25T23:10:39.4570000

Hi EA,

The Pricing gdx file for 20240312 is not available for download. I wonder when it will be available.

Regards,

Ziming

Trading: Spot verses Forward Contract

2024-03-18T21:33:21.8870000

Hello,

Is there anywhere where I can see what percentage of supplied power is purchased as a forward contract and what percentage is purcahsed on the spot market?

Data Dictionary - description of data available

2024-03-15T07:40:59.4900000

Hi,

Do you have a data dictionary / document describing what data you have available including a description of each of the data elements and their data types? Also the frequency of when the data is updated and made available would be useful. We are interested in both actual/historical data and forecasts. Looking for a description of the data you have available in the wholesale datasets and also any other data you would have available that we'd be able to access automatically via a download script or via a tool such as Azure Storage Explorer.

Thanks in advance for anything you can provide.

Regards

Mark

New dataset – ICP share by MEP and trader

2024-03-05T19:23:51.4670000

A new retail dataset has been published in the ICP and metering details collection. It will be updated monthly, soon after the 10th business day of the month.

The market share by MEP and trader dataset presents the count of ICPs by MEP and trader for each network reporting region. It also breaks down the ICP count by residential, commercial, and industrial connections.

The Metering snapshot report on EMI shows market share by one of four entities: MEP, MEP parent company, Trader, and Retail parent company. This new dataset contains the crosstab of two of those entities – MEP and Trader. The notes on the 'More information' tab of the Metering snapshot report can be consulted for greater detail about this dataset.

Data missing in Aug 9, 2021 gdx file final version

2024-02-19T02:56:28.2670000

Hi,

In the Aug 9, 2021 gdx file final version, the data after 6pm is missing. Will this file be updated?

Regards,

Ziming

access issues with EMI datasets

2024-01-28T20:11:22.7500000

Morning,

I'm having issues accessing EMI datasets using the latest SAS key in the below post ...

New access arrangements to EMI datasets (retirement of anonymous FTP) (ea.govt.nz)

"https://emidatasets.blob.core.windows.net/publicdata?sv=2021-10-04&si=exp2024-03-31&sr=c&sig=fH6rIJPLMPtmt37cC6CZk44UDLs0E0C9Sy695KQCxlo%3D"

am getting ...

{"The remote server returned an error: (400) Bad Request."}

Has been working fine for a long time until Wenesday last week.

Could you advise ?

Thanks in advance

Hydro storage information

2024-01-18T01:58:12.3700000

Hi, is there a dashboard with national hydro storage - ideally by island and then by catchment - relative to long run averages.

Thanks

Chris

2023 PowerFactory cases have been uploaded

2023-12-12T02:42:13.0100000

The Power Systems Engineering team at Transpower have supplied new 2023 PowerFactory case files. The updates are described in the 202311 PDF file.

Report Q - Generation output by plant - how to identify unique plant, understand duplicates?

2023-12-04T03:47:25.4630000

I am seeking some clarification in how to analyse the generation output by plant datasets (https://www.emi.ea.govt.nz/Wholesale/Datasets/Generation/Generation_MD). Which columns need to be combined to uniquely identify the singular plants data?

Is it the unique combinations of a Network code, generator code, and POC? Ive included some example combinations below from looking at the dataset 202310_Generation_MD to which I was hoping to get clarification around please.

1. at TWC2201, there is one NW code TRPG, and a dataset for each gen code te_rere_hau, and twf_3. This looks to example that the POC cannot be the sole identifier and that this is therefore two different generation plants that inject as the same NSP?

2. at LTN2201, there is one NW code MRPL, but two data sets for the same gen code turitea. One with a fuel/tech type of wind, one with fuel/tech blank. The kWh data for each set appears identical - is this an error, or is this correct and the two datasets should be combined for the turitea total? (Is one of the sets for turitea north and one for turitea south?)

3. at ARI1102, there is one gen code arapuni, that has two network codes MRPL and POCO. One of which data set appears to be all 0 kWh. Is this the same generation plant and can inject across two networks at the same POC? Or is this a case of a change in network company historically, the old remains and will report as zero?

Much appreciated

Laura

Missing wind farms from Generation output by plant: YYYYmm_Generation_MD.csv files

2023-12-01T00:56:58.7930000

The files YYYYmm_Generation_MD.csv files are missing generation data from the following wind farms:

GOR0331_KWD0 HRP2201_HRP0 WIL0331_MCK0 HWB0331_MAH0

The em6 API is returning SCADA for these wind farms yet they do not appear in the EA EMI .csv files.

Pricing_20231025.gdx not available

2023-11-12T19:57:40.9700000

Hi,

I wonder when the Pricing_20231025.gdx file will be available on the daily GDX files webpage.

Regards,

Ziming Guan

Generation output by plant and capacity factors

2023-10-16T00:50:46.0770000

Hey all,

I am working with the wholesale dataset "Generation output by plant". Right now I am trying to calculate a capacity factor for the geothermal generation. For that I am also using the data provided by the MBIE on the amount of capacity installed. For different years this gives me a capacity factor of about 82%. However, it should be more like 90-95%, shouldn't it?

Is the discrepency coming from curtailed geothermal production or what am I missing? Could someone point me in the right direction or explain the dataset to me?

Cheers,
David

Sensitivity of price to changes in load

2023-10-12T00:29:01.9730000

Hi EMI team,

Recently you have released new Wholesale report "Sensitivity of price to changes to load", https://www.emi.ea.govt.nz/Wholesale/Reports/O5XQOI?_si=v|3

It is a great piece of information but I couldn't find a way to download historic dataset, only data for one day.

Can you please help to get access to historical dataset? Is there a way to download it through Azure Storage Explorer?

Thanks, Olga

New version of vSPD and new daily GDX files

2023-10-09T23:58:28.8200000

Today we are starting the roll out of a substantial update to vSPD and its associated GDX files.

Since the advent of real-time pricing on 1 November 2022, a time-weighted average of the dispatch prices is used to calculate the price that each trading period is settled on. This occurs for both energy prices by node and reserve prices by island. Dispatch prices are typically derived from the RTD SPD schedules. But the PRSS schedule can also be the source of dispatch prices, especially for the first few minutes of a trading period.

Post 1 Nov 2022 daily GDX files

We currently produce and publish a GDX file for all PRSS and RTD case files. But not all PRSS and RTD schedules give rise to prices that are published as dispatch prices, which then go into the calculation of final prices. When we learn which schedules feed into final prices, we merge them into a single, daily GDX file and, starting today, are publishing them in folders by year going back to 1 November 2022. The daily GDX files will be published early each morning and will pertain to all trading periods from the preceding day, ie the file called Pricing_20231020.gdx will pertain to 20 October 2023 and will be published early on 21 October.

In a few weeks' time, we'll stop publishing the RTD and PRSS GDX files but will continue to publish all RTD and PRSS case files.

The new daily GDX files will only work with vSPD v5.0.0.

vSPD v5.0.0

In the next day or two, we will publish version 5.0.0 of vSPD. This release will represent a major update of vSPD that features many new innovations to simplify the replication of prices post real-time pricing and the undertaking of counterfactual analyses. Version 5.0.0 will only work with the daily GDX files dating back to 1 November 2022.

Version 4.0.0 will be deprecated as it will no longer serve any useful purpose. We made it available for users that wanted to solve vSPD following the start of real-time pricing but couldn't wait until we released v5.0.0. Version 4.0.0 requires the individual RTD or PRSS schedules, which, as noted above, we are soon going to stop publishing.

For analysis of dates preceding 1 November 2022, vSPD v3.1.0 should be used along with the old final pricing GDX files.

In the coming weeks, we will publish some Python code that allows an override GDX file to be created so that counterfactual experiments can be run using vSPD v5.0.0. Thereafter, we will work on a publicly available tool to replace vSPD online for dates since 1 November 2022.

API for SmartHome Load Curtailment Automation

2023-09-20T09:42:54.2170000

Hi all,
I'm looking to develop something for the NZ smart home community to use, that could respond to the grid when it is under stress. A way for smart homes to trigger home automation which shuts off non-essential systems in their homes when EMI/grid operators need it. i.e. stop EV charging, pool heating etc.
Something like the old ripple control system but for smart homes/modern times.

It seems that currently, the practice is to use social media and press asking people to reduce power. e.g. https://www.stuff.co.nz/business/132722172/transpower-says-power-supplies-tight-as-cold-snap-moves-up-country

Wondering if the the EMI's APIs are suitable for this, is there a better alternative or is there something already planned that would best provide this?

Thanks

Power ratings of transmission network in NZ

2023-09-15T09:33:22.4670000

Is there a consolidated document which enlists the power ratings of various transmission lines (all voltages or atleast 220kV and above) as shown below for both North and South Islands?

Best,
Ashish

Data on bidding price by various generators - daily offer stack

2023-09-14T09:39:34.5600000

Hello Community admins and members,

Where can I find the daily offer stacks with price bands (with technology type) by trading periods as shown in the EA trading conduct report on Figure 14, Page 10 here

Thank you

Best,

Ashish

Open source alternative to GAMS/vSPDonline

2023-08-28T23:01:07.4930000

Hi,

I've been using vSPD-online in recent weeks. Whilst it is a useful tool and allows running of simple counter-factuals, I find that the interface is a little limited and it is also hard to automate market simulations. I understand you make all the GDX files available which allows you to "self-host" and run models yourself. However, this relies on having the propietary tool GAMS, which costs several thousand $ for a commercial license.

Anyway, is there a way to run GDX files and SPD models using an open source alternative? This would be very beneficial to industry consumers.

Issue applying override

2023-08-17T22:52:58.1130000

Hi there,

I'm a newbie vSPD user trying to create an override for a hypothetical solar injeciton at HLY220 node. Attached is the CSV file I used to create the override.

The most recent job I tried to use it on is called "try try again". When doing the run it appears to completely ignore the new offers, so clearly I'm missing something obvious. Any help is appreciated.

Units of embedded generation

2023-08-07T13:41:06.1200000

Hello everyone,

I have just started querying EMI data.

Specifically I'm looking at the embedded generation data set

I only have a basic understanding of power markets so I am wondering what are the units for the values shown?

Is there any place where I can find this kind of information (i.e. metadata about the data sets) for future data sets?

Thanks in advance and kind regards

PS: Congrats to the team who built the data access system. It's great compared to what you find in other countries

Hydrological modelling dataset (HMD) - clarifications

2023-07-30T22:56:38.8630000

I would first like to thank EMI for the provision of the HMD dataset.

When I was having a look at this data for one of my projects, I came up with a few questions:

1. For Lake Taupo inflow, there are 5 different datasets with different site numbers - Actual, Natural, Linnear, Non linear and Opearational. This is also the same for a few different flows. Am I right in assuming that all the different datasets represent the same flow using different methods? If that is the case, is there a most up-to-date method which EMI suggests using?

2. As I was trying to understand how the data was put together, I did some analysis on Lake Ohau (this flow was chosen because it had inflow, outflow, storage, and spill data). Below is a small sample of the analysis:

The flow data is in reference to the left axis while the m3 quantity is along the right axis. The inflow is very closely correlated to the outflow. Also, the difference between the two has remained the same throughout the analyzed period at 12m3/s. Further, the spill is remaining the same at around 1.22 Mm3. Given these data, how is the storage data changing? When eyeballing it, it seems like when the inflow is increasing, there is an increase in storage (timeshifted by a few periods) but there is also an increase in outflow by the same amount. Even the spill data is not exactly explaining the change. Can someone please clarify this?

3. I went through this thread for understanding how Specific_Energy is derived. There seem to be two different types of specific energy data - Scheme and Single stage. What is the difference between the two?

Thanks in advance.

Cleared offers - energy, FIR and SIR - now available on EMI

2023-06-22T03:35:11.8730000

Cleared offers extracted from RTD SPD case files are now available on EMI.

A new file will be published at about 7:00am each morning containing all of the RTD cleared offers from the preceding day, midnight to midnight.

Adding RunDateTime to nodal price and volume data files

2023-06-14T20:48:27.1530000

Next week we will modify the nodal price and volume CSVs published on EMI datasets by adding the SPD case RunDateTime.

The new column will appear following IntervalDateTime and before CaseTypeCode.

This is necessary because there is no other way to know the chronological order of the cases when there is more than one RTD case per 5-minute interval.

Please let us know if you have automated processes to handle these files and therefore require a greater lead time before we make this change.

FTR obligation price map

2023-06-14T20:34:54.1030000

We recently prepared a visualisation of FTR obligation prices.

The visualisation can be found on our Tableau Public site It is our intention to recreate this report on EMI at some point in the future.

Current generation fleet dataset

2023-05-29T22:51:27.4430000

Kia ora koutou,

I was looking for the most recent, up-to-date xls of the generation fleet. I used to be able to find it on the EA website via google. I think the version on EMI is from pre-2020:

https://www.emi.ea.govt.nz/Wholesale/Datasets/Generation/Generation_fleet/Existing/

Please could you update with the current version?

Thanks!

New EMI report: scheduled generation outages

2023-05-07T23:46:05.6430000

We've published a new report that shows scheduled generation outages by generation type, participant and island. See also the news item here.

Consumer Plans and Prices Extract

2023-05-03T22:41:17.1370000

I noticed the really useful discussion on prices recently here but it doesn't seem to have exactly what I'm looking for. Is there a periodic data extract made available for all of the prices and plans each electricty provider in NZ offers? I could scrape their websites, but that seems wasteful. Looking to map from a given ICP to all the available prices and plans that are on offer at that time to the consumer.

Thanks in advance

Stephen

https://ahiko.nz

NodalPricesAndVolumes - Data issue

2023-05-03T20:47:48.7100000

It looks like we only got half a day of data for 02/05/2023 and no data for 03/05/2023 with this dataset. Is there an ongoing issue here?

EMI datasets - Access via a storage client (Azure Storage Explorer)

2023-04-03T21:56:33.6230000

Re: the below, i may have missed it elsewhere, but is there an updated SAS as the below one has expired ? (Thanks in advance)

2. Access via a storage client (Azure Storage Explorer)

If you’d like to browse through the datasets as you’ve previously done with an FTP client, you can now use Azure Storage Explorer and connect to EMI datasets using this Shared Access Signature URI:

https://emidatasets.blob.core.windows.net/publicdata?sv=2018-03-28&si=exp2019-12-31&sr=c&sig=RgEr3fnUCRgCg%2FGc%2BYus0OJHXpWQBZvUPpIDxsOtJQE%3D

https://emidatasets.blob.core.windows.net/publicdata?sv=2018-03-28&si=exp2020-12-31&sr=c&sig=7AB6rWqiWNl87RgAck6U9oOUMhmp6EOZXm1mfAbq%2Bvc%3D

https://emidatasets.blob.core.windows.net/publicdata?sv=2019-12-12&si=exp2022-03-31&sr=c&sig=m2kSNI61k%2BmyHl1O84EdFlaXbgRMve%2BNByuDIzoMMXg%3D

Edit: Updated SAS URI
https://emidatasets.blob.core.windows.net/publicdata?sv=2020-08-04&si=exp2023-03-31&sr=c&sig=TmXW68yI9Z2PUnheGD6PAy3c8cTdoug1tY7UrDMWuVE%3D

Network Pricing Schedules

2023-03-26T21:52:55.1370000

I would like to access nationwide pricing schedules but it seems this is not published in a centralised format.

Is the only way to get this information to go to individual EDB's and extract from their website disclosures or are these all filed and accessible somewhere?

Thanks

Clive

Where and how to source comprehensive price, dispatch, CO2 intensity and reservoir data?

2023-02-09T01:37:20.3830000

Hi everyone
I am very new to New Zealand electricity grid and wholesale market and was tasked to collect and analyse as much as possible NZ spot/forward price, dispatch, carbon intensity and hydro reservoir data without having to use paid data suppliers and leveraging as much as possible of public domain and real time and up to date information.
Would anyone be able to help poiting me to the exsiting datasets, tools and/or dashboards within or outside EMI's portal?
Thank you so much in advance for your attention and help!
Kind regards,
Gabriel

Data on daily offer stack

2023-01-31T07:58:16.5470000

Hello Community admins and members,

Where can I find the daily offer stacks with price bands (with technology type) by trading periods as shown in the EA trading conduct report on Figure 14, Page 10 here

Thank you

Best,

Ashish

Industrial gas price vs Wholesale gas price

2023-01-30T02:03:28.8130000

Hi Community admins and members, May I understand the key difference between industrial and wholesale gas price data published by MBIE? Also, what gas price typically applies to large end users/industrial end users? Is it wholesale or industry gas price? Thank you Best, Ashish

Date format change in metered data files (from march 2022)

2023-01-29T21:54:57.8670000

Hi there,

Interested to understand the rationale for change of date format for the metered data from March 2022 onwards.

Prior to then it was DD/MM/YYYY, and after it was YYYY-MM-DD.

Data availability on active storage levels for lakes in New Zealand

2023-01-27T04:20:21.4630000

Hi Community admins and members,

EA's trading conduct report shows storage levels for the years 2021 and 2022 here

I am wondering if data on active storage (Mm3) and lake level(m) for the years 2021 and 2022 are available? I can only view the data for these two indicators made available for lakes upto end 2020 on the EMI platform.

Thanks in advance!

Best,
Ashish

Duplicates in SPD case files

2022-12-14T05:26:19.6330000

I'm trying to collate the 30-minute pricing data at each node, and I've noticed that on occasion the same INTERVAL is present in more than 1 SPD case file - as an example, between cases 61012022121905054 and 61012022121905055. I'm just hoping to clarify how to correctly calculate the 30-minute settlement price from individual cases, particularly where there are two cases for the same INTERVAL, or, conversely, where there are no cases for a 5-minute INTERVAL.

Cheers,

Jordan.

accumulated north island and south island data

2022-12-05T10:11:10.2170000

Hi there again,

Is there accumulated north and south island pricing data available in one file per month or day ?

If not, then what is the best way to generate this data from the datasets ?

data availability for historic demand

2022-12-01T01:36:47.8230000

Hi there,

I have found the monthly historic pricing data for each island particularly useful - thanks. This is the link I was using :

https://www.emi.ea.govt.nz/Wholesale/Datasets/DispatchAndPricing/DispatchEnergyPrices/2022

I am after the demand data which matches the pricing data. Is that available in the datasets ?

thank you

Matt

New DIgSILENT PowerFactory case files now available

2022-11-03T03:04:36.3300000

The Power Systems Engineering team at Transpower have supplied updated PowerFactory case files. The updates are summarised in the 202210 PDF file.

Real-time pricing on 1 November 2022 - impact on EMI reports and datasets

2022-10-13T01:53:53.3330000

Real-time pricing (RTP) goes live on 1 November 2022. The implementation of RTP will necessitate changes to a lot of the data received, processed, and published by the EMI team. If you are a regular user of Wholesale reports or Wholesale datasets, you might want to keep an eye on this discussion for regular updates over the next few weeks.

Changes are going to be made with very little notice. Some reports or datasets may be stopped altogether on 1 November and restored in the following days or weeks.

vSPD and GDX files

The vSPD model is undergoing substantial change and testing in readiness for real-time pricing. A new version of vSPD will very soon be made available. It will not be backward compatible with the current version. After 1 November 2022, if you want to run simulations that span 30 Oct / 1 Nov 2022, you’ll need to use both versions of vSPD, i.e. the current and the new versions.

GDX files are currently produced from the ex post final pricing (FP) SPD cases. FP GDX files will cease to exist after 1 November and in their place GDX files will be produced from the real-time dispatch (RTD) cases. There will be an indeterminate number of these per day but typically there will be well over 200. These new RTD GDX files will be published beginning 1 Nov. At some point after 1 November 2022, we will change the GDX processing to package all RTD GDXs for a day (midnight to midnight) into a single GDX file, which will be published early in the morning (2-3am’ish) of the following day. The daily RTD GDX file, when we start publishing it, will be approximately six times larger than the current FP GDX files.

Dispatch and pricing

A new wholesale dataset folder will be created called DispatchAndPricing. Beginning on 1 November, the following datasets will be published into subfolders of this new folder as follows:

DispatchEnergyPrices – Dispatch energy prices: the ‘new’ real-time energy prices that will replace the current real-time (or 5-min) prices published here. The current real-time prices will cease to be produced from 1 Nov.
DispatchReservePrices – Dispatch reserve prices: the 'new' real-time reserve prices.
GDX: the RTD GDX files as described above.
CaseFiles – RTD case files: the RTD case files.
InterimPrices – Interim prices: from 1 November 2022, interim prices will be calculated as a time-weighted average of the 'new' real-time prices. Interim prices will pertain to the entire trading period.
FinalPrices – Final prices: if no pricing error claim is lodged pertaining to interim prices, then interim prices will be declared final by 2pm the following business day. Whereas interim prices will be published by trading period, i.e. one file per trading period, final prices will be published by day, i.e. one file per day containing prices for all trading periods from the previous day.

vSPD online

vSPD online will be disabled on 1 November until such time as we get it rebuilt to work with both the new and old versions of vSPD.

Final pricing dataset

The final pricing dataset will cease to be populated beginning on 1 November 2022. The entire folder will likely be archived within the Dispatch and pricing folder described above.

New report - carbon emissions from generation?

2022-09-27T03:41:24.4900000

Hi team,

I see EMS publishes total carbon emissions from generation, and average emissions per MWh every half hour. I would have thought this was something you could calculate and offer for free in a report, using some constant, generic emissions factors like those in GEM (Rankine gas/coal fuel switching makes things a bit trickier).

Is this something you've considered, or that is available somewhere already?

Thanks!

James

OTA minus BEN price chart not working

2022-09-22T23:12:51.6370000

Hi Team

I am getting "No results" when selecting this option on forward markets chart ...

https://www.emi.ea.govt.nz/Forward%20markets/Reports/0NQPKT?DateFrom=20210923&DateTo=20220922&Duration=STR&Maturity=ALL&_rsdr=L364D&Location=OTAMBEN&_si=v|3

Thanks

Shane

Three wholesale market price APIs to be decommissioned on 21 October 2022

2022-09-20T20:19:30.5100000

Please be advised that three of the four Wholesale market price APIs are to be removed from service on 21 October 2022. Specifically, the three APIs to be decommissioned are:

Forecast NRSS prices
Forecast PRSS prices
Real-time prices.

The Real-time dispatch API and the ICP connection data v2 API will continue to operate just as they do today.

Users interested in obtaining wholesale market prices via an API can sign up to the WITS APIs at https://developer.electricityinfo.co.nz/WITS.

NZX is contracted by the Electricity Authority to be the Wholesale Information Trading System (WITS) manager. Earlier this year, the WITS manager stood up several APIs that make the EMI APIs somewhat redundant. Indeed, the only reason the EMI team at the Authority released its wholesale price APIs several years ago was because users were demanding such tools and none existed elsewhere. That is no longer the case.

The timing of this API decommissioning coincides with a programme of work we are currently undertaking to refactor our data ingestion processes to align with the system changes being introduced with the go-live of real-time pricing on 1 November 2021.

ICP connection data API - not available, 19 Sep 2022

2022-09-18T22:46:18.2100000

The ICP connection data API seems to have gone belly up this morning - from around 8am perhaps. I am getting errors such as: {"Code":500,"Message":"API is currently unavailable to process this request. (R)"}

Programmatic access to Wholesale Generation data

2022-08-11T23:34:02.4330000

Hi,

I'm trying to figure out how to access the wholesale generation by plant data through a python programmatic interface, but the link referring to python getting started appears to be broken on this page.

Any chance someone could post a simple example of how to access the data with python?

Cheers

Jeff

Process heat - electrification vs biomass

2022-08-08T01:34:50.4130000

I'm interested in tracking the switch from fossil fuels to either electricity or bio-mass in process heat. I have noticed that biomass is included in the distributed generation trends dataset. Does anyone know what this would cover?

In particular, say Fonterra or some other company replace a coal boiler with bio-mass; would this be included in this data or does it specifically need to be used to generate electricity (which would then be subsequently used in some process)?

Bonus question: If this data set does not track such conversions, does anyone know of a source that does?

Generation output by plant

2022-07-20T08:37:11.3930000

Hi, I'm wondering when the Generation output by plant dataset for June will become available:

https://www.emi.ea.govt.nz/Wholesale/Datasets/Generation/Generation_MD

Wholesale price APIs to be decommissioned

2022-06-13T06:06:04.1770000

Hi all

This is a heads up that our wholesale market price APIs will soon be decommissioned. The WITS team have announced that they are going live with publicly available APIs - see announcement below.

We will take a good look at the WITS offering and make sure that everything we pump out via our APIs is available via the WITS API. If it is not, we will keep ours going. We will email all of our API subscribers and draw their attention to this announcement. We will give plenty of time for subscribers to our wholesale price APIs to transition over to WITS.

Announcement from WITS

All development, testing and UAT for the WITS API Project has been completed and the API has been deployed to the production environment. We would like to thank those who participated in the beta testing, we appreciate you taking a moment to provide feedback.

We’re now ready to share the API with the wider energy market. Participants and interested public parties can access the API here: https://developer.electricityinfo.co.nz/WITS

The public data that is available via this API includes data that can be found on the WITS website under market prices, energy quantities and reserve quantities. Information on how to call our APIs is available on the portal.

If you would like to receive a short user guide to navigate access to the API, require any support or have any suggestions for improvements please contact our WITS Support Service – wits@nzx.com or 0800 426 648. Please note: The API is currently only supported during business hours 8:30am-5pm.

Further API development will be planned for our future work programmes. We would like to hear what future API’s participants would find most useful, please email your suggestions to us.

Changes in Tech Codes for Generation MD Files causing Automation Errors

2022-06-06T22:04:15.1370000

We're getting file validation errors when trying to process the generation md files.

Root cause looks to be changes made to the values in the tech_code column when the files were regenerated under the post relating to Turitea missing from Generation_MD CSV files.

Is it possible to regenerate the files again and set the tech codes back to the codes used in the rest of the datasets for that library for consistancy?

Tech_Code(New files) Tech_Code(Existing Files) Hydro Hydro Wind Wind Cogeneration Cogen Thermal Thrml Geothermal Geo