- New datasets on EMI – More final pricing data now available
New datasets on EMI – More final pricing data now available
- 699 Views
- Last post 26 October 2016
Some further comments about the availability of this data and the file naming conventions are warranted.
Both the cleared offers CSV files and the load, generation and price files are made available on a daily basis and are placed in folders arranged by year and month. Additionally, the most recent ten daily files will also be available in their respective root directories. This should assist users who want to use scripted processes to obtain the files, i.e. they will only need to point to a single location and the script won't require editing each month to point to a different location.
The most recent information we have for any trading day will be made available at 2:00pm of the day following the trading day. But users should understand that SPD final pricing case files may be received more frequently than this. Furthermore, we don't necessarily know the status - provisional, interim, or final - of final prices at the time the final pricing case file is received. See also the discussion here. Note that the status attaches to published prices, not an SPD case file.
The file naming convention is as follows:
- Cleared offers: YYYYMMDD_ClearedOffersx_X.csv
- Load, generation and prices: YYYYMMDD_LoadGenerationPricex_X.csv
- YYYY denotes year
- MM denotes month
- DD denotes day
- The lower case x, which is generally not present, denotes that SPD and vSPD have yielded different prices for at least one node in at least one trading period
- The upper case X denotes the status of final prices and may take on the values of P, I, F, or there may be no value at all, where:
- P stands for provisional
- I stands for interim
- F stands for final
- The absence of an upper case X means that no status has yet been assigned by the pricing manager.
Finally, and for the sake of clarity, the cleared offers and load are inputs to SPD while generation and price are SPD outputs. We extract all of this data - SPD inputs and outputs - from SPD case files. The status indicator - provisional, interim, or final - refers only to the status of prices and is included in the file names to be consistent with the approach used in naming GDX files.
Find discussions by tag
- 1 New EMI API release – Version 2 of the ICP connection data API now available
- 2 EMI dataset changes – Minor change to the data types in the offers file
- 3 New EMI API release – 1 March 2020, Version 2 of the ICP connection data API (ACCES quick wins)
- 4 Meter Register Content Codes - Impact on Billing
- 5 New dataset on EMI – Data on metering configurations