547 Pages
React 18 + TypeScript frontend with dashboards spanning all NEM market segments: spot prices, generation, FCAS, gas, renewables, battery storage, and DNSP intelligence.
Databricks Energy AI Intelligence
AI-powered market intelligence for the Australian National Electricity Market — built entirely on Databricks
Platform at a Glance
Section titled “Platform at a Glance”62 Routers / 979+ Endpoints
FastAPI backend with modular routers for every domain: market data, DNSP, settlement, risk, ML inference, and AI copilot streaming.
58 AI Tools
Claude Sonnet 4.5 via Databricks Foundation Model API with 58 tools covering market data retrieval, ML forecasting, trading analysis, risk management, and DNSP operations.
16 Genie Spaces
AI/BI Genie spaces for natural language SQL across NEM prices, generation, interconnectors, FCAS, settlement, DNSP compliance, and more.
39 Pipeline Jobs
Serverless Databricks jobs orchestrating Bronze→Silver→Gold data ingestion from AEMO NEMWEB, BOM weather, AER CDR, OpenElectricity, STTM gas, and 15 other sources.
113+ Gold Tables
Unity Catalog medallion lakehouse with 113+ curated Gold Delta tables feeding real-time dashboards and ML models with sub-10ms query latency via Lakebase.
Core Capabilities
Section titled “Core Capabilities” AI Market Intelligence Copilot Conversational AI with 51 domain-specific tools. Ask about spot prices, explain price events, run what-if scenarios, generate DNSP compliance reports — all in natural language.
Real-Time NEM Data 5-minute dispatch prices, generation by fuel type, interconnector flows, and FCAS prices — all sourced directly from AEMO NEMWEB with sub-10ms serving via Databricks Lakebase.
DNSP Intelligence Suite End-to-end intelligence for Distribution Network Service Providers: AER regulatory compliance, asset health scoring, RAB roll-forward, vegetation risk ML, and DAPR assembly.
ML Forecasting XGBoost and Prophet models for NEM price forecasting, asset failure prediction, vegetation risk classification, workforce demand forecasting, and STPIS anomaly detection.
Live Application
Section titled “Live Application”The Energy Copilot platform is deployed and accessible at:
https://energy-copilot-7474645691011751.aws.databricksapps.com
The application runs as a Databricks App, combining a React frontend served as static files with a FastAPI backend that queries Unity Catalog Gold tables via Lakebase (primary) or SQL Warehouse (fallback).
Authors
Section titled “Authors”Built by Beyza Yalavac and Sourabh Ghose, Databricks Field Engineering.
Who Is This For?
Section titled “Who Is This For?”| Role | Primary Use Cases |
|---|---|
| NEM Traders | Live spot prices, forward curves, trading signals, VaR, P&L attribution |
| Portfolio Analysts | MtM valuation, position management, risk limits, Greeks |
| DNSP Operators | AER compliance, asset health, RAB modelling, DAPR assembly |
| Market Analysts | Daily NEM briefs, generation mix, interconnector constraints, FCAS |
| Data Scientists | MLflow experiment tracking, model performance, feature store |
| Compliance Officers | NER obligations calendar, AER enforcement register, LGC registry |