State Updates
We want to get information from the Energy Devices that are connected to the Texture Platform and make that information available to you so you can monitor the devices on platform, make decisions based on it, and possibly take action based on it.
We call the bundle of telemetry data/information associated with that update a "State Update" because it represents the state of the device at that moment in time. This state can be anything from the current power output of a solar inverter, to the current fan mode of a thermostat, to the current charge of a battery or electric vehicle.
In a perfect world these updates would come in real-time or near real-time. In practice, most of these updates come in at 5 or 15 minute intervals based on the manufacturer, often through polling since most manufacturers don't yet support real-time push updates. We try to get this telemetry data as often as possible, but are hamstrung by manufacturer limitations.
If you are a manufacturer and we're not chatting already, we'd love to work with you to move more toward push/real-time updates to reduce the need for polling! Please contact us if we don't have an open thread already.
Real-time ETL
For every state update we receive, we take the following steps in nearly real-time via our event-driven system:
- We normalize all of the data taking the disparate structures and units from manufacturers and converting them all into standard units
- We then map that normalized data to the Texture standard data models.
- We then enrich them with other sources of data, where applicable, possibly including weather data, marginal carbon emissions data, pricing data, etc.
- If enabled, we will pair this behind-the-meter demand-side production/consumption/storage with meter data
- Then after all of this data transformation, we take that state update and:
- store the state update in our database (so that it can be retrieved via our REST and GraphQL APIs)
- store it in Elasticsearch (so it can be used for faceted queries and analytics and aggregations)
- store it in our data warehouse (for more intensive analyticts and for reverse ETL)
- push it out via any Destination you have configured so you can use it in your own systems or analytics
- And we maintain a history of state updates for eath device so that you can see and understand its energy usage over time. This is a key part of the Texture Platform and is used to power many of our features.