Skip to content

Latest commit

 

History

History
25 lines (15 loc) · 1.4 KB

spark-sql-streaming-StreamingAggregationStateManagerImplV1.adoc

File metadata and controls

25 lines (15 loc) · 1.4 KB

StreamingAggregationStateManagerImplV1 — Legacy State Manager for Streaming Aggregation

StreamingAggregationStateManagerImplV1 is the legacy state manager for streaming aggregations.

Note
The version of a state manager is controlled using spark.sql.streaming.aggregation.stateFormatVersion internal configuration property.

StreamingAggregationStateManagerImplV1 is created exclusively when StreamingAggregationStateManager is requested for a new StreamingAggregationStateManager.

Storing Row in State Store — put Method

put(store: StateStore, row: UnsafeRow): Unit
Note
put is part of the StreamingAggregationStateManager Contract to store a row in a state store.

put…​FIXME

Creating StreamingAggregationStateManagerImplV1 Instance

StreamingAggregationStateManagerImplV1 takes the following when created:

  • Attribute expressions for keys (Seq[Attribute])

  • Attribute expressions of input rows (Seq[Attribute])