spark-sql-streaming-OffsetSeq.adoc

OffsetSeq

OffsetSeq is…​FIXME

OffsetSeq is created when…​MEFIXME

toStreamProgress Method

toStreamProgress(sources: Seq[BaseStreamingSource]): StreamProgress

toStreamProgress then creates a new StreamProgress with the only sources that have the offsets defined.

toStreamProgress throws a AssertionError if the number of the input sources does not match the offsets.

Note	toStreamProgress is used when: MicroBatchExecution is requested to populateStartOffsets and construct the next streaming micro-batch ContinuousExecution is requested to getStartOffsets

Creating OffsetSeq Instance

OffsetSeq takes the following when created:

• Collection of Offsets

• OffsetSeqMetadata (default: None)