spark-sql-streaming-MicroBatchReader.adoc

MicroBatchReader Contract — DataSourceReaders For Micro-Batch Stream Processing

MicroBatchReader is the extension of the DataSourceReader (and BaseStreamingSource) contracts for data source readers that can read continually in Micro-Batch Stream Processing mode.

Table 1. MicroBatchReader Contract

Method	Description
commit	void commit(Offset end) Used when…​FIXME
deserializeOffset	Offset deserializeOffset(String json) Used when…​FIXME
getEndOffset	Offset getEndOffset() Used when…​FIXME
getStartOffset	Offset getStartOffset() Used when…​FIXME
setOffsetRange	void setOffsetRange( Optional<Offset> start, Optional<Offset> end) Used when…​FIXME

Table 2. MicroBatchReaders

MicroBatchReader	Description
KafkaMicroBatchReader
MemoryStream
RateStreamMicroBatchReader
TextSocketMicroBatchReader