Source: MySQL Target: Vertica Messaging Layer: Kafka
Pre-Requestes:
- This programs processes the events produced by Maxwell daemon. http://maxwells-daemon.io/
- Kafka and Zookeper is already setup and Maxwell daemon is sending the CDC events to kafka.
- Target - Vertica is setup.
- Target -You have CDC table created in mataching source table.
This program currently caonverts json payload produced by Maxwell and filters the inserts events and insert it to vertica table.
- Reading from kafka.
- Transform json object to required field.
- Filtering the Insert events corrosponds to target table.
- Converting cdc this operations in insert statements to write to vertica.