Skip to content

dbhatia2/KafkaToVertica

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 

Repository files navigation

KafkaToVertica

Source: MySQL Target: Vertica Messaging Layer: Kafka

Pre-Requestes:

  1. This programs processes the events produced by Maxwell daemon. http://maxwells-daemon.io/
  2. Kafka and Zookeper is already setup and Maxwell daemon is sending the CDC events to kafka.
  3. Target - Vertica is setup.
  4. Target -You have CDC table created in mataching source table.

This program currently caonverts json payload produced by Maxwell and filters the inserts events and insert it to vertica table.

  1. Reading from kafka.
  2. Transform json object to required field.
  3. Filtering the Insert events corrosponds to target table.
  4. Converting cdc this operations in insert statements to write to vertica.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages