2.0.54: Issue 135 (#151)

Changelog

Unreleased

GitHub #135 Support reading an entire file at a time enhancement

Issue 135 (#151)

• Some of the connectors were not inheriting from AbstractSpoolDirSourceConnector so they did not support multiple tasks. Moved this functionality to AbstractSourceConnector. Fixes #136
• Added support for reading an entire file and writing it's content to Kafka. Fixes #135.

8a6ae52154c62c0 Jeremy Custenborder 2020-11-21 17:38:48

GitHub #136 SpoolDirLineDelimitedSourceConnector should support multiple tasks bug

Issue 135 (#151)

• Some of the connectors were not inheriting from AbstractSpoolDirSourceConnector so they did not support multiple tasks. Moved this functionality to AbstractSourceConnector. Fixes #136
• Added support for reading an entire file and writing it's content to Kafka. Fixes #135.

8a6ae52154c62c0 Jeremy Custenborder 2020-11-21 17:38:48

GitHub #151 Issue 135

Issue 135 (#151)

• Some of the connectors were not inheriting from AbstractSpoolDirSourceConnector so they did not support multiple tasks. Moved this functionality to AbstractSourceConnector. Fixes #136
• Added support for reading an entire file and writing it's content to Kafka. Fixes #135.

8a6ae52154c62c0 Jeremy Custenborder 2020-11-21 17:38:48

2.0.46

Changelog

Unreleased

GitHub #139 update doc for processing.file.extension property

update doc for processing.file.extension property (#139)

2b0824335022890 Mark Bank 2020-08-26 22:37:36

2.0.43: Bump version. Update commons compress. (#125)

Changelog

Unreleased

GitHub #101 Correct Connect Packaging plugin configuration

V2.0 (#106)

• Start of the 2.0 branch.
• Added support for sorting the order of files processed. Added support for multiple tasks. Refactored file selection logic out to predicates. Fixes #98. Fixes #97.
• Clean up policy to move files to subdirectories by date in finished directory (#103)
• Moving finished files to date folders
• Add test
• Removed duplicate call to listFiles.
• Moving the metadata to headers. Metadata currently was not used by the individual connectors. Fixed #94. Fixed #95.
• Refactored to remove usage of Path since we have that functionality in File. Lower logging of directory to trace.
• Refactored InputFile to own everything for the input file. Added metadata class that is responsible for the file metadata based on cached values from InputFile. Updated test cases to have values for headers, ignoring some of the headers that will by dynamic.
• Fixed java doc warnings.
• Added finishedPathRequired method to config. This will be used to determine if the tasks should check for a finished path. Moved ownership of the InputStream to be completely within InputFile.
• Fixed checkstyle.
• Major refactor to add support for using a BufferedInputStream. Renamed abstract classes to be consistent. Connectors can optionally support using a BufferedInputStream which should reduce the round trips to the underlying filesystem. file.buffer.size.bytes can be used to configure the buffer. Fixes #105.
• Corrected Metadata to include offset within the file. #95.
• Corrected to use proper config() method.
• Added missing file.offset header to test cases. #95.
• Removed duplicate check.
• Added MB per second calculations.
• Bump the backoff time to 500 ms if no files are returned.
• Lower the logging level when searching for files.
• Correct Connect Packaging plugin configuration (#101)
• Correct Connect Packaging plugin configuration so that the project's packaging configuration properties properly override those inherited from the parent POM.
• Change manifest file's link to documentation (#102)
• Missed configuring tasks for SchemaLessJson. #97.
• Fixed Checkstyle.
• Refactored to allow metadata to be placed in a header, field, or dropped.
• Modified to not require a key for the messages. Bumped version for extended-log-format. Fixes #117
• CC-5455: Update support summary for LA connector (#109)
• Signed-off-by: Arjun Satish <[email protected]>
• Refactored to allow metadata to be placed in a header, field, or dropped.
• Documentation for metadata.field was not correct.
• Corrected extended-log-format version.
• Update docs for task.partitioner.
• Removed schema generation dependency.
• Updated examples.
• Co-authored-by: Jon Mitchell <[email protected]>
• Co-authored-by: Randall Hauch <[email protected]>
• Co-authored-by: Arjun Satish <[email protected]>

08c35d576db982d Jeremy Custenborder 2020-02-28 18:02:52

Correct Connect Packaging plugin configuration (#101)

• Correct Connect Packaging plugin configuration so that the project's packaging configuration properties properly override those inherited from the parent POM.

1db3817a007a386 Randall Hauch 2019-06-04 03:58:06

GitHub #102 Change manifest file's link to documentation

V2.0 (#106)

• Start of the 2.0 branch.
• Added support for sorting the order of files processed. Added support for multiple tasks. Refactored file selection logic out to predicates. Fixes #98. Fixes #97.
• Clean up policy to move files to subdirectories by date in finished directory (#103)
• Moving finished files to date folders
• Add test
• Removed duplicate call to listFiles.
• Moving the metadata to headers. Metadata currently was not used by the individual connectors. Fixed #94. Fixed #95.
• Refactored to remove usage of Path since we have that functionality in File. Lower logging of directory to trace.
• Refactored InputFile to own everything for the input file. Added metadata class that is responsible for the file metadata based on cached values from InputFile. Updated test cases to have values for headers, ignoring some of the headers that will by dynamic.
• Fixed java doc warnings.
• Added finishedPathRequired method to config. This will be used to determine if the tasks should check for a finished path. Moved ownership of the InputStream to be completely within InputFile.
• Fixed checkstyle.
• Major refactor to add support for using a BufferedInputStream. Renamed abstract classes to be consistent. Connectors can optionally support using a BufferedInputStream which should reduce the round trips to the underlying filesystem. file.buffer.size.bytes can be used to configure the buffer. Fixes #105.
• Corrected Metadata to include offset within the file. #95.
• Corrected to use proper config() method.
• Added missing file.offset header to test cases. #95.
• Removed duplicate check.
• Added MB per second calculations.
• Bump the backoff time to 500 ms if no files are returned.
• Lower the logging level when searching for files.
• Correct Connect Packaging plugin configuration (#101)
• Correct Connect Packaging plugin configuration so that the project's packaging configuration properties properly override those inherited from the parent POM.
• Change manifest file's link to documentation (#102)
• Missed configuring tasks for SchemaLessJson. #97.
• Fixed Checkstyle.
• Refactored to allow metadata to be placed in a header, field, or dropped.
• Modified to not require a key for the messages. Bumped version for extended-log-format. Fixes #117
• CC-5455: Update support summary for LA connector (#109)
• Signed-off-by: Arjun Satish <[email protected]>
• Refactored to allow metadata to be placed in a header, field, or dropped.
• Documentation for metadata.field was not correct.
• Corrected extended-log-format version.
• Update docs for task.partitioner.
• Removed schema generation dependency.
• Updated examples.
• Co-authored-by: Jon Mitchell <[email protected]>
• Co-authored-by: Randall Hauch <[email protected]>
• Co-authored-by: Arjun Satish <[email protected]>

08c35d576db982d Jeremy Custenborder 2020-02-28 18:02:52

Change manifest file's link to documentation (#102)

a9c1e382e3bc1ad Randall Hauch 2019-06-04 17:24:26

GitHub #103 Clean up policy to move files to subdirectories by date in finished directory

V2.0 (#106)

• Start of the 2.0 branch.
• Added support for sorting the order of files processed. Added support for multiple tasks. Refactored file selection logic out to predicates. Fixes #98. Fixes #97.
• Clean up policy to move files to subdirectories by date in finished directory (#103)
• Moving finished files to date folders
• Add test
• Removed duplicate call to listFiles.
• Moving the metadata to headers. Metadata currently was not used by the individual connectors. Fixed #94. Fixed #95.
• Refactored to remove usage of Path since we have that functionality in File. Lower logging of directory to trace.
• Refactored InputFile to own everything for the input file. Added metadata class that is responsible for the file metadata based on cached values from InputFile. Updated test cases to have values for headers, ignoring some of the headers that will by dynamic.
• Fixed java doc warnings.
• Added finishedPathRequired method to config. This will be used to determine if the tasks should check for a finished path. Moved ownership of the InputStream to be completely within InputFile.
• Fixed checkstyle.
• Major refactor to add support for using a BufferedInputStream. Renamed abstract classes to be consistent. Connectors can optionally support using a BufferedInputStream which should reduce the round trips to the underlying filesystem. file.buffer.size.bytes can be used to configure the buffer. Fixes #105.
• Corrected Metadata to include offset within the file. #95.
• Corrected to use proper config() method.
• Added missing file.offset header to test cases. #95.
• Removed duplicate check.
• Added MB per second calculations.
• Bump the backoff time to 500 ms if no files are returned.
• Lower the logging level when searching for files.
• Correct Connect Packaging plugin configuration (#101)
• Correct Connect Packaging plugin configuration so that the project's packaging configuration properties properly override those inherited from the parent POM.
• Change manifest file's link to documentation (#102)
• Missed configuring tasks for SchemaLessJson. #97.
• Fixed Checkstyle.
• Refactored to allow metadata to be placed in a header, field, or dropped.
• Modified to not require a key for the messages. Bumped version for extended-log-format. Fixes #117
• CC-5455: Update support summary for LA connector (#109)
• Signed-off-by: Arjun Satish <[email protected]>
• Refactored to allow metadata to be placed in a header, field, or dropped.
• Documentation for metadata.field was not correct.
• Corrected extended-log-format version.
• Update docs for task.partitioner.
• Removed schema generation dependency.
• Updated examples.
• Co-au...

2.0.42: Bump version. Update commons compress. (#125)

Changelog

Unreleased

GitHub #101 Correct Connect Packaging plugin configuration

V2.0 (#106)

• Start of the 2.0 branch.
• Added support for sorting the order of files processed. Added support for multiple tasks. Refactored file selection logic out to predicates. Fixes #98. Fixes #97.
• Clean up policy to move files to subdirectories by date in finished directory (#103)
• Moving finished files to date folders
• Add test
• Removed duplicate call to listFiles.
• Moving the metadata to headers. Metadata currently was not used by the individual connectors. Fixed #94. Fixed #95.
• Refactored to remove usage of Path since we have that functionality in File. Lower logging of directory to trace.
• Refactored InputFile to own everything for the input file. Added metadata class that is responsible for the file metadata based on cached values from InputFile. Updated test cases to have values for headers, ignoring some of the headers that will by dynamic.
• Fixed java doc warnings.
• Added finishedPathRequired method to config. This will be used to determine if the tasks should check for a finished path. Moved ownership of the InputStream to be completely within InputFile.
• Fixed checkstyle.
• Major refactor to add support for using a BufferedInputStream. Renamed abstract classes to be consistent. Connectors can optionally support using a BufferedInputStream which should reduce the round trips to the underlying filesystem. file.buffer.size.bytes can be used to configure the buffer. Fixes #105.
• Corrected Metadata to include offset within the file. #95.
• Corrected to use proper config() method.
• Added missing file.offset header to test cases. #95.
• Removed duplicate check.
• Added MB per second calculations.
• Bump the backoff time to 500 ms if no files are returned.
• Lower the logging level when searching for files.
• Correct Connect Packaging plugin configuration (#101)
• Correct Connect Packaging plugin configuration so that the project's packaging configuration properties properly override those inherited from the parent POM.
• Change manifest file's link to documentation (#102)
• Missed configuring tasks for SchemaLessJson. #97.
• Fixed Checkstyle.
• Refactored to allow metadata to be placed in a header, field, or dropped.
• Modified to not require a key for the messages. Bumped version for extended-log-format. Fixes #117
• CC-5455: Update support summary for LA connector (#109)
• Signed-off-by: Arjun Satish <[email protected]>
• Refactored to allow metadata to be placed in a header, field, or dropped.
• Documentation for metadata.field was not correct.
• Corrected extended-log-format version.
• Update docs for task.partitioner.
• Removed schema generation dependency.
• Updated examples.
• Co-authored-by: Jon Mitchell <[email protected]>
• Co-authored-by: Randall Hauch <[email protected]>
• Co-authored-by: Arjun Satish <[email protected]>

08c35d576db982d Jeremy Custenborder 2020-02-28 18:02:52

Correct Connect Packaging plugin configuration (#101)

• Correct Connect Packaging plugin configuration so that the project's packaging configuration properties properly override those inherited from the parent POM.

1db3817a007a386 Randall Hauch 2019-06-04 03:58:06

GitHub #102 Change manifest file's link to documentation

V2.0 (#106)

• Start of the 2.0 branch.
• Added support for sorting the order of files processed. Added support for multiple tasks. Refactored file selection logic out to predicates. Fixes #98. Fixes #97.
• Clean up policy to move files to subdirectories by date in finished directory (#103)
• Moving finished files to date folders
• Add test
• Removed duplicate call to listFiles.
• Moving the metadata to headers. Metadata currently was not used by the individual connectors. Fixed #94. Fixed #95.
• Refactored to remove usage of Path since we have that functionality in File. Lower logging of directory to trace.
• Refactored InputFile to own everything for the input file. Added metadata class that is responsible for the file metadata based on cached values from InputFile. Updated test cases to have values for headers, ignoring some of the headers that will by dynamic.
• Fixed java doc warnings.
• Added finishedPathRequired method to config. This will be used to determine if the tasks should check for a finished path. Moved ownership of the InputStream to be completely within InputFile.
• Fixed checkstyle.
• Major refactor to add support for using a BufferedInputStream. Renamed abstract classes to be consistent. Connectors can optionally support using a BufferedInputStream which should reduce the round trips to the underlying filesystem. file.buffer.size.bytes can be used to configure the buffer. Fixes #105.
• Corrected Metadata to include offset within the file. #95.
• Corrected to use proper config() method.
• Added missing file.offset header to test cases. #95.
• Removed duplicate check.
• Added MB per second calculations.
• Bump the backoff time to 500 ms if no files are returned.
• Lower the logging level when searching for files.
• Correct Connect Packaging plugin configuration (#101)
• Correct Connect Packaging plugin configuration so that the project's packaging configuration properties properly override those inherited from the parent POM.
• Change manifest file's link to documentation (#102)
• Missed configuring tasks for SchemaLessJson. #97.
• Fixed Checkstyle.
• Refactored to allow metadata to be placed in a header, field, or dropped.
• Modified to not require a key for the messages. Bumped version for extended-log-format. Fixes #117
• CC-5455: Update support summary for LA connector (#109)
• Signed-off-by: Arjun Satish <[email protected]>
• Refactored to allow metadata to be placed in a header, field, or dropped.
• Documentation for metadata.field was not correct.
• Corrected extended-log-format version.
• Update docs for task.partitioner.
• Removed schema generation dependency.
• Updated examples.
• Co-authored-by: Jon Mitchell <[email protected]>
• Co-authored-by: Randall Hauch <[email protected]>
• Co-authored-by: Arjun Satish <[email protected]>

08c35d576db982d Jeremy Custenborder 2020-02-28 18:02:52

Change manifest file's link to documentation (#102)

a9c1e382e3bc1ad Randall Hauch 2019-06-04 17:24:26

GitHub #103 Clean up policy to move files to subdirectories by date in finished directory

V2.0 (#106)

• Start of the 2.0 branch.
• Added support for sorting the order of files processed. Added support for multiple tasks. Refactored file selection logic out to predicates. Fixes #98. Fixes #97.
• Clean up policy to move files to subdirectories by date in finished directory (#103)
• Moving finished files to date folders
• Add test
• Removed duplicate call to listFiles.
• Moving the metadata to headers. Metadata currently was not used by the individual connectors. Fixed #94. Fixed #95.
• Refactored to remove usage of Path since we have that functionality in File. Lower logging of directory to trace.
• Refactored InputFile to own everything for the input file. Added metadata class that is responsible for the file metadata based on cached values from InputFile. Updated test cases to have values for headers, ignoring some of the headers that will by dynamic.
• Fixed java doc warnings.
• Added finishedPathRequired method to config. This will be used to determine if the tasks should check for a finished path. Moved ownership of the InputStream to be completely within InputFile.
• Fixed checkstyle.
• Major refactor to add support for using a BufferedInputStream. Renamed abstract classes to be consistent. Connectors can optionally support using a BufferedInputStream which should reduce the round trips to the underlying filesystem. file.buffer.size.bytes can be used to configure the buffer. Fixes #105.
• Corrected Metadata to include offset within the file. #95.
• Corrected to use proper config() method.
• Added missing file.offset header to test cases. #95.
• Removed duplicate check.
• Added MB per second calculations.
• Bump the backoff time to 500 ms if no files are returned.
• Lower the logging level when searching for files.
• Correct Connect Packaging plugin configuration (#101)
• Correct Connect Packaging plugin configuration so that the project's packaging configuration properties properly override those inherited from the parent POM.
• Change manifest file's link to documentation (#102)
• Missed configuring tasks for SchemaLessJson. #97.
• Fixed Checkstyle.
• Refactored to allow metadata to be placed in a header, field, or dropped.
• Modified to not require a key for the messages. Bumped version for extended-log-format. Fixes #117
• CC-5455: Update support summary for LA connector (#109)
• Signed-off-by: Arjun Satish <[email protected]>
• Refactored to allow metadata to be placed in a header, field, or dropped.
• Documentation for metadata.field was not correct.
• Corrected extended-log-format version.
• Update docs for task.partitioner.
• Removed schema generation dependency.
• Updated examples.
• Co-au...

1.0.42: V2.0 (#106)

Changelog

Unreleased

GitHub #101 Correct Connect Packaging plugin configuration

V2.0 (#106)

• Start of the 2.0 branch.
• Added support for sorting the order of files processed. Added support for multiple tasks. Refactored file selection logic out to predicates. Fixes #98. Fixes #97.
• Clean up policy to move files to subdirectories by date in finished directory (#103)
• Moving finished files to date folders
• Add test
• Removed duplicate call to listFiles.
• Moving the metadata to headers. Metadata currently was not used by the individual connectors. Fixed #94. Fixed #95.
• Refactored to remove usage of Path since we have that functionality in File. Lower logging of directory to trace.
• Refactored InputFile to own everything for the input file. Added metadata class that is responsible for the file metadata based on cached values from InputFile. Updated test cases to have values for headers, ignoring some of the headers that will by dynamic.
• Fixed java doc warnings.
• Added finishedPathRequired method to config. This will be used to determine if the tasks should check for a finished path. Moved ownership of the InputStream to be completely within InputFile.
• Fixed checkstyle.
• Major refactor to add support for using a BufferedInputStream. Renamed abstract classes to be consistent. Connectors can optionally support using a BufferedInputStream which should reduce the round trips to the underlying filesystem. file.buffer.size.bytes can be used to configure the buffer. Fixes #105.
• Corrected Metadata to include offset within the file. #95.
• Corrected to use proper config() method.
• Added missing file.offset header to test cases. #95.
• Removed duplicate check.
• Added MB per second calculations.
• Bump the backoff time to 500 ms if no files are returned.
• Lower the logging level when searching for files.
• Correct Connect Packaging plugin configuration (#101)
• Correct Connect Packaging plugin configuration so that the project's packaging configuration properties properly override those inherited from the parent POM.
• Change manifest file's link to documentation (#102)
• Missed configuring tasks for SchemaLessJson. #97.
• Fixed Checkstyle.
• Refactored to allow metadata to be placed in a header, field, or dropped.
• Modified to not require a key for the messages. Bumped version for extended-log-format. Fixes #117
• CC-5455: Update support summary for LA connector (#109)
• Signed-off-by: Arjun Satish <[email protected]>
• Refactored to allow metadata to be placed in a header, field, or dropped.
• Documentation for metadata.field was not correct.
• Corrected extended-log-format version.
• Update docs for task.partitioner.
• Removed schema generation dependency.
• Updated examples.
• Co-authored-by: Jon Mitchell <[email protected]>
• Co-authored-by: Randall Hauch <[email protected]>
• Co-authored-by: Arjun Satish <[email protected]>

08c35d576db982d Jeremy Custenborder 2020-02-28 18:02:52

Correct Connect Packaging plugin configuration (#101)

• Correct Connect Packaging plugin configuration so that the project's packaging configuration properties properly override those inherited from the parent POM.

1db3817a007a386 Randall Hauch 2019-06-04 03:58:06

GitHub #102 Change manifest file's link to documentation

V2.0 (#106)

• Start of the 2.0 branch.
• Added support for sorting the order of files processed. Added support for multiple tasks. Refactored file selection logic out to predicates. Fixes #98. Fixes #97.
• Clean up policy to move files to subdirectories by date in finished directory (#103)
• Moving finished files to date folders
• Add test
• Removed duplicate call to listFiles.
• Moving the metadata to headers. Metadata currently was not used by the individual connectors. Fixed #94. Fixed #95.
• Refactored to remove usage of Path since we have that functionality in File. Lower logging of directory to trace.
• Refactored InputFile to own everything for the input file. Added metadata class that is responsible for the file metadata based on cached values from InputFile. Updated test cases to have values for headers, ignoring some of the headers that will by dynamic.
• Fixed java doc warnings.
• Added finishedPathRequired method to config. This will be used to determine if the tasks should check for a finished path. Moved ownership of the InputStream to be completely within InputFile.
• Fixed checkstyle.
• Major refactor to add support for using a BufferedInputStream. Renamed abstract classes to be consistent. Connectors can optionally support using a BufferedInputStream which should reduce the round trips to the underlying filesystem. file.buffer.size.bytes can be used to configure the buffer. Fixes #105.
• Corrected Metadata to include offset within the file. #95.
• Corrected to use proper config() method.
• Added missing file.offset header to test cases. #95.
• Removed duplicate check.
• Added MB per second calculations.
• Bump the backoff time to 500 ms if no files are returned.
• Lower the logging level when searching for files.
• Correct Connect Packaging plugin configuration (#101)
• Correct Connect Packaging plugin configuration so that the project's packaging configuration properties properly override those inherited from the parent POM.
• Change manifest file's link to documentation (#102)
• Missed configuring tasks for SchemaLessJson. #97.
• Fixed Checkstyle.
• Refactored to allow metadata to be placed in a header, field, or dropped.
• Modified to not require a key for the messages. Bumped version for extended-log-format. Fixes #117
• CC-5455: Update support summary for LA connector (#109)
• Signed-off-by: Arjun Satish <[email protected]>
• Refactored to allow metadata to be placed in a header, field, or dropped.
• Documentation for metadata.field was not correct.
• Corrected extended-log-format version.
• Update docs for task.partitioner.
• Removed schema generation dependency.
• Updated examples.
• Co-authored-by: Jon Mitchell <[email protected]>
• Co-authored-by: Randall Hauch <[email protected]>
• Co-authored-by: Arjun Satish <[email protected]>

08c35d576db982d Jeremy Custenborder 2020-02-28 18:02:52

Change manifest file's link to documentation (#102)

a9c1e382e3bc1ad Randall Hauch 2019-06-04 17:24:26

GitHub #103 Clean up policy to move files to subdirectories by date in finished directory

V2.0 (#106)

• Start of the 2.0 branch.
• Added support for sorting the order of files processed. Added support for multiple tasks. Refactored file selection logic out to predicates. Fixes #98. Fixes #97.
• Clean up policy to move files to subdirectories by date in finished directory (#103)
• Moving finished files to date folders
• Add test
• Removed duplicate call to listFiles.
• Moving the metadata to headers. Metadata currently was not used by the individual connectors. Fixed #94. Fixed #95.
• Refactored to remove usage of Path since we have that functionality in File. Lower logging of directory to trace.
• Refactored InputFile to own everything for the input file. Added metadata class that is responsible for the file metadata based on cached values from InputFile. Updated test cases to have values for headers, ignoring some of the headers that will by dynamic.
• Fixed java doc warnings.
• Added finishedPathRequired method to config. This will be used to determine if the tasks should check for a finished path. Moved ownership of the InputStream to be completely within InputFile.
• Fixed checkstyle.
• Major refactor to add support for using a BufferedInputStream. Renamed abstract classes to be consistent. Connectors can optionally support using a BufferedInputStream which should reduce the round trips to the underlying filesystem. file.buffer.size.bytes can be used to configure the buffer. Fixes #105.
• Corrected Metadata to include offset within the file. #95.
• Corrected to use proper config() method.
• Added missing file.offset header to test cases. #95.
• Removed duplicate check.
• Added MB per second calculations.
• Bump the backoff time to 500 ms if no files are returned.
• Lower the logging level when searching for files.
• Correct Connect Packaging plugin configuration (#101)
• Correct Connect Packaging plugin configuration so that the project's packaging configuration properties properly override those inherited from the parent POM.
• Change manifest file's link to documentation (#102)
• Missed configuring tasks for SchemaLessJson. #97.
• Fixed Checkstyle.
• Refactored to allow metadata to be placed in a header, field, or dropped.
• Modified to not require a key for the messages. Bumped version for extended-log-format. Fixes #117
• CC-5455: Update support summary for LA connector (#109)
• Signed-off-by: Arjun Satish <[email protected]>
• Refactored to allow metadata to be placed in a header, field, or dropped.
• Documentation for metadata.field was not correct.
• Corrected extended-log-format version.
• Update docs for task.partitioner.
• Removed schema generation dependency.
• Updated examples.
• Co-au...

1.0.31

Unreleased

GitHub #17 Schema refactor

Schema refactor (#17)

• Refactored to add support for json. Added experimental support for tracking offsets. Moved to require schemas to be supplied.
• Modified scope to ensure that jackson is in target directory.
• Updated the docker compose to the latest version
• Updated data files with changes from offsets.
• Added documentation test.
• Bumped version to 0.10.2.0-cp1.
• Added support to throw a contextual exception when a record cannot be parsed. This will throw the record and field.
• Added support to write records with a timestamp.
• Added description to connectors.
• Added generators to aid in building schemas for the input files. Added a command line utility as well.
• Added validation of character sets.
• Added support to dynamically generate schemas if schema.generation.enabled is set to true.
• Pulled out jfairy because it's no longer used.
• Updated the documentation.
• Modified so SimpleDateFormat is being set with the correct timezone. This was causing tests to fail in other timezones like UTC.

f14906f3fd81a79 Jeremy Custenborder 2017-05-29 02:56:36

GitHub #22 Fix connectors validate method

Issue 22 (#24)

• bump opencsv to 3.10.
• Moved to use ValidDirectoryWritable from config-utils. Fixes #22

7a0ecc80908605e Jeremy Custenborder 2017-07-22 03:46:29

GitHub #23 Rst

Rst (#23)

• Added documentation.
• Changed to 0.10.2.1-cp2.

9c753e61623383f Jeremy Custenborder 2017-07-18 22:15:45

GitHub #24 Issue 22

Issue 22 (#24)

• bump opencsv to 3.10.
• Moved to use ValidDirectoryWritable from config-utils. Fixes #22

7a0ecc80908605e Jeremy Custenborder 2017-07-22 03:46:29

GitHub #34 Bumped kafka to 1.0.0

Bumped kafka to 1.0.0 (#34)

ee16eaba2f64fb8 Jeremy Custenborder 2017-11-04 03:00:53

GitHub #40 Incorrect offset handling of reprocessed JSON files

Corrected offset. fixes #40

7b36790f3587b20 Jeremy Custenborder 2018-03-27 16:32:38

GitHub #42 Connector Hub Support

Issue 42 (#43)

• Added assembly plugin. fixes #42.
• Corrected. Just a sink.

68b2e59226f0122 Jeremy Custenborder 2018-04-03 00:26:04

GitHub #43 Issue 42

Issue 42 (#43)

• Added assembly plugin. fixes #42.
• Corrected. Just a sink.

68b2e59226f0122 Jeremy Custenborder 2018-04-03 00:26:04

GitHub #45 kafka-run-class: command not found

Updated documentation to the corrected path for the build output. Fixes #45.

d0a498b0bf48e1d Jeremy Custenborder 2018-04-20 19:35:25

GitHub #48 Added support to decompress based on the file extension.

Added support to decompress based on the file extension. (#48)

cac32a7dc7ad8c1 Jeremy Custenborder 2018-04-21 02:13:21

GitHub #50 Add support for extended log format.

Issue 50 (#51)

• Partial support for ELF. #50
• Full support for ELF. Added InputFileDeque the number of calls to list the directory contents. This will query only when needed to reduce the number of stat calls.

b85ffb68636b29b Jeremy Custenborder 2018-05-02 14:02:38

GitHub #51 Issue 50

Issue 50 (#51)

• Partial support for ELF. #50
• Full support for ELF. Added InputFileDeque the number of calls to list the directory contents. This will query only when needed to reduce the number of stat calls.

b85ffb68636b29b Jeremy Custenborder 2018-05-02 14:02:38

GitHub #52 Support a configurable cleanup policy.

Added support for a configurable delete policy. Fixes #52. (#53)

b8f1b19cc2a1ca4 Jeremy Custenborder 2018-05-02 21:51:02

GitHub #53 Added support for a configurable delete policy. Fixes #52.

Added support for a configurable delete policy. Fixes #52. (#53)

b8f1b19cc2a1ca4 Jeremy Custenborder 2018-05-02 21:51:02

No issue

Add the number of records imported.

82aeb6ca2f5a356 Jeremy Custenborder 2018-05-09 20:53:47

Make the separator character configurable.

95d384fa37db2bb Jeremy Custenborder 2018-05-09 20:53:20

Added check for cleanup policy. Added log message when removing file.

e6c6ec4d30d91f9 Jeremy Custenborder 2018-05-02 23:03:20

validValues should not return null.

3af4d58257f6dfc Jeremy Custenborder 2018-05-02 22:40:13

Cleanup of configuration documentation.

cb67558c6a4931b Jeremy Custenborder 2018-04-20 22:23:26

Cleanup of configuration documentation.

ac8c4e452402c16 Jeremy Custenborder 2018-04-20 21:38:03

Updated documentation

1a52576b4719e95 Jeremy Custenborder 2017-11-07 22:07:02

Corrected schema registry image.

464603a3ea40a4b Jeremy Custenborder 2016-11-04 20:04:03

Changed the displayname parameter for a few fields in the CSVRecordProcessorConfig

6e8954d925d9971 Chris Matta 2016-09-15 18:02:51

Moved all of the documentation back to markdown.

45a3eacf9c01464 Jeremy Custenborder 2016-09-07 05:38:53

Changed assembly to ouput a tar.gz

7b2dce5e2c593b6 Jeremy Custenborder 2016-09-07 05:33:11

Changed to include developer SCM data so the releases plugin will upload properly.

cb7abea45b497d6 Jeremy Custenborder 2016-09-07 05:26:38

Updated license header.

243fbb8f6108bcc Jeremy Custenborder 2016-09-07 05:20:13

Deploy to github releases.

f12eba253a6f4b6 Jeremy Custenborder 2016-09-07 05:16:08

Added logging for testing.

3748e346703a5a1 Jeremy Custenborder 2016-08-23 03:35:59

Added confluent repository.

c8610c37fb26fba Jeremy Custenborder 2016-08-23 03:30:09

Initial commit for Jenkinsfile.

139ed2da2514c70 Jeremy Custenborder 2016-08-23 03:26:10

Changes to pull connect-utils from maven central.

a98dc0b7aa32fff Jeremy Custenborder 2016-08-23 03:21:57

Added settings to control the output schema name for a generated schema.

02a0071767974d3 Jeremy Custenborder 2016-07-19 18:22:43

Corrected test cases for maven. Added metadata to the record if configured.

c606245639e26bb Jeremy Custenborder 2016-07-12 13:22:43

Cleanup of refactor in strings.

d61d1d8b5af3ee9 Jeremy Custenborder 2016-07-11 21:56:28

Rename the file once before it has started processing.

[a060f56](https://github.com/...

1.0.30

Unreleased

GitHub #17 Schema refactor

Schema refactor (#17)

• Refactored to add support for json. Added experimental support for tracking offsets. Moved to require schemas to be supplied.
• Modified scope to ensure that jackson is in target directory.
• Updated the docker compose to the latest version
• Updated data files with changes from offsets.
• Added documentation test.
• Bumped version to 0.10.2.0-cp1.
• Added support to throw a contextual exception when a record cannot be parsed. This will throw the record and field.
• Added support to write records with a timestamp.
• Added description to connectors.
• Added generators to aid in building schemas for the input files. Added a command line utility as well.
• Added validation of character sets.
• Added support to dynamically generate schemas if schema.generation.enabled is set to true.
• Pulled out jfairy because it's no longer used.
• Updated the documentation.
• Modified so SimpleDateFormat is being set with the correct timezone. This was causing tests to fail in other timezones like UTC.

f14906f3fd81a79 Jeremy Custenborder 2017-05-29 02:56:36

GitHub #22 Fix connectors validate method

Issue 22 (#24)

• bump opencsv to 3.10.
• Moved to use ValidDirectoryWritable from config-utils. Fixes #22

7a0ecc80908605e Jeremy Custenborder 2017-07-22 03:46:29

GitHub #23 Rst

Rst (#23)

• Added documentation.
• Changed to 0.10.2.1-cp2.

9c753e61623383f Jeremy Custenborder 2017-07-18 22:15:45

GitHub #24 Issue 22

Issue 22 (#24)

• bump opencsv to 3.10.
• Moved to use ValidDirectoryWritable from config-utils. Fixes #22

7a0ecc80908605e Jeremy Custenborder 2017-07-22 03:46:29

GitHub #34 Bumped kafka to 1.0.0

Bumped kafka to 1.0.0 (#34)

ee16eaba2f64fb8 Jeremy Custenborder 2017-11-04 03:00:53

GitHub #40 Incorrect offset handling of reprocessed JSON files

Corrected offset. fixes #40

7b36790f3587b20 Jeremy Custenborder 2018-03-27 16:32:38

GitHub #42 Connector Hub Support

Issue 42 (#43)

• Added assembly plugin. fixes #42.
• Corrected. Just a sink.

68b2e59226f0122 Jeremy Custenborder 2018-04-03 00:26:04

GitHub #43 Issue 42

Issue 42 (#43)

• Added assembly plugin. fixes #42.
• Corrected. Just a sink.

68b2e59226f0122 Jeremy Custenborder 2018-04-03 00:26:04

GitHub #45 kafka-run-class: command not found

Updated documentation to the corrected path for the build output. Fixes #45.

d0a498b0bf48e1d Jeremy Custenborder 2018-04-20 19:35:25

GitHub #48 Added support to decompress based on the file extension.

Added support to decompress based on the file extension. (#48)

cac32a7dc7ad8c1 Jeremy Custenborder 2018-04-21 02:13:21

GitHub #50 Add support for extended log format.

Issue 50 (#51)

• Partial support for ELF. #50
• Full support for ELF. Added InputFileDeque the number of calls to list the directory contents. This will query only when needed to reduce the number of stat calls.

b85ffb68636b29b Jeremy Custenborder 2018-05-02 14:02:38

GitHub #51 Issue 50

Issue 50 (#51)

• Partial support for ELF. #50
• Full support for ELF. Added InputFileDeque the number of calls to list the directory contents. This will query only when needed to reduce the number of stat calls.

b85ffb68636b29b Jeremy Custenborder 2018-05-02 14:02:38

GitHub #52 Support a configurable cleanup policy.

Added support for a configurable delete policy. Fixes #52. (#53)

b8f1b19cc2a1ca4 Jeremy Custenborder 2018-05-02 21:51:02

GitHub #53 Added support for a configurable delete policy. Fixes #52.

Added support for a configurable delete policy. Fixes #52. (#53)

b8f1b19cc2a1ca4 Jeremy Custenborder 2018-05-02 21:51:02

No issue

Added check for cleanup policy. Added log message when removing file.

e6c6ec4d30d91f9 Jeremy Custenborder 2018-05-02 23:03:20

validValues should not return null.

3af4d58257f6dfc Jeremy Custenborder 2018-05-02 22:40:13

Cleanup of configuration documentation.

cb67558c6a4931b Jeremy Custenborder 2018-04-20 22:23:26

Cleanup of configuration documentation.

ac8c4e452402c16 Jeremy Custenborder 2018-04-20 21:38:03

Updated documentation

1a52576b4719e95 Jeremy Custenborder 2017-11-07 22:07:02

Corrected schema registry image.

464603a3ea40a4b Jeremy Custenborder 2016-11-04 20:04:03

Changed the displayname parameter for a few fields in the CSVRecordProcessorConfig

6e8954d925d9971 Chris Matta 2016-09-15 18:02:51

Moved all of the documentation back to markdown.

45a3eacf9c01464 Jeremy Custenborder 2016-09-07 05:38:53

Changed assembly to ouput a tar.gz

7b2dce5e2c593b6 Jeremy Custenborder 2016-09-07 05:33:11

Changed to include developer SCM data so the releases plugin will upload properly.

cb7abea45b497d6 Jeremy Custenborder 2016-09-07 05:26:38

Updated license header.

243fbb8f6108bcc Jeremy Custenborder 2016-09-07 05:20:13

Deploy to github releases.

f12eba253a6f4b6 Jeremy Custenborder 2016-09-07 05:16:08

Added logging for testing.

3748e346703a5a1 Jeremy Custenborder 2016-08-23 03:35:59

Added confluent repository.

c8610c37fb26fba Jeremy Custenborder 2016-08-23 03:30:09

Initial commit for Jenkinsfile.

139ed2da2514c70 Jeremy Custenborder 2016-08-23 03:26:10

Changes to pull connect-utils from maven central.

a98dc0b7aa32fff Jeremy Custenborder 2016-08-23 03:21:57

Added settings to control the output schema name for a generated schema.

02a0071767974d3 Jeremy Custenborder 2016-07-19 18:22:43

Corrected test cases for maven. Added metadata to the record if configured.

c606245639e26bb Jeremy Custenborder 2016-07-12 13:22:43

Cleanup of refactor in strings.

d61d1d8b5af3ee9 Jeremy Custenborder 2016-07-11 21:56:28

Rename the file once before it has started processing.

a060f567ad6eb10 Jeremy Custenborder 2016-07-11 17:57:17

Added more testing around not having keys defined. This should result in a null schema and a null object ending up in the connect record.

7c49df8804a986f Jeremy Custenborder *2016-0...

1.0.29

Unreleased

GitHub #17 Schema refactor

Schema refactor (#17)

• Refactored to add support for json. Added experimental support for tracking offsets. Moved to require schemas to be supplied.
• Modified scope to ensure that jackson is in target directory.
• Updated the docker compose to the latest version
• Updated data files with changes from offsets.
• Added documentation test.
• Bumped version to 0.10.2.0-cp1.
• Added support to throw a contextual exception when a record cannot be parsed. This will throw the record and field.
• Added support to write records with a timestamp.
• Added description to connectors.
• Added generators to aid in building schemas for the input files. Added a command line utility as well.
• Added validation of character sets.
• Added support to dynamically generate schemas if schema.generation.enabled is set to true.
• Pulled out jfairy because it's no longer used.
• Updated the documentation.
• Modified so SimpleDateFormat is being set with the correct timezone. This was causing tests to fail in other timezones like UTC.

f14906f3fd81a79 Jeremy Custenborder 2017-05-29 02:56:36

GitHub #22 Fix connectors validate method

Issue 22 (#24)

• bump opencsv to 3.10.
• Moved to use ValidDirectoryWritable from config-utils. Fixes #22

7a0ecc80908605e Jeremy Custenborder 2017-07-22 03:46:29

GitHub #23 Rst

Rst (#23)

• Added documentation.
• Changed to 0.10.2.1-cp2.

9c753e61623383f Jeremy Custenborder 2017-07-18 22:15:45

GitHub #24 Issue 22

Issue 22 (#24)

• bump opencsv to 3.10.
• Moved to use ValidDirectoryWritable from config-utils. Fixes #22

7a0ecc80908605e Jeremy Custenborder 2017-07-22 03:46:29

GitHub #34 Bumped kafka to 1.0.0

Bumped kafka to 1.0.0 (#34)

ee16eaba2f64fb8 Jeremy Custenborder 2017-11-04 03:00:53

GitHub #40 Incorrect offset handling of reprocessed JSON files

Corrected offset. fixes #40

7b36790f3587b20 Jeremy Custenborder 2018-03-27 16:32:38

GitHub #42 Connector Hub Support

Issue 42 (#43)

• Added assembly plugin. fixes #42.
• Corrected. Just a sink.

68b2e59226f0122 Jeremy Custenborder 2018-04-03 00:26:04

GitHub #43 Issue 42

Issue 42 (#43)

• Added assembly plugin. fixes #42.
• Corrected. Just a sink.

68b2e59226f0122 Jeremy Custenborder 2018-04-03 00:26:04

GitHub #45 kafka-run-class: command not found

Updated documentation to the corrected path for the build output. Fixes #45.

d0a498b0bf48e1d Jeremy Custenborder 2018-04-20 19:35:25

GitHub #48 Added support to decompress based on the file extension.

Added support to decompress based on the file extension. (#48)

cac32a7dc7ad8c1 Jeremy Custenborder 2018-04-21 02:13:21

GitHub #50 Add support for extended log format.

Issue 50 (#51)

• Partial support for ELF. #50
• Full support for ELF. Added InputFileDeque the number of calls to list the directory contents. This will query only when needed to reduce the number of stat calls.

b85ffb68636b29b Jeremy Custenborder 2018-05-02 14:02:38

GitHub #51 Issue 50

Issue 50 (#51)

• Partial support for ELF. #50
• Full support for ELF. Added InputFileDeque the number of calls to list the directory contents. This will query only when needed to reduce the number of stat calls.

b85ffb68636b29b Jeremy Custenborder 2018-05-02 14:02:38

GitHub #52 Support a configurable cleanup policy.

Added support for a configurable delete policy. Fixes #52. (#53)

b8f1b19cc2a1ca4 Jeremy Custenborder 2018-05-02 21:51:02

GitHub #53 Added support for a configurable delete policy. Fixes #52.

Added support for a configurable delete policy. Fixes #52. (#53)

b8f1b19cc2a1ca4 Jeremy Custenborder 2018-05-02 21:51:02

No issue

validValues should not return null.

3af4d58257f6dfc Jeremy Custenborder 2018-05-02 22:40:13

Cleanup of configuration documentation.

cb67558c6a4931b Jeremy Custenborder 2018-04-20 22:23:26

Cleanup of configuration documentation.

ac8c4e452402c16 Jeremy Custenborder 2018-04-20 21:38:03

Updated documentation

1a52576b4719e95 Jeremy Custenborder 2017-11-07 22:07:02

Corrected schema registry image.

464603a3ea40a4b Jeremy Custenborder 2016-11-04 20:04:03

Changed the displayname parameter for a few fields in the CSVRecordProcessorConfig

6e8954d925d9971 Chris Matta 2016-09-15 18:02:51

Moved all of the documentation back to markdown.

45a3eacf9c01464 Jeremy Custenborder 2016-09-07 05:38:53

Changed assembly to ouput a tar.gz

7b2dce5e2c593b6 Jeremy Custenborder 2016-09-07 05:33:11

Changed to include developer SCM data so the releases plugin will upload properly.

cb7abea45b497d6 Jeremy Custenborder 2016-09-07 05:26:38

Updated license header.

243fbb8f6108bcc Jeremy Custenborder 2016-09-07 05:20:13

Deploy to github releases.

f12eba253a6f4b6 Jeremy Custenborder 2016-09-07 05:16:08

Added logging for testing.

3748e346703a5a1 Jeremy Custenborder 2016-08-23 03:35:59

Added confluent repository.

c8610c37fb26fba Jeremy Custenborder 2016-08-23 03:30:09

Initial commit for Jenkinsfile.

139ed2da2514c70 Jeremy Custenborder 2016-08-23 03:26:10

Changes to pull connect-utils from maven central.

a98dc0b7aa32fff Jeremy Custenborder 2016-08-23 03:21:57

Added settings to control the output schema name for a generated schema.

02a0071767974d3 Jeremy Custenborder 2016-07-19 18:22:43

Corrected test cases for maven. Added metadata to the record if configured.

c606245639e26bb Jeremy Custenborder 2016-07-12 13:22:43

Cleanup of refactor in strings.

d61d1d8b5af3ee9 Jeremy Custenborder 2016-07-11 21:56:28

Rename the file once before it has started processing.

a060f567ad6eb10 Jeremy Custenborder 2016-07-11 17:57:17

Added more testing around not having keys defined. This should result in a null schema and a null object ending up in the connect record.

7c49df8804a986f Jeremy Custenborder 2016-07-10 02:28:24

Added more test cases around non defined schemas. Extend SchemaConfig tests to validate the key schema. Refactored CSVRecordProcessor to use data package. Added more documentation to RST.

[e2361c...

1.0.28

Unreleased

GitHub #17 Schema refactor

Schema refactor (#17)

• Refactored to add support for json. Added experimental support for tracking offsets. Moved to require schemas to be supplied.
• Modified scope to ensure that jackson is in target directory.
• Updated the docker compose to the latest version
• Updated data files with changes from offsets.
• Added documentation test.
• Bumped version to 0.10.2.0-cp1.
• Added support to throw a contextual exception when a record cannot be parsed. This will throw the record and field.
• Added support to write records with a timestamp.
• Added description to connectors.
• Added generators to aid in building schemas for the input files. Added a command line utility as well.
• Added validation of character sets.
• Added support to dynamically generate schemas if schema.generation.enabled is set to true.
• Pulled out jfairy because it's no longer used.
• Updated the documentation.
• Modified so SimpleDateFormat is being set with the correct timezone. This was causing tests to fail in other timezones like UTC.

f14906f3fd81a79 Jeremy Custenborder 2017-05-29 02:56:36

GitHub #22 Fix connectors validate method

Issue 22 (#24)

• bump opencsv to 3.10.
• Moved to use ValidDirectoryWritable from config-utils. Fixes #22

7a0ecc80908605e Jeremy Custenborder 2017-07-22 03:46:29

GitHub #23 Rst

Rst (#23)

• Added documentation.
• Changed to 0.10.2.1-cp2.

9c753e61623383f Jeremy Custenborder 2017-07-18 22:15:45

GitHub #24 Issue 22

Issue 22 (#24)

• bump opencsv to 3.10.
• Moved to use ValidDirectoryWritable from config-utils. Fixes #22

7a0ecc80908605e Jeremy Custenborder 2017-07-22 03:46:29

GitHub #34 Bumped kafka to 1.0.0

Bumped kafka to 1.0.0 (#34)

ee16eaba2f64fb8 Jeremy Custenborder 2017-11-04 03:00:53

GitHub #40 Incorrect offset handling of reprocessed JSON files

Corrected offset. fixes #40

7b36790f3587b20 Jeremy Custenborder 2018-03-27 16:32:38

GitHub #42 Connector Hub Support

Issue 42 (#43)

• Added assembly plugin. fixes #42.
• Corrected. Just a sink.

68b2e59226f0122 Jeremy Custenborder 2018-04-03 00:26:04

GitHub #43 Issue 42

Issue 42 (#43)

• Added assembly plugin. fixes #42.
• Corrected. Just a sink.

68b2e59226f0122 Jeremy Custenborder 2018-04-03 00:26:04

GitHub #45 kafka-run-class: command not found

Updated documentation to the corrected path for the build output. Fixes #45.

d0a498b0bf48e1d Jeremy Custenborder 2018-04-20 19:35:25

GitHub #48 Added support to decompress based on the file extension.

Added support to decompress based on the file extension. (#48)

cac32a7dc7ad8c1 Jeremy Custenborder 2018-04-21 02:13:21

GitHub #50 Add support for extended log format.

Issue 50 (#51)

• Partial support for ELF. #50
• Full support for ELF. Added InputFileDeque the number of calls to list the directory contents. This will query only when needed to reduce the number of stat calls.

b85ffb68636b29b Jeremy Custenborder 2018-05-02 14:02:38

GitHub #51 Issue 50

Issue 50 (#51)

• Partial support for ELF. #50
• Full support for ELF. Added InputFileDeque the number of calls to list the directory contents. This will query only when needed to reduce the number of stat calls.

b85ffb68636b29b Jeremy Custenborder 2018-05-02 14:02:38

GitHub #52 Support a configurable cleanup policy.

Added support for a configurable delete policy. Fixes #52. (#53)

b8f1b19cc2a1ca4 Jeremy Custenborder 2018-05-02 21:51:02

GitHub #53 Added support for a configurable delete policy. Fixes #52.

Added support for a configurable delete policy. Fixes #52. (#53)

b8f1b19cc2a1ca4 Jeremy Custenborder 2018-05-02 21:51:02

No issue

Cleanup of configuration documentation.

cb67558c6a4931b Jeremy Custenborder 2018-04-20 22:23:26

Cleanup of configuration documentation.

ac8c4e452402c16 Jeremy Custenborder 2018-04-20 21:38:03

Updated documentation

1a52576b4719e95 Jeremy Custenborder 2017-11-07 22:07:02

Corrected schema registry image.

464603a3ea40a4b Jeremy Custenborder 2016-11-04 20:04:03

Changed the displayname parameter for a few fields in the CSVRecordProcessorConfig

6e8954d925d9971 Chris Matta 2016-09-15 18:02:51

Moved all of the documentation back to markdown.

45a3eacf9c01464 Jeremy Custenborder 2016-09-07 05:38:53

Changed assembly to ouput a tar.gz

7b2dce5e2c593b6 Jeremy Custenborder 2016-09-07 05:33:11

Changed to include developer SCM data so the releases plugin will upload properly.

cb7abea45b497d6 Jeremy Custenborder 2016-09-07 05:26:38

Updated license header.

243fbb8f6108bcc Jeremy Custenborder 2016-09-07 05:20:13

Deploy to github releases.

f12eba253a6f4b6 Jeremy Custenborder 2016-09-07 05:16:08

Added logging for testing.

3748e346703a5a1 Jeremy Custenborder 2016-08-23 03:35:59

Added confluent repository.

c8610c37fb26fba Jeremy Custenborder 2016-08-23 03:30:09

Initial commit for Jenkinsfile.

139ed2da2514c70 Jeremy Custenborder 2016-08-23 03:26:10

Changes to pull connect-utils from maven central.

a98dc0b7aa32fff Jeremy Custenborder 2016-08-23 03:21:57

Added settings to control the output schema name for a generated schema.

02a0071767974d3 Jeremy Custenborder 2016-07-19 18:22:43

Corrected test cases for maven. Added metadata to the record if configured.

c606245639e26bb Jeremy Custenborder 2016-07-12 13:22:43

Cleanup of refactor in strings.

d61d1d8b5af3ee9 Jeremy Custenborder 2016-07-11 21:56:28

Rename the file once before it has started processing.

a060f567ad6eb10 Jeremy Custenborder 2016-07-11 17:57:17

Added more testing around not having keys defined. This should result in a null schema and a null object ending up in the connect record.

7c49df8804a986f Jeremy Custenborder 2016-07-10 02:28:24

Added more test cases around non defined schemas. Extend SchemaConfig tests to validate the key schema. Refactored CSVRecordProcessor to use data package. Added more documentation to RST.

e2361cc656c32df Jeremy Custenborder 2016-07-10 02:16:31

Hopefully corrected RST.

[1851a2b](...

1.0.27: Issue 50 (#51)

Unreleased

GitHub #17 Schema refactor

Schema refactor (#17)

• Refactored to add support for json. Added experimental support for tracking offsets. Moved to require schemas to be supplied.
• Modified scope to ensure that jackson is in target directory.
• Updated the docker compose to the latest version
• Updated data files with changes from offsets.
• Added documentation test.
• Bumped version to 0.10.2.0-cp1.
• Added support to throw a contextual exception when a record cannot be parsed. This will throw the record and field.
• Added support to write records with a timestamp.
• Added description to connectors.
• Added generators to aid in building schemas for the input files. Added a command line utility as well.
• Added validation of character sets.
• Added support to dynamically generate schemas if schema.generation.enabled is set to true.
• Pulled out jfairy because it's no longer used.
• Updated the documentation.
• Modified so SimpleDateFormat is being set with the correct timezone. This was causing tests to fail in other timezones like UTC.

f14906f3fd81a79 Jeremy Custenborder 2017-05-29 02:56:36

GitHub #22 Fix connectors validate method

Issue 22 (#24)

• bump opencsv to 3.10.
• Moved to use ValidDirectoryWritable from config-utils. Fixes #22

7a0ecc80908605e Jeremy Custenborder 2017-07-22 03:46:29

GitHub #23 Rst

Rst (#23)

• Added documentation.
• Changed to 0.10.2.1-cp2.

9c753e61623383f Jeremy Custenborder 2017-07-18 22:15:45

GitHub #24 Issue 22

Issue 22 (#24)

• bump opencsv to 3.10.
• Moved to use ValidDirectoryWritable from config-utils. Fixes #22

7a0ecc80908605e Jeremy Custenborder 2017-07-22 03:46:29

GitHub #34 Bumped kafka to 1.0.0

Bumped kafka to 1.0.0 (#34)

ee16eaba2f64fb8 Jeremy Custenborder 2017-11-04 03:00:53

GitHub #40 Incorrect offset handling of reprocessed JSON files

Corrected offset. fixes #40

7b36790f3587b20 Jeremy Custenborder 2018-03-27 16:32:38

GitHub #42 Connector Hub Support

Issue 42 (#43)

• Added assembly plugin. fixes #42.
• Corrected. Just a sink.

68b2e59226f0122 Jeremy Custenborder 2018-04-03 00:26:04

GitHub #43 Issue 42

Issue 42 (#43)

• Added assembly plugin. fixes #42.
• Corrected. Just a sink.

68b2e59226f0122 Jeremy Custenborder 2018-04-03 00:26:04

GitHub #45 kafka-run-class: command not found

Updated documentation to the corrected path for the build output. Fixes #45.

d0a498b0bf48e1d Jeremy Custenborder 2018-04-20 19:35:25

GitHub #48 Added support to decompress based on the file extension.

Added support to decompress based on the file extension. (#48)

cac32a7dc7ad8c1 Jeremy Custenborder 2018-04-21 02:13:21

GitHub #50 Add support for extended log format.

Issue 50 (#51)

• Partial support for ELF. #50
• Full support for ELF. Added InputFileDeque the number of calls to list the directory contents. This will query only when needed to reduce the number of stat calls.

b85ffb68636b29b Jeremy Custenborder 2018-05-02 14:02:38

GitHub #51 Issue 50

Issue 50 (#51)

• Partial support for ELF. #50
• Full support for ELF. Added InputFileDeque the number of calls to list the directory contents. This will query only when needed to reduce the number of stat calls.

b85ffb68636b29b Jeremy Custenborder 2018-05-02 14:02:38

No issue

Cleanup of configuration documentation.

cb67558c6a4931b Jeremy Custenborder 2018-04-20 22:23:26

Cleanup of configuration documentation.

ac8c4e452402c16 Jeremy Custenborder 2018-04-20 21:38:03

Updated documentation

1a52576b4719e95 Jeremy Custenborder 2017-11-07 22:07:02

Corrected schema registry image.

464603a3ea40a4b Jeremy Custenborder 2016-11-04 20:04:03

Changed the displayname parameter for a few fields in the CSVRecordProcessorConfig

6e8954d925d9971 Chris Matta 2016-09-15 18:02:51

Moved all of the documentation back to markdown.

45a3eacf9c01464 Jeremy Custenborder 2016-09-07 05:38:53

Changed assembly to ouput a tar.gz

7b2dce5e2c593b6 Jeremy Custenborder 2016-09-07 05:33:11

Changed to include developer SCM data so the releases plugin will upload properly.

cb7abea45b497d6 Jeremy Custenborder 2016-09-07 05:26:38

Updated license header.

243fbb8f6108bcc Jeremy Custenborder 2016-09-07 05:20:13

Deploy to github releases.

f12eba253a6f4b6 Jeremy Custenborder 2016-09-07 05:16:08

Added logging for testing.

3748e346703a5a1 Jeremy Custenborder 2016-08-23 03:35:59

Added confluent repository.

c8610c37fb26fba Jeremy Custenborder 2016-08-23 03:30:09

Initial commit for Jenkinsfile.

139ed2da2514c70 Jeremy Custenborder 2016-08-23 03:26:10

Changes to pull connect-utils from maven central.

a98dc0b7aa32fff Jeremy Custenborder 2016-08-23 03:21:57

Added settings to control the output schema name for a generated schema.

02a0071767974d3 Jeremy Custenborder 2016-07-19 18:22:43

Corrected test cases for maven. Added metadata to the record if configured.

c606245639e26bb Jeremy Custenborder 2016-07-12 13:22:43

Cleanup of refactor in strings.

d61d1d8b5af3ee9 Jeremy Custenborder 2016-07-11 21:56:28

Rename the file once before it has started processing.

a060f567ad6eb10 Jeremy Custenborder 2016-07-11 17:57:17

Added more testing around not having keys defined. This should result in a null schema and a null object ending up in the connect record.

7c49df8804a986f Jeremy Custenborder 2016-07-10 02:28:24

Added more test cases around non defined schemas. Extend SchemaConfig tests to validate the key schema. Refactored CSVRecordProcessor to use data package. Added more documentation to RST.

e2361cc656c32df Jeremy Custenborder 2016-07-10 02:16:31

Hopefully corrected RST.

1851a2b7b12de45 Jeremy Custenborder 2016-07-10 01:15:01

Added more documentation and moved some common functionality out to connect-utils.

00ceb01d64764a2 Jeremy Custenborder 2016-07-10 01:13:51

Cleanup schema generation code. Clarified support for generating a schema based on the the header row. Indexes for specified schemas are indexed based on the header row if it is used. Added checkstyle.

28c0590ebe8f62b Jeremy Custenborder *2016-07-09 1...