norconex-committer-core-2.0.3

Release notes, binary downloads, and documentation can all be found on Norconex Committer Core website: http://www.norconex.com/collectors/committer-core/

norconex-committer-core-2.0.2

Release notes, binary downloads, and documentation can all be found on Norconex Committer Core website: http://www.norconex.com/collectors/committer-core/

norconex-committer-core-2.0.1

Release notes, binary downloads, and documentation can all be found on Norconex Committer Core website: http://www.norconex.com/collectors/committer-core/

norconex-committer-core-2.0.0

• Now licensed under The Apache License, Version 2.0.
• ICommitter now expects InputStream instead of files.
• FileSystemCommitter now uses a more friendly date-based directory structure for storing files.
• The document reference is now part of IAddOperation.
• Now requires Java 7 or higher.

Binary download: http://www.norconex.com/collectors/committer-core/download

norconex-committer-1.2.0

• New MultiCommitter class allowing the use multiple committers.
• New NilCommitter class swallowing the queuing and commit requests (i.e. doing nothing) but prints how many were queued or committed (but fake).
• New configuration options for AbstractBatchCommitter and subclasses:
  • Max number of retries between commit failures
  • How long to wait between attempts.
• AbstractFileQueueCommitter and its subclasses now periodically delete empty directories under their queue directory. This can greatly reduce the directory scanning time when dealing with thousands/millions of files, improving performance.

norconex-committer-1.1.0

This release is backward compatible, but has several deprecations. List of changes:

• Rewrite of abstract committer classes to make it easier/more intuitive to create your own committer implementation. BaseCommmitter, BatchableCommitter, and FileSystemQueueCommmitter have been deprecated and are replaced by AbstractCommitter, AbstractFileQueueCommitter, AbstractBatchCommitter, and AbstractMappedCommitter.
• Former batchSize on BatchableCommitter is now queueSize on AbstractCommitter, and reflect the queue of files to be committed.
• A new "commitBatchSize" attribute has been introduced on new AbstractBatchCommitter class, and represents the quantity of files/items to be sent in a single request to the target repository (e.g. search engine).
• Removed unused dependency.