0.200.0 (2022-11-02)
Pre-release
Pre-release
cloudant-sdks-automation
released this
02 Nov 15:40
·
87 commits
to main
since this release
- [FIXED] README and documentation have been extensively rewritten.
- [BREAKING CHANGE] Rename source connector. Properties files should be updated to
useconnector.class=com.ibm.cloud.cloudant.kafka.SourceChangesConnector
. - [BREAKING CHANGE] Rename sink connector. Properties files should be updated to
useconnector.class=com.ibm.cloud.cloudant.kafka.SinkConnector
. - [BREAKING CHANGE] Configuration parameters have changed for url, database, authentication, and last change sequence.
See README for details. - [BREAKING CHANGE] Source connector flatten, schema generation and omit design documents options have been replaced by
message transforms. See README for details. - [BREAKING CHANGE] Source connector now emits
java.util.Map
(notString
) event values by default. See README for
details. - [BREAKING CHANGE] Source connector now emits
org.apache.kafka.connect.data.Struct
(notString
) event keys. See
README for details. - [BREAKING CHANGE] Source connector now emits tombstone events for deleted documents.
See single message transforms section in README for details. - [BREAKING CHANGE] Converter support for sink connector has changed. See README for details.
- [BREAKING CHANGE] Preserve
_rev
field message values in sink connector.
See sink connector config section in README for more details. - [BREAKING CHANGE] Semantics of
batch.size
configuration parameter changed: for sink connector this value no longer
affects whenflush()
is called. - [BREAKING CHANGE] Sink connector will correctly honour
errors.tolerance
,errors.log.enable
,
anderrors.deadletterqueue.topic.name
configuration parameters.
See the sample sink properties file for a recommended example of how
to configure these to continue processing when non-fatal errors occur. - [BREAKING CHANGE] Renamed from
kafka-connect-cloudant
tocloudant-kafka-connector
and packaged as zipped directory instead of uber jar. See README for installation details. - [BREAKING CHANGE] Publish releases to https://github.com/IBM/cloudant-kafka-connector/releases.
- [UPGRADED] Connector now supports all authentication types via the
cloudant.auth.type
configuration parameter. When
using an authentication type of "iam", the API key is configured via thecloudant.apikey
configuration parameter. - [UPGRADED] Upgraded Gradle distribution from 4.5.1 to 7.4
- [UPGRADED] Upgraded Kafka Connect API to 3.2.1.
- [UPGRADED] Refactored to use the new
cloudant-java-sdk
library.
What's Changed
- Added copyright to DCO1.1.txt by @emlaver in #42
- Updated travis to use docker CouchDB by @ricellis in #43
- Template updates by @ricellis in #44
- ci: Add secrets baseline file by @eiri in #48
- Update Jenkins executor label by @ricellis in #49
- Fix README by @mojito317 in #45
- 50 migrate to new sdk by @emlaver in #51
- Update support email address by @emlaver in #55
- Update gradle version from 4.5.1 to 7.4 by @vmatyusGitHub in #58
- 53: Fix publishing by @tomblench in #59
- Upgrade Kafka to 3.1.0 by @emlaver in #56
- Feature/61 configuration validation by @tomblench in #70
- Support for JSONConverter in sink connector by @tomblench in #71
- Stop removing
_rev
from sink documents by @emlaver in #77 - Re-use Cloudant client in sink connector by @tomblench in #74
- Module rename by @ricellis in #78
- Update links for repo rename/transfer by @ricellis in #80
- [ImgBot] Optimize images by @imgbot in #81
- Document the use of SMTs to customize _id field by @emlaver in #83
- 79 packaging and coordinate renaming by @ricellis in #85
- fix: Only support 1 task in source connector by @tomblench in #87
- feat: Emit tombstones for deleted documents by @tomblench in #88
- Remove use of com.google.common.collect.Streams by @emlaver in #91
- 84 handle per event errors by @tomblench in #89
- chore: exclude members from DCO check by @ricellis in #95
- fix: remove _running/stop machinery by @tomblench in #99
- 63 schema flatten smts by @ricellis in #93
- clean up source code and tests by @emlaver in #92
- chore: remove org.json dependency by @tomblench in #102
- feat: add isDesignDocument predicate by @ricellis in #106
- feat: batch size limits in options by @tomblench in #108
- refactor: connector moves and renames by @mojito317 in #110
- fix: ensure sink task is partitioned properly by @tomblench in #109
- chore: refactor ConnectRecordMapper, rename to SinkRecordToDocument by @tomblench in #113
- refactor: move classes to a more sensible package hierarchy by @mojito317 in #115
- chore: cleanup warnings by @ricellis in #119
- chore: tidy up ConfigDef to aid README generation by @tomblench in #114
- fix: convert LazilyParsedNumbers to specific Number types by @ricellis in #118
- chore: rewrite documents and split out sections by @tomblench in #117
- refactor: source partition offset map by @ricellis in #120
- fix: ensure collection (array/list) types are converted properly by @tomblench in #121
- ci: sign the jar by @ricellis in #123
- fix: use LONGPOLL with one minute timeout by @tomblench in #127
- docs: add DLQ and error options to sample sink properties by @tomblench in #129
- fix: change
cloudant.since
logic to prefer saved offset, if present by @tomblench in #125 - fix: failing test by @tomblench in #132
- chore: Use parameterized logging where possible by @tomblench in #131
- docs: fix SMT flatten syntax by @tomblench in #134
- chore: update cloudant-java-sdk to 0.4.0 by @ricellis in #133
- feat: change record key to struct including url and db by @tomblench in #136
- chore: update gradle wrapper to 7.4 by @tomblench in #141
- build: package as zip instead of jar by @ricellis in #142
- update readme, changes, version by @tomblench in #137
New Contributors
- @emlaver made their first contribution in #42
- @eiri made their first contribution in #48
- @mojito317 made their first contribution in #45
- @vmatyusGitHub made their first contribution in #58
- @imgbot made their first contribution in #81
Full Changelog: 0.100.2-kafka-1.0.0...v0.200.0