- Added support for Tuple type
- Added support for Variant type
- Added support for Nested type
- Refactored Column class so that we use Builder pattern using Lombok
- Refactored recursive Map type parsing to iterative approach using describe_include_subcolumns=1
- Added support for ClickHouse Enum type #370
- Added extra break down of time measurement for insert operations
- Removed 1002 from the retriable exceptions list as it's a catch-all for all other exceptions
- Change Java Client to 0.6.0-patch3 and switch tests to use same Base class
- Added code 107 to the exception list and added more DLQ logging
- Added ExtractTopic transform to our source so that it would work on MSK
- Fixed print vs log bug
- Fixed bug in overlap logic, added more tests to support this
- Fixed null-pointer bug in stop() method
- Updated dependencies
- Fix missing jdbcConnectionProperties setup in ClickHouseWriter.getMutationRequest
- Added support for multiple databases in single stream using a virtual topic #41
- Add support for configuring JDBC properties in connection URL (i.e.
?auto_discovery=true
) - Added minimum version check for ClickHouse (currently 23.3)
- Added support for fixed_string type
- Added support for RowBinaryWithDefaults
- Updated dependencies
- Adjusting default values for some settings (like insert_quorum)
- Added string support for DateTime64
- Fixed writing into nullable Decimal column by @mlivirov in #276
- Adjusting the deduplication token hash by @Paultagoras in #280
- Fixed exception for when an array type column gets null value by @mlivirov in #279
- Support for data ingestion into Array(DateTime64(3)) type columns by @alexshanabrook in #260
- Added more logging to help debug future issues
- Restored send_progress_in_http_headers flag
- Remove send_progress_in_http_headers flag as it conflicts
- Updated tests
- Updated dependencies
- Fix Handle ClickHouse JDBC Client Timeout Exception by @ygrzjh in #252
- Make sure an HTTP request is successfully processed by ClickHouse
- Added additional logging to help debug future issues
- Added 'zkPath' and 'zkDatabase' properties to customize exactly-once state storage
- Bugfix
- Added support for proxy configurations
- Additional test cases
- Additional error codes added to retry list (242, 319, 999)
- Updated dependencies
- Add BYTES type support
- Add Decimal type support
- Additional exception handling
- Retriable Exceptions are now always retried (even when errors.tolerance=all)
- Support for org.apache.kafka.connect.storage.StringConverter
- Added support for
tableRefreshInterval
to re-fetch table changes from ClickHouse
- Additional tests for ExactlyOnce
- Allows customized ClickHouse settings using `clickhouse.settings' property
- Tweaked deduplication behavior to account for dynamic fields
- Added support for `errors.tolerance' and the DLQ
- Support inline schema with org.apache.kafka.connect.data.Timestamp type
- Support inline schema with org.apache.kafka.connect.data.Time type
- Updating Logo
- Updated state handling so that warnings are posted, rather than errors + exceptions.
- Adding 285 TOO_FEW_LIVE_REPLICAS to the retry list
- Tweaking the code to switch to JSON handling when default values are present. This should be more reliable (if the data structure is simple enough) while supporting defaults. This is a temporary solution until we can implement a longer-term fix in core code.
- Added 202 (TOO_MANY_SIMULTANEOUS_QUERIES) Code to retry list Issue
- Added 252 (TOO_MANY_PARTS) to the retry list
- Fix for LowCardinality(t) and LowCardinality(Nullable(t)) Issue
- Fix null exception when getting empty record
- Add UNEXPECTED_END_OF_FILE as RetriableException #98
- Implemented retry mechanism to fix Issue ** Some ClickHouse errors (159 - TIMEOUT_EXCEEDED; 164 - READONLY; 203 - NO_FREE_CONNECTION; 209 - SOCKET_TIMEOUT; 210 - NETWORK_ERROR; 425 - SYSTEM_ERROR) as well as SocketTimeoutException and UnknownHostException will result in the connector retrying the operation (based on configuration). This should help mitigate temporary (but unavoidable) hiccups in network operations, though this list will likely be tweaked over time as well.
- Nullable date columns fix Issue
- Support nullable values in SchemalessRecordConverter. #55
- Add Emojis tests & fix utf-8 bug. #52
- Add manifest.json. #44
- Fix index error in describeTable. #49
- Don't validate JSON records against the table schema. #47
- Add support for Amazon MSK in #46