v1.10.1

release v1.10.1

v1.10.0

For installation and running instructions, see Get started.

Main changes

SQL features

• SQL commands:
  • Supports specifying the authorization and omitting the schema name when creating a schema. #16806
  • Supports session window in batch and emit-on-window-close mode. #17098
  • Supports fetching multiple rows from subscription cursor. #16764
• SQL functions & operators:
  • Supports has_table_privilege(), has_schema_privilege(), and has_any_column_privilege(). #16674
  • Supports quote_literal() and quote_nullable(). #16807
  • Supports pg_get_keywords(). #17033
  • Supports jsonb_set(). #17124
  • Supports user-defined aggregate functions for embedded Python and JavaScript UDFs. #16874
  • Allows the specified time zone of AT TIME ZONE to be non-literal. #17395
• System catalog:
  • Supports rw_catalog.actor_id_to_ddl and rw_catalog.fragment_id_to_ddl. #17229

Connectors

• Avro schemas with "default": "NaN" and positive and negative infinities, are supported as float and double types. #17309
• Supports ingesting simple AVRO MAP types as JSONB. #16948
• Supports ingesting avro uuid types as varchar. #17069
• Supports ingesting avro with internal Ref types. #17052
• Adds aws prefix to AWS related parameters when creating a source or sink. #16671
• Supports using AWS IAM to connect to Amazon MSK. #16625
• Adds pubsub.parallelism under the WITH option for Google PubSub source. #16733
• Supports INCLUDE TIMESTAMP [AS] clause for MySQL, PostgreSQL, and MongoDB CDC tables.#16833
• Supports additional metadata columns for CDC tables. #17051
• Automatically maps upstream table schema when creating MySQL and PostgreSQL tables. #16986
• Sets a network timeout for JDBC sink connections. #17244
• Enables sink decouple by default for Kafka, Kinesis, Pulsar, Google Pub/Sub, NATS, MQTT, ClickHouse sinks. #17221
• Supports the KEY ENCODE clause when creating a sink. #16377
• Supports FORMAT PLAIN ENCODE AVRO for Kafka sinks. #17216
• Supports DynamoDB sink. #16670
• Supports Microsoft SQL Server sinks for self-hosted SQL Server and Azure SQL. #17154
• Supports OpenSearch sink. #16330
• Supports checkpoint decouple for StarRocks sinks. #16816
• Supports checkpoint decouple for Delta Lake sinks. #16777
• Supports sinking serial types. #16969

Cluster configuration changes

• Sets arrangement backfill as the default. #14846
• Supports spill hash join to avoid OOM issue. #17122
• Supports spill hash aggregation for batch queries. #16771
• Changes the algorithm that calculates the reserve memory size. #16992

Fixes

• Improves error message and location of cursor. #16959
• Improves error message when trying to create CDC source with columns. #16636
• Allows GRANT and REVOKE privileges on views. #16699

Full Changelog: v1.9.1...v1.10.0

v1.10.0-rc.3

release v1.10.0-rc.3

v1.10.0-rc.2

release v1.10.0-rc.2

v1.10.0-rc.1

release v1.10.0-rc.1

v1.9.2

release v1.9.2

v1.9.1

For installation and running instructions, see Get started.

Main changes

SQL features

• Query syntax:
  • Supports non-append-only temporal joins, where the outer side is not required to be append-only. #16286
• SQL commands:
  • Supports DISCARD ALL command for Npgsql compatibility. #16432
  • Supports creating, dropping, altering, and showing subscriptions. #14831
  • Supports cursors for subscription queues. #15180
  • Supports altering stream rate limit for sources and tables with a source. #16399
  • Supports RECOVER command to trigger an ad-hoc recovery. #16259
• SQL functions & operators:
  • Supports using a single ASCII character as an escape character with the LIKE clause. #16057
  • Supports jsonb_populate_record() and jsonb_populate_recordset(). #13421
• System catalog:
  • Supports system table rw_iceberg_files for displaying the files of an Iceberg source or table. #16180
  • Supports system table rw_iceberg_snapshot for listing all snapshots. #16175

Connectors

• Provides stable support for SQLAlchemy 2.0. risingwavelabs/sqlalchemy-risingwave#29
• Deprecates s3 connector. #16337
• Supports generated columns for non-shared CDC tables. #16522
• Supports time travel for Iceberg sources. #15866
• Blocks sink creation until backfill is completed by default. #16249
• Supports Kafka connector parameter properties.request.required.acks. #16482
• Adds connector parameter ssl.mode for PostgreSQL and Neon source connector. #15690
• Adds connector parameter ssl.mode for MySQL source connector. #16579
• Supports parameters snapshot.interval and snapshot.batch_size under WITH options when creating a table from a CDC source. #16426
• Supports implicitly converting numeric types from PostgreSQL sources into rw_int256 or varchar. #16346
• Supports configuring the timeout of CDC sources. #16598
• Supports timestamptz.handling.mode formatting option when creating a source with PLAIN, UPSERT, or DEBEZIUM JSON formats. #16265
• Only uses fragment ID as group ID for Kafka sources. #16111
• Supports cluster URLs for Redis sink connector. #16034
• Supports creating Delta sinks with GCS. #16182
• Supports Snowflake sink connector. #15429
• Supports creating upsert type BigQuery sinks. #15780

Installation and deployment

• Sets PostgreSQL as the default meta store when deploying with Docker Compose. #16724

Cluster configuration changes

• Supports using ALTER SYSTEM to set a system-wide default value for a session parameter. #16062
• Supports setting streaming_rate_limit to zero. #16333
• Supports configuring the reserved memory bytes of the compute node by using RW_RESERVED_MEMORY_BYTES runtime parameter and reserved-memory-bytes startup option. #16433
• Introduce new timeout and retry configurations for ObjectStore and deprecate ambiguous timeout configurations. #16231

Fixes

• Properly convert -inf, +inf, and nan types to null for JDBC sinks. #16230
• Handles sinking -inf, +inf, and nan types for ClickHouse, Doris, and StarRocks sink connectors. #15664
• Fixes an issue where DELETE events could not be sinked if the primary key is uuid type for JDBC sinks.#16447
• Fixes an issue where enum types from PostgreSQL could not be ingested as varchar types. #16423
• Fixes sources with encode avro on decimal ingesting. #16202
• Fixes sources with encode avro on bytes/fixed/decimal default value. #16414

Full Changelog: v1.8.0...v1.9.1

v1.9.1-rc.2

release v1.9.1-rc.2

v1.9.1-rc.1

release v1.9.1-rc.1

v1.9.0

For installation and running instructions, see Get started.

Main changes

SQL features

• Query syntax:
  • Supports non-append-only temporal joins, where the outer side is not required to be append-only. #16286
• SQL commands:
  • Supports DISCARD ALL command for Npgsql compatibility. #16432
  • Supports creating, dropping, altering, and showing subscriptions. #14831
  • Supports cursors for subscription queues. #15180
  • Supports altering stream rate limit for sources and tables with a source. #16399
  • Supports RECOVER command to trigger an ad-hoc recovery. #16259
• SQL functions & operators:
  • Supports using a single ASCII character as an escape character with the LIKE clause. #16057
  • Supports jsonb_populate_record() and jsonb_populate_recordset(). #13421
• System catalog:
  • Supports system table rw_iceberg_files for displaying the files of an Iceberg source or table. #16180
  • Supports system table rw_iceberg_snapshot for listing all snapshots. #16175

Connectors

• Provides stable support for SQLAlchemy 2.0. risingwavelabs/sqlalchemy-risingwave#29
• Deprecates s3 connector. #16337
• Supports generated columns for non-shared CDC tables. #16522
• Supports time travel for Iceberg sources. #15866
• Blocks sink creation until backfill is completed by default. #16249
• Supports Kafka connector parameter properties.request.required.acks. #16482
• Adds connector parameter ssl.mode for PostgreSQL and Neon source connector. #15690
• Adds connector parameter ssl.mode for MySQL source connector. #16579
• Supports parameters snapshot.interval and snapshot.batch_size under WITH options when creating a table from a CDC source. #16426
• Supports implicitly converting numeric types from PostgreSQL sources into rw_int256 or varchar. #16346
• Supports configuring the timeout of CDC sources. #16598
• Supports timestamptz.handling.mode formatting option when creating a source with PLAIN, UPSERT, or DEBEZIUM JSON formats. #16265
• Only uses fragment ID as group ID for Kafka sources. #16111
• Supports cluster URLs for Redis sink connector. #16034
• Supports creating Delta sinks with GCS. #16182
• Supports Snowflake sink connector. #15429
• Supports creating upsert type BigQuery sinks. #15780

Installation and deployment

• Sets PostgreSQL as the default meta store when deploying with Docker Compose. #16724

Cluster configuration changes

• Supports using ALTER SYSTEM to set a system-wide default value for a session parameter. #16062
• Supports setting streaming_rate_limit to zero. #16333
• Supports configuring the reserved memory bytes of the compute node by using RW_RESERVED_MEMORY_BYTES runtime parameter and reserved-memory-bytes startup option. #16433
• Introduce new timeout and retry configurations for ObjectStore and deprecate ambiguous timeout configurations. #16231

Fixes

• Properly convert -inf, +inf, and nan types to null for JDBC sinks. #16230
• Handles sinking -inf, +inf, and nan types for ClickHouse, Doris, and StarRocks sink connectors. #15664
• Fixes an issue where DELETE events could not be sinked if the primary key is uuid type for JDBC sinks.#16447
• Fixes an issue where enum types from PostgreSQL could not be ingested as varchar types. #16423
• Fixes sources with encode avro on decimal ingesting. #16202
• Fixes sources with encode avro on bytes/fixed/decimal default value. #16414

Full Changelog: v1.8.0...v1.9.0