YDB CLI 2.4.0

Released on May 24, 2023. To update to version 2.4.0, select the Downloads section.

Features

• Added the ability to upload multiple files in parallel with the command ydb import file.
• Added support for deleting column tables for the command ydb scheme rmdir --recursive.
• Improved stability of the command ydb workload topic.

Full Changelog: CLI_2.3.0...CLI_2.4.0

YDB Server 23.1.26

Functionality:

• Added initial table scan when creating a CDC changefeed. Now, you can export all the data existing at the time of changefeed creation.
• Added atomic index replacement. Now, you can atomically replace one pre-defined index with another. This operation is absolutely transparent for your application. Indexes are replaced seamlessly, with no downtime.
• Added the audit log: Event stream including data about all the operations on YDB objects.

Performance:

• Improved formats of data exchanged between query stages. As a result, we accelerated SELECTs by 10% on parameterized queries and by up to 30% on write operations.
• Added autoconfiguring for the actor system pools based on the workload against them. This improves performance through more effective CPU sharing.
• Optimized the predicate logic: Processing of parameterized OR or IN constraints is automatically delegated to DataShard.
• (Experimental) For scan queries, you can now effectively search for individual rows using a primary key or secondary indexes. This can bring you a substantial gain in performance in many cases. Similarly to regular queries, to use a secondary index, you need to explicitly specify its name in the query text using the VIEW keyword.
• The query's computational graph is now cached at query runtime, reducing the CPU resources needed to build the graph.

Bug fixes:

• Fixed bugs in the distributed data warehouse implementation. We strongly recommend all our users to upgrade to the latest version.
• Fixed the error that occurred on building an index on NOT NULL columns.
• Fixed statistics calculation with MVCC enabled.
• Fixed errors with backups.
• Fixed the race condition that occurred at splitting and deleting a table with SDC.

Full Changelog: 22.5.10...23.1.26

YDB CLI 2.3.0

Released on May 5, 2023. To update to version 2.3.0, select the Downloads section.

What's new:

• Added interactive query execution mode. It can be launched using ydb yql command without arguments. This mode is experimental and is a subject to change.
• Added ydb table index rename command for atomic secondary index replacement or renaming.
• Added ydb workload topic command section that allows to run a workload of writes and reads to topics.
• Added --recursive option for ydb scheme rmdir command that allows to remove a directory recursively with all its content.
• Added topic and coordination node support for ydb scheme describe command.
• Added --commit option for ydb topic consumer command to commit offset for consumer.
• Added --columns option for ydb import file csv|tsv command to list column names in, instead of placing it into file header.
• Added --newline-delimited option for ydb import file csv|tsv command that confirms that there is no newline characters inside records which allows to read from several sections of a file simultaneously.

Bug fixes:

• Fixed a bug that caused executing the ydb import file command to consume too much memory and CPU.

Full Changelog: CLI_2.2.0...CLI_2.3.0

YDB CLI 2.2.0

Released on March 3, 2023. To update to version 2.2.0, select the Downloads section.

What's new:

• Fixed the error that didn't allow specifying supported compression algorithms when adding a topic consumer.
• Added support for streaming YQL scripts and queries based on parameters transferred via stdin.
• YQL query parameter values can now be transferred from a file.
• Password input requests are now output to stderr instead of stdout.
• You can now save the root CA certificate path in a profile.
• Added a global parameter named --profile-file to use the specified file as storage for profile settings.
• Added a new type of load testing: ydb workload clickbench.

Full Changelog: CLI_2.1.1...CLI_2.2.0

YDB Server 22.5.10

What's new:

• Added changefeed configuration settings to transfer additional info about changes to topic.
• Added support of rename for tables with TTL setting enabled.
• Added retention period setting for cdc-log.

BugFixes & Improvements:

• Fixed: Error inserting 0 rows via BulkUpsert.
• Fixed: Error when importing Date/DateTime columns from CSV.
• Fixed: Error importing data from CSV with line breaks in values.
• Fixed: Error importing data from CSV with empty values.
• Improved Query Processing performance (WorkerActor was replaced with SessionActor).
• DataShard compaction now starts immediately after split or merge operations.

Full Changelog: 22.4.44...22.5.10

YDB CLI 2.1.1

Released on December 30, 2022. To update to version 2.1.1, select the Downloads section.

Improvements:

• Added support for the --stats parameter of the ydb scheme describe command for column-oriented tables.
• Added support for Parquet files to enable their import with the ydb import command.
• Added support for additional logging and retries for the ydb import command.

Full Changelog: CLI_2.1.0...CLI_2.1.1

YDB Server 22.4.44

• Minor bugfix and improvements
• Fixed security issue (CVE-2022-28228)

Full Changelog: 22.4.31...22.4.44

YDB CLI 2.1.0

Released on November 18, 2022. To update to version 2.1.0, select the Downloads section.

What's new:

• You can now create a profile non-interactively.
• Added the ydb config profile update and ydb config profile replace commands to update and replace profiles, respectively.
• Added the -1 parameter for the ydb scheme ls command to enable output of a single object per row.
• You can now save the IAM service URL in a profile.
• Added support for username and password-based authentication without specifying the password.
• Added support for AWS profiles in the ydb export s3 command.
• You can now create profiles using stdin. For example, you can pass the YC CLI yc ydb database get information command output to the ydb config profile create command input.

Bug fixes:

• Fixed the error when request results were output in JSON-array format incorrectly if they included multiple server responses.
• Fixed the error that disabled profile updates so that an incorrect profile was used.

Full Changelog: https://github.com/ydb-platform/ydb/commits/CLI_2.1.0

YDB Server 22.4.31

YDB Topics and Change Data Capture (CDC):

• A new Topic API is introduced in YDB. YDB topic is an entity for storing unstructured messages and delivering them to multiple subscribers.
• A new TopicAPI is supported in YDB CLI and SDK. The API enables topic management operations and streaming message publish/subscribe.
• Added support of table data changes capture into a topic using CDC change feeds.

SDK:

• YDB Topics support added in YDB Golang SDK.
• Official database/sql driver to work with YDB is now supported for Golang.

Embedded UI:

• CDC change feeds and Secondary Indexes are displayed in Database scheme hierarchy as separate objects.
• Visualization of query explain plan was completely redesigned.
• Storage groups with problems are now more visible.
• Various optimizations based on UX assessment

Query Processing:

• Added Query Processor 2.0 — a brand new version of execution engine for OLTP-queries with significant improvements comparing to previous one.
• Improved performance: up to 10% better read throughout, up to 60% better write throughput.
• A feature for NOT NULL constraint for Primary Key has been added. Can be set up at table creation stage only.
• Added support of online secondary index rename without stopping the service.
• Improved query explain representation now includes graph for physical operators.

Core:

• Read-only transactions now use a consistent snapshot that doesn't conflict with concurrent writes.
• Added BulkUpsert support for tables with async secondary indexes.
• Added TTL support for tables with async secondary indexes.
• Added option to compress data during export to S3.
• Added initial version of audit log for DDL statements.
• Added support of authentication with static credentials.
• Added system tables for query performance diagnostics.

Full Changelog: 22.2.47...22.4.31