Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add v7.2.0 release notes #14154

Merged
merged 123 commits into from
Jun 29, 2023
Merged
Changes from 37 commits
Commits
Show all changes
123 commits
Select commit Hold shift + click to select a range
15aca45
Create release-7.2.0.md
qiancai Jun 5, 2023
6d9cd25
Update release-7.2.0.md
joey-yez Jun 9, 2023
88d62c1
added supplementary info
qiancai Jun 9, 2023
5f3f94d
Update releases/release-7.2.0.md
qiancai Jun 9, 2023
4b96d67
Enabling tidb_remove_orderby_in_subquery by default
songrijie Jun 11, 2023
7c75c9d
CMD to show the progress of stats collection
songrijie Jun 11, 2023
b76254f
analyze enhancement: skip useless
songrijie Jun 11, 2023
d6599bd
runaway query management
songrijie Jun 11, 2023
8a41a89
Reduce the time consumed by "admin check table/index"
songrijie Jun 11, 2023
0b1ed24
Apply suggestions from code review
qiancai Jun 12, 2023
4aaf2d0
Apply suggestions from code review
qiancai Jun 12, 2023
8843752
Apply suggestions from code review
qiancai Jun 12, 2023
1787424
adjust the location of DM features
qiancai Jun 12, 2023
a8b6cae
add release note: DDL tasks support pause and resume operations
qiancai Jun 13, 2023
ce19b22
Update releases/release-7.2.0.md
qiancai Jun 13, 2023
4b6887b
Update release-7.2.0.md
joey-yez Jun 13, 2023
66926d9
remove empty placeholders
qiancai Jun 14, 2023
1e64322
Update release-7.2.0.md
joey-yez Jun 14, 2023
a637bef
Update releases/release-7.2.0.md
qiancai Jun 14, 2023
c15b147
update tw name and number
qiancai Jun 14, 2023
3168b7c
Merge branch 'v7.2.0/release_notes' of https://github.com/qiancai/doc…
joey-yez Jun 14, 2023
012ec6e
enhance hint parsing and support more patterns for binding from history
songrijie Jun 14, 2023
2976c50
Apply suggestions from code review
qiancai Jun 14, 2023
a1ca9cb
Update releases/release-7.2.0.md
qiancai Jun 15, 2023
49c674a
Update release-7.2.0.md
joey-yez Jun 15, 2023
3574bd9
Update releases/release-7.2.0.md
qiancai Jun 15, 2023
8ba4dad
Update releases/release-7.2.0.md
qiancai Jun 15, 2023
e5c12bd
address comments
songrijie Jun 15, 2023
39e0aab
Update release-7.2.0.md
joey-yez Jun 15, 2023
688c889
Update releases/release-7.2.0.md
qiancai Jun 15, 2023
dae152f
Update release-7.2.0.md
joey-yez Jun 16, 2023
c3da810
Update releases/release-7.2.0.md
qiancai Jun 16, 2023
8463a39
Update releases/release-7.2.0.md
qiancai Jun 16, 2023
28c83a1
Apply suggestions from code review
qiancai Jun 16, 2023
9b4fa72
Apply suggestions from code review
qiancai Jun 16, 2023
7c53d77
format updates
qiancai Jun 16, 2023
9bd95ee
Update releases/release-7.2.0.md
qw4990 Jun 16, 2023
5d2ee3c
add the issue number for two features
qiancai Jun 16, 2023
494045b
remove a feature description
qiancai Jun 16, 2023
2f240e9
Introduce fix control
songrijie Jun 18, 2023
3d343d9
Update releases/release-7.2.0.md
qiancai Jun 19, 2023
85826c8
compatibility changes: add tidb_expensive_txn_time_threshold and TiCDC
Oreoxmt Jun 19, 2023
23ea804
Update releases/release-7.2.0.md
hfxsd Jun 19, 2023
3d960bb
Update releases/release-7.2.0.md
hfxsd Jun 19, 2023
811d54f
Apply suggestions from code review
ran-huang Jun 19, 2023
9508185
Apply suggestions from code review
hfxsd Jun 19, 2023
db1d404
Update releases/release-7.2.0.md
ran-huang Jun 19, 2023
15da354
Apply suggestions from code review
hfxsd Jun 19, 2023
5232f37
Apply suggestions from code review
Oreoxmt Jun 19, 2023
3a19f79
Apply suggestions from code review
ran-huang Jun 20, 2023
26289cc
Update releases/release-7.2.0.md
ran-huang Jun 20, 2023
2357c57
Apply suggestions from code review
qiancai Jun 20, 2023
69b69c1
Update releases/release-7.2.0.md
joey-yez Jun 20, 2023
33db81d
Apply suggestions from code review
qiancai Jun 20, 2023
5e09703
Apply suggestions from code review
qiancai Jun 20, 2023
3a0699d
Update releases/release-7.2.0.md
qiancai Jun 20, 2023
e107c14
add three compatibility changes
qiancai Jun 20, 2023
27a5442
Apply suggestions from code review
Oreoxmt Jun 20, 2023
78c6ced
Apply suggestions from code review
ran-huang Jun 21, 2023
3ca2e06
Apply suggestions from code review
qiancai Jun 21, 2023
f378f40
Apply suggestions from code review
hfxsd Jun 21, 2023
2e1c9cd
Update releases/release-7.2.0.md
hfxsd Jun 21, 2023
8277323
Update releases/release-7.2.0.md
hfxsd Jun 21, 2023
900a650
Apply suggestions from code review
qiancai Jun 21, 2023
ed5b893
format upates
qiancai Jun 21, 2023
efdd29b
Apply suggestions from code review
qiancai Jun 21, 2023
08bc45b
Apply suggestions from code review
qiancai Jun 24, 2023
14c1c31
Update releases/release-7.2.0.md
qiancai Jun 24, 2023
bd6f95d
Update release-7.2.0.md
qiancai Jun 24, 2023
5b20c2a
format updates
qiancai Jun 24, 2023
dbac868
add contibutors
qiancai Jun 25, 2023
17fb9e8
Update releases/release-7.2.0.md
qiancai Jun 25, 2023
619befa
Apply suggestions from code review
Oreoxmt Jun 25, 2023
6af529f
Apply suggestions from code review
qiancai Jun 25, 2023
dee33d6
implement comments from wjhuang2016
qiancai Jun 25, 2023
b1a86df
remove improvements and bug fixes already covered in v7.1.0
qiancai Jun 25, 2023
946034d
remove #43294 as the issue for it has been covered by v7.1.0
qiancai Jun 25, 2023
a8163fd
Apply suggestions from code review
qiancai Jun 25, 2023
c02f561
Apply suggestions from code review
qiancai Jun 25, 2023
96e9818
Apply suggestions from code review
hfxsd Jun 25, 2023
8b9e5f7
Update releases/release-7.2.0.md
hfxsd Jun 25, 2023
56c4802
Apply suggestions from code review
Oreoxmt Jun 26, 2023
1b85978
Update releases/release-7.2.0.md
Defined2014 Jun 26, 2023
ef13845
Apply suggestions from code review
qiancai Jun 26, 2023
ca80de9
fix comment format issue that causes build failures
qiancai Jun 26, 2023
3ec4365
Apply suggestions from code review
ran-huang Jun 26, 2023
3d5242c
Update releases/release-7.2.0.md
ran-huang Jun 26, 2023
61b8528
Update releases/release-7.2.0.md
qiancai Jun 26, 2023
ea5ec8a
Update releases/release-7.2.0.md
qiancai Jun 26, 2023
3c56033
Update releases/release-7.2.0.md
qiancai Jun 26, 2023
1294326
add key features
qiancai Jun 26, 2023
4a3cb10
Update release-7.2.0.md
qiancai Jun 26, 2023
24581bc
Apply suggestions from code review
ran-huang Jun 27, 2023
0599dfc
Apply suggestions from code review
hfxsd Jun 27, 2023
38af09a
lightweight initial stats GA
songrijie Jun 27, 2023
924ec53
Merge branch 'v7.2.0/release_notes' of https://github.com/qiancai/doc…
songrijie Jun 27, 2023
a265a97
Update releases/release-7.2.0.md
qiancai Jun 27, 2023
9e6d665
Apply suggestions from code review
qiancai Jun 27, 2023
c8674dc
Apply suggestions from code review
Oreoxmt Jun 27, 2023
eb9a251
Apply suggestions from code review
qiancai Jun 27, 2023
00bc4e2
Update releases/release-7.2.0.md
qiancai Jun 27, 2023
851a5fb
Apply suggestions from code review
qiancai Jun 27, 2023
94da8d0
Update releases/release-7.2.0.md
qiancai Jun 27, 2023
58b8f89
adjust the order of system variables
qiancai Jun 27, 2023
e50833e
add two new TiKV parameters
qiancai Jun 27, 2023
49db470
Apply suggestions from code review
qiancai Jun 28, 2023
c6be3c1
Update releases/release-7.2.0.md
qiancai Jun 28, 2023
e876e23
Update releases/release-7.2.0.md
ran-huang Jun 28, 2023
8fee094
Apply suggestions from code review
qiancai Jun 28, 2023
b4f5991
fix a broken link
qiancai Jun 28, 2023
13db9ab
Update releases/release-7.2.0.md
ran-huang Jun 28, 2023
4407eba
Apply suggestions from code review
qiancai Jun 28, 2023
d85aa0d
remove the tw info
qiancai Jun 28, 2023
034713f
Update releases/release-7.2.0.md
qiancai Jun 28, 2023
2a3f11d
Merge remote-tracking branch 'upstream/master' into v7.2.0/release_notes
qiancai Jun 28, 2023
ddc73b9
fix broken links
qiancai Jun 28, 2023
6b354e3
Update releases/release-7.2.0.md
hfxsd Jun 29, 2023
43fa02a
add 7.2 to toc
qiancai Jun 29, 2023
4b1120f
add DMR for 7.2
qiancai Jun 29, 2023
b84eebb
Update releases/release-7.2.0.md
qiancai Jun 29, 2023
46953e2
Apply suggestions from code review
qiancai Jun 29, 2023
f365960
Update releases/release-7.2.0.md
ran-huang Jun 29, 2023
5e63f5e
Update upgrade-tidb-using-tiup.md
qiancai Jun 29, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
243 changes: 243 additions & 0 deletions releases/release-7.2.0.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,243 @@
---
title: TiDB 7.2.0 Release Notes
summary: 了解 TiDB 7.2.0 版本的新功能、兼容性变更、改进提升,以及错误修复。
---

# TiDB 7.2.0 Release Notes

发版日期:2023 年 x 月 x 日

TiDB 版本:7.2.0

试用链接:[快速体验](https://docs.pingcap.com/zh/tidb/v7.2/quick-start-with-tidb) | [下载离线包](https://cn.pingcap.com/product-community/)

在 7.2.0 版本中,你可以获得以下关键特性:

<!-- 关键特性表格 placeholder-->

## 功能详情

### 性能

* 新增支持下推两个[窗口函数](/tiflash/tiflash-supported-pushdown-calculations.md) 至 TiFlash [#7427](https://github.com/pingcap/tiflash/issues/7427) @[xzhangxian1008](https://github.com/xzhangxian1008) **tw@qiancai** <!--1310-->
qiancai marked this conversation as resolved.
Show resolved Hide resolved

* `FIRST_VALUE`
* `LAST_VALUE`

* TiFlash 支持 pipeline 执行模型(实验特性) [#6518](https://github.com/pingcap/tiflash/issues/6518) @[SeaRise](https://github.com/SeaRise) **tw@ran-huang** <!--1440-->

在 v7.2.0 版本之前,TiFlash 引擎中各个任务在执行时,需要自行申请线程资源。TiFlash 引擎通过控制任务数的方式限制线程资源使用,以避免线程资源超用,但是并不能完全避免。在 v7.2.0 版本中,TiFlash 引入 pipeline 执行模型,对所有线程资源进行统一管理,并对所有任务的执行进行统一调度,充分利用线程资源,同时避免资源超用。新增系统变量 [`tidb_enable_tiflash_pipeline_model`](/system-variables.md#tidb_enable_tiflash_pipeline_model) 用于设定是否启用 pipeline 执行模型。
ran-huang marked this conversation as resolved.
Show resolved Hide resolved

更多信息,请参考[用户文档](/tiflash/tiflash-pipeline-model.md)。

* 降低 TiFlash 等待 schema 同步的时延 [#7630](https://github.com/pingcap/tiflash/issues/7630) @[hongyunyan](https://github.com/hongyunyan) **tw@qiancai** <!--1361-->
flowbehappy marked this conversation as resolved.
Show resolved Hide resolved

当表的 schema 变动时,TiFlash 需要及时和 TiKV 同步表的 schema 信息。在 v7.2.0 版本之前,TiFlash 访问表数据时,如果检测到某张表的 schema 变动时,会同步所有表的 schema 信息。即使一张表没有 TiFlash 副本,TiFlash 也会同步该表的 schema 信息。当数据库中有大量表时,读取一张表的数据需要同步所有表的 schema 信息,schema 同步的时延非常高。在 v7.2.0 版本中,TiFlash 优化 schema 同步机制,只同步包含 TiFlash 副本的表的 schema 信息,并且当检测到某张表的 schema 变动时,只同步该表的 schema 信息,降低 TiFlash 同步 schema 的时延。该优化自动生效,不需要任何设定调整。
joey-yez marked this conversation as resolved.
Show resolved Hide resolved

qiancai marked this conversation as resolved.
Show resolved Hide resolved
* 提升统计信息收集的性能 [#issue号](链接) @[xuyifangreeneyes](https://github.com/xuyifangreeneyes) **tw@hfxsd** <!--1352-->
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

v7.2.0 优化了统计信息的收集策略,会选择跳过收集 JSON/BLOB 类型的列的统计信息,收集这些列的统计信息需要占用较大的内存但这些列的统计信息对优化器进行决策的价值不高。该优化能降低统计信息收集的内存使用,提高其稳定性。

qiancai marked this conversation as resolved.
Show resolved Hide resolved

v7.2.0 优化了统计信息的收集策略,会选择跳过一部分重复的信息,以及对优化器价值不高的信息,提升统计信息收集的整体速度达 30% 。 这个提升有利于 TiDB 对数据库对象的统计信息进行更及时的更新,使得生成的执行计划更准确, 从而达到提升数据库整体性能的目的。

* 提升表和索引一致性检查的性能 [#issue号](链接) @[wjhuang2016](https://github.com/wjhuang2016) **tw@qiancai** <!--1436-->
qiancai marked this conversation as resolved.
Show resolved Hide resolved

TiDB 在新版本中优化了数据一致性校验的方式,大幅提升了 [`ADMIN CHECK [TABLE|INDEX]`](/sql-statements/sql-statement-admin-check-table-index.md) 的执行效率, 性能提升接近 200 倍。 这个能力可以大幅减少大型表数据一致性检查的时间, 提升运维体验。 设置 [`tidb_enable_fast_table_check`](链接) 为 `TRUE` 启用这个新机制。
qiancai marked this conversation as resolved.
Show resolved Hide resolved

更多信息,请参考[用户文档](链接)
qiancai marked this conversation as resolved.
Show resolved Hide resolved

### 稳定性

* 自动管理资源超出预期的查询 (实验特性) [#43691](https://github.com/pingcap/tidb/issues/43691) @[Connor1996](https://github.com/Connor1996) @[CabinfeverB](https://github.com/CabinfeverB) @[glorv](https://github.com/glorv) @[HuSharp](https://github.com/HuSharp) @[nolouch](https://github.com/nolouch) **tw@hfxsd** <!--1411-->

突发的 SQL 性能问题引发数据库整体性能下降,是数据库稳定性最常见的挑战。 造成 SQL 性能问题的原因有很多, 有可能是未经充分测试的新 SQL,数据量剧烈变化,执行计划突变等等,这些问题很难从源头上完全规避。 TiDB 在 v7.2.0 加入了对资源超出预期的查询的管理能力,在上述问题发生时,能够快速降低影响范围。

用户可以针对某个资源组 (Resource Group) 设置查询的最长执行时间。 当查询的执行时间超过设置时, 自动降低查询的优先级或者取消查询。 用户还可以设置在一段时间内通过文本立即匹配已经识别出的查询, 从而避免问题查询的并发度太高时,在识别阶段就造成大量消耗的情况。

对资源超出预期查询的自动管理, 为用户提供了有效的手段,快速应对突发的查询性能问题,降低问题对数据库整体性能的影响,从而提升数据库的稳定性。

更多信息,请参考[用户文档](/tidb-resource-control.md###管理Runaway查询)。
hfxsd marked this conversation as resolved.
Show resolved Hide resolved

* 增强对历史执行计划的绑定能力 [#39199](https://github.com/pingcap/tidb/issues/39199) @[qw4990](https://github.com/qw4990) **tw@Oreoxmt** <!--1349-->

新版本的 TiDB 对历史执行计划绑定的能力做了进一步增强。 一方面加强了对复杂语句的解析和绑定, 另一方面, 也加入了对新 Hint 的支持,包括 [`AGG_TO_COP()`](/optimizer-hints.md#agg_to_cop)、[`LIMIT_TO_COP()`](/optimizer-hints.md#limit_to_cop)、[`ORDERED_INDEX`](/optimizer-hints.md#order_indext1_name-idx1_name--idx2_name)、[`NO_ORDERED_INDEX()`](/optimizer-hints.md#no_order_indext1_name-idx1_name--idx2_name)。 借助这个能力, 从历史执行计划中创建的 [SQL Binding](/sql-plan-management.md#执行计划绑定-sql-binding) 能够更加稳定的固定住执行计划。

更多信息,请参考[用户文档](/sql-plan-management.md#执行计划绑定-sql-binding)。
Oreoxmt marked this conversation as resolved.
Show resolved Hide resolved

### SQL 功能

qiancai marked this conversation as resolved.
Show resolved Hide resolved
* 支持 `CHECK` 约束 [#41711](https://github.com/pingcap/tidb/issues/41711) @[fzzf678] (https://github.com/fzzf678) **tw@qiancai** <!--1404-->
qiancai marked this conversation as resolved.
Show resolved Hide resolved

v7.2.0 版本开始,用户可以通过 `CHECK` 约束功能约束表中一个或者多个字段值必须满足特定条件。添加 `CHECK` 约束后,TiDB 会在数据插入或者更新时检查约束条件是否满足,只允许满足约束的数据写入。
qiancai marked this conversation as resolved.
Show resolved Hide resolved

更多信息,请参考[用户文档](链接)。
qiancai marked this conversation as resolved.
Show resolved Hide resolved

Defined2014 marked this conversation as resolved.
Show resolved Hide resolved
### 数据库管理

* DDL 任务支持暂停和恢复操作(实验特性)[#18015](https://github.com/pingcap/tidb/issues/18015) @[godouxm](https://github.com/godouxm) **tw@ran-huang** <!--1185-->

TiDB v7.2.0 之前的版本中,当 DDL 任务执行期间遇到业务高峰时间点时,为了减少对业务的影响,只能手动取消 DDL 任务。TiDB v7.2.0 引入了 DDL 任务的暂停和恢复功能,你可以在高峰时间点暂停 DDL 任务,等到业务高峰时间结束后再恢复 DDL 任务,从而避免了 DDL 操作对业务负载的影响。
ran-huang marked this conversation as resolved.
Show resolved Hide resolved

例如,可以通过如下 `ADMIN PAUSE DDL JOBS` 或 `ADMIN RESUME DDL JOBS` 语句暂停或者恢复多个 DDL 任务:

```sql
ADMIN PAUSE DDL JOBS 1,2;
ADMIN RESUME DDL JOBS 1,2;

ran-huang marked this conversation as resolved.
Show resolved Hide resolved
更多信息,请参考 [用户文档](/ddl-introduction.md#ddl - 相关的命令介绍)。
qiancai marked this conversation as resolved.
Show resolved Hide resolved
ran-huang marked this conversation as resolved.
Show resolved Hide resolved

### 可观测性

### 数据迁移

* 引入新的 SQL statement “import into” (实验特性),该 SQL 集成了 Lightning 物理导入模式(local backend)的能力,大大提升导入数据的效率。[#42930](https://github.com/pingcap/tidb/issues/42930) @[D3Hunter](https://github.com/D3Hunter) **tw@qiancai** <!--1413-->

"import into " 集成了 Lightning 物理导入模式(local backend)的能力,用户可直接编写 "import into“ SQL 导入数据到 TiDB,同时还支持将数据导入任务拆分成多个子任务调度到多个 TiDB 节点,进行并行导入,提升导入性能。在导入空表的场景,用户无需再部署和管理 Lightning ,降低了导入数据难度的同时,大大提升了导入数据效率。
qiancai marked this conversation as resolved.
Show resolved Hide resolved

更多信息,请参考[用户文档](链接)。
qiancai marked this conversation as resolved.
Show resolved Hide resolved

qiancai marked this conversation as resolved.
Show resolved Hide resolved
* Lightning 支持将字符集为 latin1 的源文件导入到 TiDB。[#44434](https://github.com/pingcap/tidb/issues/44434) @[lance6716](https://github.com/lance6716) **tw@qiancai** <!--1432-->
qiancai marked this conversation as resolved.
Show resolved Hide resolved

通过此功能,用户现在可以使用 Lightning 数据导入工具直接将字符集为 latin1 的源文件导入到 TiDB 中。这扩展了用户在处理各种字符集时的数据导入选项的兼容性和灵活性。以前,导入这样的文件需要额外的预处理或转换。现在用户只需在运行 Lightning 导入过程时指定源文件的字符集。Lightning 工具会在导入过程中自动处理字符集转换,确保数据的完整性和准确性。
qiancai marked this conversation as resolved.
Show resolved Hide resolved

更多信息,请参考[用户文档](https://github.com/pingcap/docs-cn/pull/14172/files)
qiancai marked this conversation as resolved.
Show resolved Hide resolved

## 兼容性变更

qiancai marked this conversation as resolved.
Show resolved Hide resolved
hfxsd marked this conversation as resolved.
Show resolved Hide resolved
> **注意:**
>
> 以下为从 v7.1.0 升级至当前版本 (v7.2.0) 所需兼容性变更信息。如果从 v7.0.0 或之前版本升级到当前版本,可能也需要考虑和查看中间版本 release notes 中提到的兼容性变更信息。

### 行为变更

<!-- 此小节包含 MySQL 兼容性变更-->

* 兼容性 1

* 兼容性 2

### 系统变量

| 变量名 | 修改类型(包括新增/修改/删除) | 描述 |
|--------|------------------------------|------|
qiancai marked this conversation as resolved.
Show resolved Hide resolved
| [`tidb_remove_orderby_in_subquery`](/system-variables.md#tidb_remove_orderby_in_subquery-从-v610-版本开始引入) | 修改 | 经进一步的测试后,该变量默认值从 `OFF` 修改为 `ON`,即优化器改写会移除子查询中的 `ORDER BY` 子句。 |
| | | |
| | | |
| | | |
ran-huang marked this conversation as resolved.
Show resolved Hide resolved

qiancai marked this conversation as resolved.
Show resolved Hide resolved
qiancai marked this conversation as resolved.
Show resolved Hide resolved
### 配置文件参数

| 配置文件 | 配置项 | 修改类型 | 描述 |
| -------- | -------- | -------- | -------- |
| | | | |
| | | | |
qiancai marked this conversation as resolved.
Show resolved Hide resolved
| TiDB Lightning | `send-kv-pairs` | 废弃 | 从 7.2 版本开始 TiDB Lightning 配置文件的参数 "send-kv-pairs" 不再生效,由新的参数 "send-kv-size" 代替。该新参数用于指定 KV 键值对的大小阈值,单位为 KiB 或 MiB,默认值为 "16 KiB"。当 KV 键值对的大小达到设定的阈值时,它们将立即发送到 TiKV,避免在导入大宽表等一些场景因为 Lightning 节点内存积累键值对过多导致 OOM 的问题。**tw@hfxsd** <!--1420--> |
| TiDB Lightning | `send-kv-size` | 新增 | 从 7.2 版本开始在 Lightning 配置文件 "[tikv-importer]" 这个 Session 中引入 `send-kv-size` 参数,用于设置发单次送到 TiKV 的 KV pairs 的大小。当 KV 键值对的大小达到设定的阈值时,它们将被 Lightning 立即发送到 TiKV,避免在导入大宽表的时候 Lightning 节点因为内存积累键值对过多导致 OOM 的问题。通过调整 "send-kv-size" 参数,你可以在内存使用和导入速度之间找到平衡,提高导入过程的稳定性和效率。**tw@hfxsd** <!--1420-->|
hfxsd marked this conversation as resolved.
Show resolved Hide resolved
| Data Migration | `strict-optimistic-shard-mode` | 新增 | 用于兼容历史版本 2.0 分库分表同步 DDL 的行为。当用户选择乐观模式时,可以启用该参数,开启后,乐观模式下,同步任务遇到二类 DDL 时,整个任务会中断,在多个表的 DDL变更有依赖关系的场景,可以及时中断,用户手动处理完各表的 DDL 后,再继续同步数据,保障上下游数据的一致性。 **tw@ran-huang** <!--1414-->|
ran-huang marked this conversation as resolved.
Show resolved Hide resolved

qiancai marked this conversation as resolved.
Show resolved Hide resolved
## 废弃功能

- note [#issue](链接) @[贡献者 GitHub ID](链接)

qiancai marked this conversation as resolved.
Show resolved Hide resolved
## 改进提升

+ TiDB

- 优化构造索引扫描范围的逻辑,支持将一些复杂条件转化为索引扫描范围 [#41572](https://github.com/pingcap/tidb/issues/41572) [#44389](https://github.com/pingcap/tidb/issues/44389) @xuyifangreeneyes
ran-huang marked this conversation as resolved.
Show resolved Hide resolved
- 支持分区表下推 TopN 算子,减少该情况下 indexLookUp 和 IndexMerge 算子回表次数,提升相关 SQL 执行性能 [#26166](https://github.com/pingcap/tidb/issues/26166) [#41028](https://github.com/pingcap/tidb/issues/41028)
qiancai marked this conversation as resolved.
Show resolved Hide resolved
- note [#issue](链接) @[贡献者 GitHub ID](链接)
qiancai marked this conversation as resolved.
Show resolved Hide resolved
qiancai marked this conversation as resolved.
Show resolved Hide resolved

qiancai marked this conversation as resolved.
Show resolved Hide resolved
qiancai marked this conversation as resolved.
Show resolved Hide resolved
qiancai marked this conversation as resolved.
Show resolved Hide resolved
qiancai marked this conversation as resolved.
Show resolved Hide resolved
qiancai marked this conversation as resolved.
Show resolved Hide resolved
+ TiKV

qiancai marked this conversation as resolved.
Show resolved Hide resolved
qiancai marked this conversation as resolved.
Show resolved Hide resolved
- note [#issue](链接) @[贡献者 GitHub ID](链接)
qiancai marked this conversation as resolved.
Show resolved Hide resolved
- note [#issue](链接) @[贡献者 GitHub ID](链接)

+ PD

- note [#issue](链接) @[贡献者 GitHub ID](链接)
qiancai marked this conversation as resolved.
Show resolved Hide resolved
- note [#issue](链接) @[贡献者 GitHub ID](链接)

+ TiFlash

- note [#issue](链接) @[贡献者 GitHub ID](链接)
- note [#issue](链接) @[贡献者 GitHub ID](链接)

+ Tools

+ Backup & Restore (BR)

- note [#issue](链接) @[贡献者 GitHub ID](链接)
- note [#issue](链接) @[贡献者 GitHub ID](链接)

+ TiCDC

- note [#issue](链接) @[贡献者 GitHub ID](链接)
- note [#issue](链接) @[贡献者 GitHub ID](链接)

+ TiDB Data Migration (DM)
qiancai marked this conversation as resolved.
Show resolved Hide resolved
qiancai marked this conversation as resolved.
Show resolved Hide resolved

qiancai marked this conversation as resolved.
Show resolved Hide resolved
- note [#issue](链接) @[贡献者 GitHub ID](链接)
- note [#issue](链接) @[贡献者 GitHub ID](链接)
qiancai marked this conversation as resolved.
Show resolved Hide resolved

+ TiDB Lightning
qiancai marked this conversation as resolved.
Show resolved Hide resolved

qiancai marked this conversation as resolved.
Show resolved Hide resolved
- note [#issue](链接) @[贡献者 GitHub ID](链接)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • 优化大表导入下 region 分裂和打散的处理机制 #43510
  • 优化导入遇到 RPC 错误的重试机制 #43291
  • 优化导入时遇到 leader 切换导致的错误的重试机制 #44478
  • 导入完成后通过 SQL 的方式校验 checksum,提升检验的稳定性 #41941
  • 优化宽表导入下 lightning OOM 的问题 43853

Copy link
Collaborator Author

@qiancai qiancai Jun 25, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

#43510 和 #43291 已经在 v7.1.0 release notes 中出现过了(如下),请确认是否是相同的问题,如果是,就不需要在 7.2 release notes 中写了

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这俩也不用了

qiancai marked this conversation as resolved.
Show resolved Hide resolved
- note [#issue](链接) @[贡献者 GitHub ID](链接)
qiancai marked this conversation as resolved.
Show resolved Hide resolved

+ TiUP

- note [#issue](链接) @[贡献者 GitHub ID](链接)
- note [#issue](链接) @[贡献者 GitHub ID](链接)

## 错误修复

+ TiDB

- note [#issue](链接) @[贡献者 GitHub ID](链接)
qiancai marked this conversation as resolved.
Show resolved Hide resolved
- note [#issue](链接) @[贡献者 GitHub ID](链接)
qiancai marked this conversation as resolved.
Show resolved Hide resolved

qiancai marked this conversation as resolved.
Show resolved Hide resolved
qiancai marked this conversation as resolved.
Show resolved Hide resolved
qiancai marked this conversation as resolved.
Show resolved Hide resolved
qiancai marked this conversation as resolved.
Show resolved Hide resolved
qiancai marked this conversation as resolved.
Show resolved Hide resolved
qiancai marked this conversation as resolved.
Show resolved Hide resolved
+ TiKV

qiancai marked this conversation as resolved.
Show resolved Hide resolved
qiancai marked this conversation as resolved.
Show resolved Hide resolved
qiancai marked this conversation as resolved.
Show resolved Hide resolved
- note [#issue](链接) @[贡献者 GitHub ID](链接)
- note [#issue](链接) @[贡献者 GitHub ID](链接)
qiancai marked this conversation as resolved.
Show resolved Hide resolved

+ PD

- note [#issue](链接) @[贡献者 GitHub ID](链接)
qiancai marked this conversation as resolved.
Show resolved Hide resolved
- note [#issue](链接) @[贡献者 GitHub ID](链接)

+ TiFlash

- note [#issue](链接) @[贡献者 GitHub ID](链接)
qiancai marked this conversation as resolved.
Show resolved Hide resolved
- note [#issue](链接) @[贡献者 GitHub ID](链接)

+ Tools

+ Backup & Restore (BR)

- note [#issue](链接) @[贡献者 GitHub ID](链接)
qiancai marked this conversation as resolved.
Show resolved Hide resolved
qiancai marked this conversation as resolved.
Show resolved Hide resolved
- note [#issue](链接) @[贡献者 GitHub ID](链接)

+ TiCDC
qiancai marked this conversation as resolved.
Show resolved Hide resolved

- note [#issue](链接) @[贡献者 GitHub ID](链接)
- note [#issue](链接) @[贡献者 GitHub ID](链接)

+ TiDB Data Migration (DM)

- note [#issue](链接) @[贡献者 GitHub ID](链接)
- note [#issue](链接) @[贡献者 GitHub ID](链接)

+ TiDB Lightning
qiancai marked this conversation as resolved.
Show resolved Hide resolved

- note [#issue](链接) @[贡献者 GitHub ID](链接)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • 修复开启 expression index 且默认值是 uuid 导致 lightning panic 的问题 #44516
  • 修复划分数据文件时任务退出导致 lightning panic 的问题 #43195
  • 修复某些监控面板不显示数据的问题 #43357
  • 修复负载较小的情况下仍可能出现 OOM 的问题 #43728

Copy link
Collaborator Author

@qiancai qiancai Jun 25, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

#43357 和 #43728 已经在 v7.1.0 release notes 中出现过了(如下),请确认是否是相同的问题,如果是,就不需要在 7.2 release notes 中写了

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok,这俩不用了

qiancai marked this conversation as resolved.
Show resolved Hide resolved
- note [#issue](链接) @[贡献者 GitHub ID](链接)
qiancai marked this conversation as resolved.
Show resolved Hide resolved

+ TiUP

- note [#issue](链接) @[贡献者 GitHub ID](链接)
- note [#issue](链接) @[贡献者 GitHub ID](链接)

## 贡献者

感谢来自 TiDB 社区的贡献者们:

- [贡献者 GitHub ID](链接)