TiSpark 2.5.0

New feature

• Support Spark 3.1.x and 3.0.x version.
• Support Spark SQL's authentication and authorization through TiDB #2185.

Fixes

• Fix duplicate range in RowIDAllocator #2156.
• upgrade log4j to 2.17.1 #2197.
• upgrade jackson-databind to 2.9.10.8 #2161.

Documents

• Fix in user docs forget to use options while using BatchWrite #2169

Known issue

• Spark SQL's authentication and authorization through TiDB will affect other datasource such as hive. See details in this issue #2224.
• Batch write needs more tests and may be unstable. See details in this issue #2222.

TiSpark 2.4.3

New feature

• scala 2.11 and 2.12 are both supported

Fixes

• Fix duplicate range in RowIDAllocator #2208.
• upgrade log4j to 2.17.1 #2209.
• upgrade jackson-databind to 2.9.10.8 #2209.

Documents

• Fix in user docs forget to use options while using BatchWrite #2171.

Known issue

• Batch write needs more tests and may be unstable. See details in this issue #2222.

TiSpark 2.4.2

Since TiSpark v2.4.2, Only Scala v2.12 is supported.

What's Changed

• BatchWrite: support clustered index (#2060) by @marsishandsome in #2079
• Fix region manager race (#1987) by @ti-srebot in #2092
• Fix ResolveLock not called in Scan API (#2089) by @ti-srebot in #2091
• fix region split: region split key should be a valid key by @marsishandsome in #2101
• Optimize region cache miss (#2106) by @ti-srebot in #2107
• fix catalog test (#2110) by @ti-srebot in #2113
• Fix channel shut-downed due to ping failure (#2120) by @ti-srebot in #2122
• Close TTLManager before creating a new one (#2114) by @ti-srebot in #2118
• Close PDClient without closing channel factory (#2123) by @ti-srebot in #2125
• Fix DateTime shift before the year 1582 (#2104) by @birdstorm in #2116
• Fix enum with trailing spaces (#2127) by @ti-srebot in #2134
• Fix not leader error due to region not invalidated (#2135) by @ti-srebot in #2138
• Fix BatchGet StackOverFlow Error (#2126) by @ti-srebot in #2140
• Update to support scala-2.12 by @birdstorm in #2149
• Update spark version info for v2.4 by @birdstorm in #2155

Full Changelog: v2.4.1...v2.4.2

TiSpark 2.4.1

Fixes

• Fix bug: write decimal(16, 4) using batch write and read using tiflash #2055
• Fix mistake setting current_ts to 0 #2067
• Filter views in catalog #2071
• BatchWrite: add argument deduplicate #2073

TiSpark 2.3.16

Fixes

• Change PARTITION_PER_SPLIT default value from 1 to 10 #2029
• Fix array index out of bound when encoding #2041
• fix batch write missing unpersist #2046
• Fix bug: write decimal(16, 4) using batch write and read using tiflash #2055
• Fix mistake setting current_ts to 0 #2067
• Filter views in catalog #2071
• BatchWrite: add argument deduplicate #2073

TiSpark 2.3.15

v2.3.15

hotfix (#2070)

TiSpark 2.4.0

New Features

• Support TiDB-5.0

TiSpark 2.3.14

Fixes

• Fix GregorianCalendar #1952
• Fix tiflash timestamp pushdown bug #1966
• Do not select tidb_row_format_version if tidb is 3.x #1993
• Update table statistics after batch write #2009
• Fix oom cause missing data bug #2010

TiSpark 2.3.13

Fixes

• Disable index scan on partition table #1923
• Fix jackson-databind #1910
• Fix BatchGet retry #1907

TiSpark 2.3.12

Fixes

• Add retry in RangeSplitter #1886
• Fix TiDAGRequest concurrent visit #1893
• Fix partition table with partition column name date #1892