Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

br restore full failed: [BR:PD:ErrPDBatchScanRegion]batch scan region; type:UNKNOWN message:"invalid store ID 0, not found" #47202

Closed
fubinzh opened this issue Sep 22, 2023 · 6 comments
Labels
component/br This issue is related to BR of TiDB. type/bug The issue is confirmed as a bug.

Comments

@fubinzh
Copy link

fubinzh commented Sep 22, 2023

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

  1. Br restore full failed due to AK/SK is readonly
  2. Run br restore full again with AK/SK with write privilege

2. What did you expect to see? (Required)

Restore should succeed.

3. What did you see instead (Required)

Restore failed.

[root@br-0 /]# /br  restore  full "-s" "s3://qe-testing/kernel-testing/fubin/bigcluster/backup?access-key=xxxx&secret-access-key=ssss&endpoint=http%3a%2f%[2fks3-cn-beijing-internal.ksyuncs.com](http://2fks3-cn-beijing-internal.ksyuncs.com/)&force-path-style=false&region=Beijing&pr
ovider=ks" "-u" "http://upstream-pd.cdc-kafka-avro-2-workloads-tps-2730799-1-116:2379/" "--check-requirements=false"
Detail BR log in /tmp/br.log.2023-09-22T02.19.11Z
Full Restore <-------------------------------------------------------------------------------------------------------------------------> 100.00%
[2023/09/22 02:20:00.341 +00:00] [INFO] [collector.go:77] ["Full Restore failed summary"] [total-ranges=465] [ranges-succeed=464] [ranges-failed=1] [restore-ranges=30396] [unit-name=file] [error="[BR:KV:ErrKVEpochNotMatch]epoch not match; scan regions from start-key:748000000000000CFFE75F698000000000FF0000010000000000FB, err: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial tcp [10.233.82.236:2379](http://10.233.82.236:2379/): connect: connection refused\": [BR:PD:ErrPDBatchScanRegion]batch scan region; type:UNKNOWN message:\"invalid store ID 0, not found\" "] [errorVerbose="the following errors occurred:\n -  [BR:KV:ErrKVEpochNotMatch]epoch not match\n    [github.com/pingcap/errors.AddStack\n](http://github.com/pingcap/errors.AddStack/n)    \t/go/pkg/mod/[github.com/pingcap/[email protected]/errors.go:174\n](http://github.com/pingcap/[email protected]/errors.go:174/n)    [github.com/pingcap/errors.Trace\n](http://github.com/pingcap/errors.Trace/n)    \t/go/pkg/mod/[github.com/pingcap/[email protected]/juju_adaptor.go:15\n](http://github.com/pingcap/[email protected]/juju_adaptor.go:15/n)    [github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ingest\n](http://github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ingest/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/import.go:885\n](http://github.com/pingcap/br/br/pkg/restore/import.go:885/n)    [github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ImportSSTFiles.func1\n](http://github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ImportSSTFiles.func1/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/import.go:572\n](http://github.com/pingcap/br/br/pkg/restore/import.go:572/n)    [github.com/pingcap/tidb/br/pkg/utils.WithRetry.func1\n](http://github.com/pingcap/tidb/br/pkg/utils.WithRetry.func1/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/utils/retry.go:57\n](http://github.com/pingcap/br/br/pkg/utils/retry.go:57/n)    [github.com/pingcap/tidb/br/pkg/utils.WithRetryV2[...]\n](http://github.com/pingcap/tidb/br/pkg/utils.WithRetryV2[...]/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/utils/retry.go:75\n](http://github.com/pingcap/br/br/pkg/utils/retry.go:75/n)    [github.com/pingcap/tidb/br/pkg/utils.WithRetry\n](http://github.com/pingcap/tidb/br/pkg/utils.WithRetry/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/utils/retry.go:56\n](http://github.com/pingcap/br/br/pkg/utils/retry.go:56/n)    [github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ImportSSTFiles\n](http://github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ImportSSTFiles/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/import.go:528\n](http://github.com/pingcap/br/br/pkg/restore/import.go:528/n)    [github.com/pingcap/tidb/br/pkg/restore.(*Client).RestoreSSTFiles.func2.1\n](http://github.com/pingcap/tidb/br/pkg/restore.(*Client).RestoreSSTFiles.func2.1/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/client.go:1432\n](http://github.com/pingcap/br/br/pkg/restore/client.go:1432/n)    [github.com/pingcap/tidb/br/pkg/restore.(*Client).RestoreSSTFiles.func2\n](http://github.com/pingcap/tidb/br/pkg/restore.(*Client).RestoreSSTFiles.func2/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/client.go:1433\n](http://github.com/pingcap/br/br/pkg/restore/client.go:1433/n)    [github.com/pingcap/tidb/br/pkg/utils.(*WorkerPool).ApplyOnErrorGroup.func1\n](http://github.com/pingcap/tidb/br/pkg/utils.(*WorkerPool).ApplyOnErrorGroup.func1/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/utils/worker.go:76\n](http://github.com/pingcap/br/br/pkg/utils/worker.go:76/n)    [golang.org/x/sync/errgroup.(*Group).Go.func1\n](http://golang.org/x/sync/errgroup.(*Group).Go.func1/n)    \t/go/pkg/mod/[golang.org/x/[email protected]/errgroup/errgroup.go:75\n](http://golang.org/x/[email protected]/errgroup/errgroup.go:75/n)    runtime.goexit\n    \t/usr/local/go/src/runtime/asm_amd64.s:1650\n -  [BR:PD:ErrPDBatchScanRegion]batch scan region\n    scan regions from start-key:748000000000000CFFE75F698000000000FF0000010000000000FB, err: rpc
error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial tcp [10.233.82.236:2379](http://10.233.82.236:2379/): connect: connection refused\"\n    [github.com/pingcap/tidb/br/pkg/restore/split.PaginateScanRegion.func1\n](http://github.com/pingcap/tidb/br/pkg/restore/split.PaginateScanRegion.func1/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/split/split.go:108\n](http://github.com/pingcap/br/br/pkg/restore/split/split.go:108/n)    [github.com/pingcap/tidb/br/pkg/utils.WithRetry.func1\n](http://github.com/pingcap/tidb/br/pkg/utils.WithRetry.func1/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/utils/retry.go:57\n](http://github.com/pingcap/br/br/pkg/utils/retry.go:57/n)    [github.com/pingcap/tidb/br/pkg/utils.WithRetryV2[...]\n](http://github.com/pingcap/tidb/br/pkg/utils.WithRetryV2[...]/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/utils/retry.go:75\n](http://github.com/pingcap/br/br/pkg/utils/retry.go:75/n)    [github.com/pingcap/tidb/br/pkg/utils.WithRetry\n](http://github.com/pingcap/tidb/br/pkg/utils.WithRetry/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/utils/retry.go:56\n](http://github.com/pingcap/br/br/pkg/utils/retry.go:56/n)    [github.com/pingcap/tidb/br/pkg/restore/split.PaginateScanRegion\n](http://github.com/pingcap/tidb/br/pkg/restore/split.PaginateScanRegion/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/split/split.go:101\n](http://github.com/pingcap/br/br/pkg/restore/split/split.go:101/n)    [github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ImportSSTFiles.func1\n](http://github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ImportSSTFiles.func1/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/import.go:532\n](http://github.com/pingcap/br/br/pkg/restore/import.go:532/n)    [github.com/pingcap/tidb/br/pkg/utils.WithRetry.func1\n](http://github.com/pingcap/tidb/br/pkg/utils.WithRetry.func1/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/utils/retry.go:57\n](http://github.com/pingcap/br/br/pkg/utils/retry.go:57/n)    [github.com/pingcap/tidb/br/pkg/utils.WithRetryV2[...]\n](http://github.com/pingcap/tidb/br/pkg/utils.WithRetryV2[...]/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/utils/retry.go:75\n](http://github.com/pingcap/br/br/pkg/utils/retry.go:75/n)    [github.com/pingcap/tidb/br/pkg/utils.WithRetry\n](http://github.com/pingcap/tidb/br/pkg/utils.WithRetry/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/utils/retry.go:56\n](http://github.com/pingcap/br/br/pkg/utils/retry.go:56/n)    [github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ImportSSTFiles\n](http://github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ImportSSTFiles/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/import.go:528\n](http://github.com/pingcap/br/br/pkg/restore/import.go:528/n)    [github.com/pingcap/tidb/br/pkg/restore.(*Client).RestoreSSTFiles.func2.1\n](http://github.com/pingcap/tidb/br/pkg/restore.(*Client).RestoreSSTFiles.func2.1/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/client.go:1432\n](http://github.com/pingcap/br/br/pkg/restore/client.go:1432/n)    [github.com/pingcap/tidb/br/pkg/restore.(*Client).RestoreSSTFiles.func2\n](http://github.com/pingcap/tidb/br/pkg/restore.(*Client).RestoreSSTFiles.func2/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/client.go:1433\n](http://github.com/pingcap/br/br/pkg/restore/client.go:1433/n)    [github.com/pingcap/tidb/br/pkg/utils.(*WorkerPool).ApplyOnErrorGroup.func1\n](http://github.com/pingcap/tidb/br/pkg/utils.(*WorkerPool).ApplyOnErrorGroup.func1/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/utils/worker.go:76\n](http://github.com/pingcap/br/br/pkg/utils/worker.go:76/n)    [golang.org/x/sync/errgroup.(*Group).Go.func1\n](http://golang.org/x/sync/errgroup.(*Group).Go.func1/n)    \t/go/pkg/mod/[golang.org/x/[email protected]/errgroup/errgroup.go:75\n](http://golang.org/x/[email protected]/errgroup/errgroup.go:75/n)    runtime.goexit\n    \t/usr/local/go/src/runtime/asm_amd64.s:1650\n -  type:UNKNOWN message:\"invalid store ID 0, not found\" \n    [github.com/tikv/pd/client.(*client).respForErr\n](http://github.com/tikv/pd/client.(*client).respForErr/n)    \t/go/pkg/mod/[github.com/tikv/pd/[email protected]/client.go:1600\n](http://github.com/tikv/pd/[email protected]/client.go:1600/n)    [github.com/tikv/pd/client.(*client).GetStore\n](http://github.com/tikv/pd/client.(*client).GetStore/n)    \t/go/pkg/mod/[github.com/tikv/pd/[email protected]/client.go:1144\n](http://github.com/tikv/pd/[email protected]/client.go:1144/n)    [github.com/pingcap/tidb/br/pkg/restore/split.(*pdClient).GetStore\n](http://github.com/pingcap/tidb/br/pkg/restore/split.(*pdClient).GetStore/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/split/client.go:157\n](http://github.com/pingcap/br/br/pkg/restore/split/client.go:157/n)    [github.com/pingcap/tidb/br/pkg/restore.(*importClient).GetImportClient\n](http://github.com/pingcap/tidb/br/pkg/restore.(*importClient).GetImportClient/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/import.go:218\n](http://github.com/pingcap/br/br/pkg/restore/import.go:218/n)    [github.com/pingcap/tidb/br/pkg/restore.(*importClient).MultiIngest\n](http://github.com/pingcap/tidb/br/pkg/restore.(*importClient).MultiIngest/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/import.go:201\n](http://github.com/pingcap/br/br/pkg/restore/import.go:201/n)    [github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ingestSSTs\n](http://github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ingestSSTs/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/import.go:933\n](http://github.com/pingcap/br/br/pkg/restore/import.go:933/n)    [github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ingest\n](http://github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ingest/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/import.go:840\n](http://github.com/pingcap/br/br/pkg/restore/import.go:840/n)    [github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ImportSSTFiles.func1\n](http://github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ImportSSTFiles.func1/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/import.go:572\n](http://github.com/pingcap/br/br/pkg/restore/import.go:572/n)    [github.com/pingcap/tidb/br/pkg/utils.WithRetry.func1\n](http://github.com/pingcap/tidb/br/pkg/utils.WithRetry.func1/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/utils/retry.go:57\n](http://github.com/pingcap/br/br/pkg/utils/retry.go:57/n)    [github.com/pingcap/tidb/br/pkg/utils.WithRetryV2[...]\n](http://github.com/pingcap/tidb/br/pkg/utils.WithRetryV2[...]/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/utils/retry.go:75\n](http://github.com/pingcap/br/br/pkg/utils/retry.go:75/n)    [github.com/pingcap/tidb/br/pkg/utils.WithRetry\n](http://github.com/pingcap/tidb/br/pkg/utils.WithRetry/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/utils/retry.go:56\n](http://github.com/pingcap/br/br/pkg/utils/retry.go:56/n)    [github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ImportSSTFiles\n](http://github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ImportSSTFiles/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/import.go:528\n](http://github.com/pingcap/br/br/pkg/restore/import.go:528/n)    [github.com/pingcap/tidb/br/pkg/restore.(*Client).RestoreSSTFiles.func2.1\n](http://github.com/pingcap/tidb/br/pkg/restore.(*Client).RestoreSSTFiles.func2.1/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/client.go:1432\n](http://github.com/pingcap/br/br/pkg/restore/client.go:1432/n)    [github.com/pingcap/tidb/br/pkg/restore.(*Client).RestoreSSTFiles.func2\n](http://github.com/pingcap/tidb/br/pkg/restore.(*Client).RestoreSSTFiles.func2/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/client.go:1433\n](http://github.com/pingcap/br/br/pkg/restore/client.go:1433/n)    [github.com/pingcap/tidb/br/pkg/utils.(*WorkerPool).ApplyOnErrorGroup.func1\n](http://github.com/pingcap/tidb/br/pkg/utils.(*WorkerPool).ApplyOnErrorGroup.func1/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/utils/worker.go:76\n](http://github.com/pingcap/br/br/pkg/utils/worker.go:76/n)    [golang.org/x/sync/errgroup.(*Group).Go.func1\n](http://golang.org/x/sync/errgroup.(*Group).Go.func1/n)    \t/go/pkg/mod/[golang.org/x/[email protected]/errgroup/errgroup.go:75\n](http://golang.org/x/[email protected]/errgroup/errgroup.go:75/n)    runtime.goexit\n    \t/usr/local/go/src/runtime/asm_amd64.s:1650\n    [github.com/tikv/pd/client.(*client).respForErr\n](http://github.com/tikv/pd/client.(*client).respForErr/n)    \t/go/pkg/mod/[github.com/tikv/pd/[email protected]/client.go:1600\n](http://github.com/tikv/pd/[email protected]/client.go:1600/n)    [github.com/tikv/pd/client.(*client).GetStore\n](http://github.com/tikv/pd/client.(*client).GetStore/n)    \t/go/pkg/mod/[github.com/tikv/pd/[email protected]/client.go:1144\n](http://github.com/tikv/pd/[email protected]/client.go:1144/n)    [github.com/pingcap/tidb/br/pkg/restore/split.(*pdClient).GetStore\n](http://github.com/pingcap/tidb/br/pkg/restore/split.(*pdClient).GetStore/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/split/client.go:157\n](http://github.com/pingcap/br/br/pkg/restore/split/client.go:157/n)    [github.com/pingcap/tidb/br/pkg/restore.(*importClient).GetImportClient\n](http://github.com/pingcap/tidb/br/pkg/restore.(*importClient).GetImportClient/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/import.go:218\n](http://github.com/pingcap/br/br/pkg/restore/import.go:218/n)    [github.com/pingcap/tidb/br/pkg/restore.(*importClient).MultiIngest\n](http://github.com/pingcap/tidb/br/pkg/restore.(*importClient).MultiIngest/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/import.go:201\n](http://github.com/pingcap/br/br/pkg/restore/import.go:201/n)    [github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ingestSSTs\n](http://github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ingestSSTs/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/import.go:933\n](http://github.com/pingcap/br/br/pkg/restore/import.go:933/n)    [github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ingest\n](http://github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ingest/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/import.go:840\n](http://github.com/pingcap/br/br/pkg/restore/import.go:840/n)    [github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ImportSSTFiles.func1\n](http://github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ImportSSTFiles.func1/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/import.go:572\n](http://github.com/pingcap/br/br/pkg/restore/import.go:572/n)    [github.com/pingcap/tidb/br/pkg/utils.WithRetry.func1\n](http://github.com/pingcap/tidb/br/pkg/utils.WithRetry.func1/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/utils/retry.go:57\n](http://github.com/pingcap/br/br/pkg/utils/retry.go:57/n)    [github.com/pingcap/tidb/br/pkg/utils.WithRetryV2[...]\n](http://github.com/pingcap/tidb/br/pkg/utils.WithRetryV2[...]/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/utils/retry.go:75\n](http://github.com/pingcap/br/br/pkg/utils/retry.go:75/n)    [github.com/pingcap/tidb/br/pkg/utils.WithRetry\n](http://github.com/pingcap/tidb/br/pkg/utils.WithRetry/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/utils/retry.go:56\n](http://github.com/pingcap/br/br/pkg/utils/retry.go:56/n)    [github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ImportSSTFiles\n](http://github.com/pingcap/tidb/br/pkg/restore.(*FileImporter).ImportSSTFiles/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/import.go:528\n](http://github.com/pingcap/br/br/pkg/restore/import.go:528/n)    [github.com/pingcap/tidb/br/pkg/restore.(*Client).RestoreSSTFiles.func2.1\n](http://github.com/pingcap/tidb/br/pkg/restore.(*Client).RestoreSSTFiles.func2.1/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/client.go:1432\n](http://github.com/pingcap/br/br/pkg/restore/client.go:1432/n)    [github.com/pingcap/tidb/br/pkg/restore.(*Client).RestoreSSTFiles.func2\n](http://github.com/pingcap/tidb/br/pkg/restore.(*Client).RestoreSSTFiles.func2/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/restore/client.go:1433\n](http://github.com/pingcap/br/br/pkg/restore/client.go:1433/n)    [github.com/pingcap/tidb/br/pkg/utils.(*WorkerPool).ApplyOnErrorGroup.func1\n](http://github.com/pingcap/tidb/br/pkg/utils.(*WorkerPool).ApplyOnErrorGroup.func1/n)    \t/home/jenkins/agent/workspace/build-common/go/src/[github.com/pingcap/br/br/pkg/utils/worker.go:76\n](http://github.com/pingcap/br/br/pkg/utils/worker.go:76/n)
[golang.org/x/sync/errgroup.(*Group).Go.func1\n](http://golang.org/x/sync/errgroup.(*Group).Go.func1/n)    \t/go/pkg/mod/[golang.org/x/[email protected]/errgroup/errgroup.go:75\n](http://golang.org/x/[email protected]/errgroup/errgroup.go:75/n)    runtime.goexit\n    \t/usr/local/go/src/runtime/asm_amd64.s:1650"]
Error: [BR:KV:ErrKVEpochNotMatch]epoch not match; scan regions from start-key:748000000000000CFFE75F698000000000FF0000010000000000FB, err: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp [10.233.82.236:2379](http://10.233.82.236:2379/): connect: connection refused": 

4. What is your TiDB version? (Required)

[BR:PD:ErrPDBatchScanRegion]batch scan region; type:UNKNOWN message:"invalid store ID 0, not found"
[root@br-0 /]# /br -V
Release Version: v7.4.0-alpha
Git Commit Hash: 3ccd09e
Git Branch: heads/refs/tags/v7.4.0-alpha
Go Version: go1.21.1
UTC Build Time: 2023-09-21 11:37:00
Race Enabled: false

@fubinzh fubinzh added the type/bug The issue is confirmed as a bug. label Sep 22, 2023
@fubinzh fubinzh changed the title br restore full failed [BR:PD:ErrPDBatchScanRegion]batch scan region; type:UNKNOWN message:"invalid store ID 0, not found" br restore full failed: [BR:PD:ErrPDBatchScanRegion]batch scan region; type:UNKNOWN message:"invalid store ID 0, not found" Sep 22, 2023
@fubinzh
Copy link
Author

fubinzh commented Sep 22, 2023

/component br

@ti-chi-bot ti-chi-bot bot added the component/br This issue is related to BR of TiDB. label Sep 22, 2023
@Leavrth
Copy link
Contributor

Leavrth commented Sep 22, 2023

fixed by tikv/pd#7134

@Leavrth
Copy link
Contributor

Leavrth commented Sep 22, 2023

/close

@ti-chi-bot
Copy link

ti-chi-bot bot commented Sep 22, 2023

@Leavrth: You can't close an active issue/PR unless you authored it or you are a collaborator.

In response to this:

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@fubinzh
Copy link
Author

fubinzh commented Sep 22, 2023

It is PD issue.
/close

@ti-chi-bot
Copy link

ti-chi-bot bot commented Sep 22, 2023

@fubinzh: Closing this issue.

In response to this:

It is PD issue.
/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@ti-chi-bot ti-chi-bot bot closed this as completed Sep 22, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/br This issue is related to BR of TiDB. type/bug The issue is confirmed as a bug.
Projects
None yet
Development

No branches or pull requests

2 participants