Skip to content

[Bug] mo-tool checkpoint dump fails: cannot resolve exact schema for table from checkpoint metadata #25830

Description

@Ariznawlll

Summary

mo-tool ckp dump 在 PITR checkpoint dump 测试中成功导出了 38 张表后,对 table 273094 执行 show create table 时报错:

Error: show create table 273094: internal error: cannot resolve exact schema for table 273094 from checkpoint metadata; mo_tables/mo_columns data is unavailable or incomplete

CI Run: https://github.com/matrixorigin/mo-nightly-regression/actions/runs/29523958842/job/87712581316
Workflow: PITR Backup Restore Test 4.0-dev
Job: CHECKPOINT DUMP S3 WITH PITR DATA
Branch: main
MO Commit: ce99d329cf (cherrypick: add copy grants #25812)
Time: 2026-07-16 18:48 - 19:39 UTC


Error Details

Execution Flow

  1. mo-tool ckp dump 成功从 S3 checkpoint 中导出了 38 张表(包括 big_data_test 下的多张大表,最大 100M 行)
  2. CSV pipeline 正常完成,所有表的 dump 和写入均成功
  3. 在导出完成后,执行 show create table 273094 时失败

Error Message

Dumped 38 tables to big_data_test_db_273086
Error: show create table 273094: internal error: cannot resolve exact schema for table 273094 from checkpoint metadata; mo_tables/mo_columns data is unavailable or incomplete

Last Successfully Dumped Tables (before error)

Table 273160 big_data_test.table_with_sortkey_for_insert_100m → OK
Table 273161 big_data_test.table_with_sortkey_for_insert_1b → OK
Table 273162 big_data_test.table_with_sortkey_for_load_100m → OK
Table 273163 big_data_test.table_with_sortkey_for_load_1b → OK
Dumped 38 tables to big_data_test_db_273086 → OK
Error: show create table 273094 → FAILED

Table 273094 不在已成功导出的 38 张表中,但在 dump 完成后尝试获取其 schema 时失败。


History

Date Result
2026-07-12 ✅ success
2026-07-13 ⏹ cancelled (workflow cancelled)
2026-07-14 ⏭ skipped
2026-07-15 ⏭ skipped
2026-07-16 🔴 failure

此前该测试正常通过,07-16 首次出现此错误。


Expected Behavior

mo-tool ckp dump 应该能够从 checkpoint metadata 中正确解析所有表的 schema,包括 mo_tables/mo_columns 中的元数据。

Actual Behavior

对特定表 (table ID 273094) 的 schema 解析失败,提示 mo_tables/mo_columns data is unavailable or incomplete。可能原因:

  1. PITR 恢复后 checkpoint 中的 catalog 数据不完整
  2. mo-tool 的 schema 解析逻辑对某些表类型/situation 处理不正确
  3. 表 273094 在 PITR 时间点之后被创建/修改,checkpoint 中未包含其完整的 catalog 信息

Environment

  • MatrixOne: main branch, commit ce99d329cf
  • mo-tool: built from go.mod at commit 786e736810ad
  • Infrastructure: TKE, amd64-mo-guangzhou-medium8 runner
  • Data: big_data_test database with ~38 tables including 100M/1B row tables

Metadata

Metadata

Assignees

Labels

kind/bugSomething isn't workingseverity/s0Active / top priority for current sprint. Owner has committed to working on it now.

Type

Fields

No fields configured for Bug.

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions