From 98b46598fd3d44fbb376468d5ae93c151970ce8b Mon Sep 17 00:00:00 2001 From: lilin90 Date: Mon, 22 Jun 2026 15:47:59 +0800 Subject: [PATCH 1/2] lake: incremental updates 0621 Introduce Kafka Consumer integration docs and reusable Kafka credentials. Adds new guides: integrate-with-kafka.md (Kafka Consumer task guide, Beta) and kafka-credentials.md (Kafka - Credentials data source). Update TOC and related pages (data-integration-overview.md, data-sources.md, integration-tasks.md, task-management.md) to reference Kafka and describe message consumption behavior and tenant Stage usage. Also apply minor fixes to mindsdb.md (update links and database name). --- TOC-tidb-cloud-lake.md | 2 + .../guides/data-integration-overview.md | 11 +- tidb-cloud-lake/guides/data-sources.md | 3 +- .../guides/integrate-with-kafka.md | 131 ++++++++++++++++++ tidb-cloud-lake/guides/integration-tasks.md | 6 +- tidb-cloud-lake/guides/kafka-credentials.md | 43 ++++++ tidb-cloud-lake/guides/mindsdb.md | 22 +-- tidb-cloud-lake/guides/task-management.md | 16 ++- 8 files changed, 208 insertions(+), 26 deletions(-) create mode 100644 tidb-cloud-lake/guides/integrate-with-kafka.md create mode 100644 tidb-cloud-lake/guides/kafka-credentials.md diff --git a/TOC-tidb-cloud-lake.md b/TOC-tidb-cloud-lake.md index ff81e3032cfa0..06a08e5d36ef1 100644 --- a/TOC-tidb-cloud-lake.md +++ b/TOC-tidb-cloud-lake.md @@ -32,6 +32,7 @@ - [MySQL - Credentials](/tidb-cloud-lake/guides/mysql-credentials.md) - [PostgreSQL - Credentials](/tidb-cloud-lake/guides/postgresql-credentials.md) - [FeiShuBot](/tidb-cloud-lake/guides/feishubot.md) + - [Kafka - Credentials](/tidb-cloud-lake/guides/kafka-credentials.md) ![BETA](/media/tidb-cloud/blank_transparent_placeholder.png) - Integration Tasks - [Overview](/tidb-cloud-lake/guides/integration-tasks.md) - [Task Management](/tidb-cloud-lake/guides/task-management.md) @@ -39,6 +40,7 @@ - [Amazon SQS (S3) Integration Task](/tidb-cloud-lake/guides/integrate-with-amazon-sqs-s3.md) ![BETA](/media/tidb-cloud/blank_transparent_placeholder.png) - [MySQL Integration Task](/tidb-cloud-lake/guides/integrate-with-mysql.md) - [PostgreSQL Integration Task](/tidb-cloud-lake/guides/integrate-with-postgresql.md) + - [Kafka Consumer Integration Task](/tidb-cloud-lake/guides/integrate-with-kafka.md) ![BETA](/media/tidb-cloud/blank_transparent_placeholder.png) - Connect - [Overview](/tidb-cloud-lake/guides/connection-overview.md) - SQL Clients diff --git a/tidb-cloud-lake/guides/data-integration-overview.md b/tidb-cloud-lake/guides/data-integration-overview.md index 1ff756febdbb6..e3b30eb04f6ba 100644 --- a/tidb-cloud-lake/guides/data-integration-overview.md +++ b/tidb-cloud-lake/guides/data-integration-overview.md @@ -5,16 +5,16 @@ summary: The Data Integration feature in {{{ .lake }}} provides a visual, no-cod # Data Integration Overview -The Data Integration feature in {{{ .lake }}} provides a visual, no-code interface for importing or synchronizing data from external systems into {{{ .lake }}}. The feature centers around two key concepts: **data sources** and **integration tasks**. +The Data Integration feature in {{{ .lake }}} provides a visual, no-code interface for importing, synchronizing, or consuming data from external systems into {{{ .lake }}}. The feature centers around two key concepts: **data sources** and **integration tasks**. ## Key Concepts | Concept | Description | |---------|-------------| -| [Data Sources](/tidb-cloud-lake/guides/data-sources.md) | Reusable connection settings or credentials used to access external systems or send notifications, such as AWS Access Key / Secret Key, MySQL hostname / username / password, SQS (S3) queue URL, or a FeiShu bot webhook. | -| [Integration Tasks](/tidb-cloud-lake/guides/integration-tasks.md) | Executable tasks that define where data comes from, which {{{ .lake }}} table it is written to, which runtime parameters are used, and how the task is started and monitored. | +| [Data Sources](/tidb-cloud-lake/guides/data-sources.md) | Reusable connection settings or credentials used to access external systems or send notifications, such as AWS Access Key / Secret Key, MySQL hostname / username / password, SQS (S3) queue URL, Kafka broker addresses, or a FeiShu bot webhook. | +| [Integration Tasks](/tidb-cloud-lake/guides/integration-tasks.md) | Executable tasks that define where data comes from, where it is written or how results are saved, which runtime parameters are used, and how the task is started and monitored. | -Data sources do not move data by themselves. They only store the information required to access external systems. Integration tasks are the units that actually perform imports, snapshots, and continuous synchronization. +Data sources do not move data by themselves. They only store the information required to access external systems. Integration tasks are the units that actually perform imports, snapshots, continuous synchronization, or message consumption.