From 98f4e139546262cd1fa1cc18e9712040921fe8de Mon Sep 17 00:00:00 2001 From: Alan Woodward Date: Thu, 18 Dec 2025 12:21:29 +0000 Subject: [PATCH 1/4] Mention use of docvalue skippers in TSDS documentation --- .../data-store/data-streams/time-series-data-stream-tsds.md | 6 +++++- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/manage-data/data-store/data-streams/time-series-data-stream-tsds.md b/manage-data/data-store/data-streams/time-series-data-stream-tsds.md index a9cc2eb380..4577c80050 100644 --- a/manage-data/data-store/data-streams/time-series-data-stream-tsds.md +++ b/manage-data/data-store/data-streams/time-series-data-stream-tsds.md @@ -100,6 +100,10 @@ A time series data stream works like a regular data stream, with some key differ * **Dimension-based routing:** The routing logic uses dimension fields to map all data points of a time series to the same shard, improving storage efficiency and query performance. Duplicate data points are rejected. * **Sorting:** A TSDS uses internal [index sorting](elasticsearch://reference/elasticsearch/index-settings/sorting.md) to order shard segments by `_tsid` and `@timestamp`, for better compression. Time series data streams do not use `index.sort.*` settings. * **Source field:** A TSDS uses [synthetic `_source`](elasticsearch://reference/elasticsearch/mapping-reference/mapping-source-field.md#synthetic-source), and as a result is subject to some [restrictions](elasticsearch://reference/elasticsearch/mapping-reference/mapping-source-field.md#synthetic-source-restrictions) and [modifications](elasticsearch://reference/elasticsearch/mapping-reference/mapping-source-field.md#synthetic-source-modifications) applied to the `_source` field. +```{applies_to} +stack: ga 9.3 +``` +* **Docvalue Skippers:** A TSDS enables [docvalue skippers](elasticsearch://reference/elasticsearch/mapping-reference/doc-values.md#doc-values-skippers) on its `_tsid`, `@timestamp`, [dimension](#time-series-dimension) and [metric](#time-series-metric) fields. Because `tsid` and `@timestamp` are part of the index sort, this allows elasticsearch to avoid building backing indexes for these fields, meaning lower disk usage and faster ingest speed. ## Query time series data ```{applies_to} @@ -114,4 +118,4 @@ You can use the {{esql}} [`TS` command](elasticsearch://reference/query-language * Try the [quickstart](/manage-data/data-store/data-streams/quickstart-tsds.md) for a hands-on introduction * [Set up a time series data stream](/manage-data/data-store/data-streams/set-up-tsds.md) * [Ingest data using the OpenTelemetry Protocol (OTLP)](/manage-data/data-store/data-streams/tsds-ingest-otlp.md) -* Learn about [downsampling](/manage-data/data-store/data-streams/downsampling-time-series-data-stream.md) to reduce storage footprint \ No newline at end of file +* Learn about [downsampling](/manage-data/data-store/data-streams/downsampling-time-series-data-stream.md) to reduce storage footprint From b40b4dd63cfbfeea6c296c306d06af0f18fb05ae Mon Sep 17 00:00:00 2001 From: Alan Woodward Date: Thu, 18 Dec 2025 13:26:33 +0000 Subject: [PATCH 2/4] Update manage-data/data-store/data-streams/time-series-data-stream-tsds.md Co-authored-by: Liam Thompson --- .../data-store/data-streams/time-series-data-stream-tsds.md | 5 +---- 1 file changed, 1 insertion(+), 4 deletions(-) diff --git a/manage-data/data-store/data-streams/time-series-data-stream-tsds.md b/manage-data/data-store/data-streams/time-series-data-stream-tsds.md index 4577c80050..595929dcdd 100644 --- a/manage-data/data-store/data-streams/time-series-data-stream-tsds.md +++ b/manage-data/data-store/data-streams/time-series-data-stream-tsds.md @@ -100,10 +100,7 @@ A time series data stream works like a regular data stream, with some key differ * **Dimension-based routing:** The routing logic uses dimension fields to map all data points of a time series to the same shard, improving storage efficiency and query performance. Duplicate data points are rejected. * **Sorting:** A TSDS uses internal [index sorting](elasticsearch://reference/elasticsearch/index-settings/sorting.md) to order shard segments by `_tsid` and `@timestamp`, for better compression. Time series data streams do not use `index.sort.*` settings. * **Source field:** A TSDS uses [synthetic `_source`](elasticsearch://reference/elasticsearch/mapping-reference/mapping-source-field.md#synthetic-source), and as a result is subject to some [restrictions](elasticsearch://reference/elasticsearch/mapping-reference/mapping-source-field.md#synthetic-source-restrictions) and [modifications](elasticsearch://reference/elasticsearch/mapping-reference/mapping-source-field.md#synthetic-source-modifications) applied to the `_source` field. -```{applies_to} -stack: ga 9.3 -``` -* **Docvalue Skippers:** A TSDS enables [docvalue skippers](elasticsearch://reference/elasticsearch/mapping-reference/doc-values.md#doc-values-skippers) on its `_tsid`, `@timestamp`, [dimension](#time-series-dimension) and [metric](#time-series-metric) fields. Because `tsid` and `@timestamp` are part of the index sort, this allows elasticsearch to avoid building backing indexes for these fields, meaning lower disk usage and faster ingest speed. +* {applies_to}`stack: ga 9.3` **Docvalue Skippers:** A TSDS enables [docvalue skippers](elasticsearch://reference/elasticsearch/mapping-reference/doc-values.md#doc-values-skippers) on its `_tsid`, `@timestamp`, [dimension](#time-series-dimension) and [metric](#time-series-metric) fields. Because `tsid` and `@timestamp` are part of the index sort, this allows {{es}} to avoid building backing indexes for these fields, meaning lower disk usage and faster ingest speed. ## Query time series data ```{applies_to} From aa109c32d785aded26ef76b705ac22decfcbc01d Mon Sep 17 00:00:00 2001 From: Alan Woodward Date: Fri, 19 Dec 2025 17:12:23 +0000 Subject: [PATCH 3/4] Update manage-data/data-store/data-streams/time-series-data-stream-tsds.md Co-authored-by: wajihaparvez --- .../data-store/data-streams/time-series-data-stream-tsds.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/manage-data/data-store/data-streams/time-series-data-stream-tsds.md b/manage-data/data-store/data-streams/time-series-data-stream-tsds.md index 595929dcdd..313be4fad0 100644 --- a/manage-data/data-store/data-streams/time-series-data-stream-tsds.md +++ b/manage-data/data-store/data-streams/time-series-data-stream-tsds.md @@ -100,7 +100,7 @@ A time series data stream works like a regular data stream, with some key differ * **Dimension-based routing:** The routing logic uses dimension fields to map all data points of a time series to the same shard, improving storage efficiency and query performance. Duplicate data points are rejected. * **Sorting:** A TSDS uses internal [index sorting](elasticsearch://reference/elasticsearch/index-settings/sorting.md) to order shard segments by `_tsid` and `@timestamp`, for better compression. Time series data streams do not use `index.sort.*` settings. * **Source field:** A TSDS uses [synthetic `_source`](elasticsearch://reference/elasticsearch/mapping-reference/mapping-source-field.md#synthetic-source), and as a result is subject to some [restrictions](elasticsearch://reference/elasticsearch/mapping-reference/mapping-source-field.md#synthetic-source-restrictions) and [modifications](elasticsearch://reference/elasticsearch/mapping-reference/mapping-source-field.md#synthetic-source-modifications) applied to the `_source` field. -* {applies_to}`stack: ga 9.3` **Docvalue Skippers:** A TSDS enables [docvalue skippers](elasticsearch://reference/elasticsearch/mapping-reference/doc-values.md#doc-values-skippers) on its `_tsid`, `@timestamp`, [dimension](#time-series-dimension) and [metric](#time-series-metric) fields. Because `tsid` and `@timestamp` are part of the index sort, this allows {{es}} to avoid building backing indexes for these fields, meaning lower disk usage and faster ingest speed. +* {applies_to}`stack: ga 9.3` **Docvalue Skippers:** A TSDS enables [docvalue skippers](elasticsearch://reference/elasticsearch/mapping-reference/doc-values.md#doc-values-skippers) on its `_tsid`, `@timestamp`, [dimension](#time-series-dimension), and [metric](#time-series-metric) fields. Because `tsid` and `@timestamp` are part of the index sort, the skippers allow {{es}} to avoid building backing indexes for these fields, meaning lower disk usage and faster ingest speed. ## Query time series data ```{applies_to} From 34bb9ba79925a4a5ba1de104ced5c09a8aafa57c Mon Sep 17 00:00:00 2001 From: Alan Woodward Date: Fri, 19 Dec 2025 17:13:04 +0000 Subject: [PATCH 4/4] Update time-series-data-stream-tsds.md --- .../data-store/data-streams/time-series-data-stream-tsds.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/manage-data/data-store/data-streams/time-series-data-stream-tsds.md b/manage-data/data-store/data-streams/time-series-data-stream-tsds.md index 313be4fad0..393b1de3e9 100644 --- a/manage-data/data-store/data-streams/time-series-data-stream-tsds.md +++ b/manage-data/data-store/data-streams/time-series-data-stream-tsds.md @@ -100,7 +100,7 @@ A time series data stream works like a regular data stream, with some key differ * **Dimension-based routing:** The routing logic uses dimension fields to map all data points of a time series to the same shard, improving storage efficiency and query performance. Duplicate data points are rejected. * **Sorting:** A TSDS uses internal [index sorting](elasticsearch://reference/elasticsearch/index-settings/sorting.md) to order shard segments by `_tsid` and `@timestamp`, for better compression. Time series data streams do not use `index.sort.*` settings. * **Source field:** A TSDS uses [synthetic `_source`](elasticsearch://reference/elasticsearch/mapping-reference/mapping-source-field.md#synthetic-source), and as a result is subject to some [restrictions](elasticsearch://reference/elasticsearch/mapping-reference/mapping-source-field.md#synthetic-source-restrictions) and [modifications](elasticsearch://reference/elasticsearch/mapping-reference/mapping-source-field.md#synthetic-source-modifications) applied to the `_source` field. -* {applies_to}`stack: ga 9.3` **Docvalue Skippers:** A TSDS enables [docvalue skippers](elasticsearch://reference/elasticsearch/mapping-reference/doc-values.md#doc-values-skippers) on its `_tsid`, `@timestamp`, [dimension](#time-series-dimension), and [metric](#time-series-metric) fields. Because `tsid` and `@timestamp` are part of the index sort, the skippers allow {{es}} to avoid building backing indexes for these fields, meaning lower disk usage and faster ingest speed. +* {applies_to}`stack: ga 9.3` **Doc value Skippers:** A TSDS enables [docvalue skippers](elasticsearch://reference/elasticsearch/mapping-reference/doc-values.md#doc-values-skippers) on its `_tsid`, `@timestamp`, [dimension](#time-series-dimension), and [metric](#time-series-metric) fields. Because `tsid` and `@timestamp` are part of the index sort, the skippers allow {{es}} to avoid building backing indexes for these fields, meaning lower disk usage and faster ingest speed. ## Query time series data ```{applies_to}