Skip to content

Docs: improve ingestion tutorial - #2376

Open
nhoening wants to merge 6 commits into
mainfrom
docs/improve-ingestion-tutorial
Open

Docs: improve ingestion tutorial#2376
nhoening wants to merge 6 commits into
mainfrom
docs/improve-ingestion-tutorial

Conversation

@nhoening

@nhoening nhoening commented Aug 2, 2026

Copy link
Copy Markdown
Member

Description

We got feedback that early users do not have enough hand-holding on how to get data into FlexMeasures and build their own data pipelines.

  • major improvement on posting data tutorial
  • Adding running the ingestion script to our CI (succeeding)
  • Added changelog item in documentation/changelog.rst

Context:
- New users need a clearer path from a first file upload to an automated ingestion pipeline.

Change:
- Refactor the existing posting-data tutorial around Client 0.9.4, Excel/CSV, export scripts, verification, and an optional UI checkpoint.
- Add a standalone Docker QA runner and update the tutorial script guidance.
Context:
- The executable ingestion tutorial exposed that Docker workers reject XLSX uploads because openpyxl was test-only.

Change:
- Promote openpyxl to a default dependency and update the lockfile so production installations can process advertised Excel uploads.
Context:
- Tutorial examples should remain executable in both synchronous and queued Docker deployments.

Change:
- Run the ingestion tutorial in Docker build and release QA workflows using the current client checkout.
- Exclude that host-side client checkout from the Docker build context.
Context:
- Review identified safer password handling and several points that should be more explicit for new users.

Change:
- Prompt interactively for passwords, document CI toy credentials, clarify export values and optional verification, and remove the client upper bound.
- Rename the verification helper and correct the sixth toy tutorial's numbering and navigation order.
Context:
- The ingestion tutorial may be run with different integration accounts.

Change:
- Include the configured email address in interactive password prompts in both the tutorial and executable script.
Signed-off-by: Nicolas Höning <nicolas@seita.nl>
@read-the-docs-community

Copy link
Copy Markdown

@nhoening nhoening self-assigned this Aug 3, 2026
@nhoening nhoening added the documentation Improvements or additions to documentation label Aug 3, 2026
@nhoening nhoening added this to the 1.0.0 milestone Aug 3, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant