Skip to content

Bugfix/9174 no time column dataset download - #298

Merged
utas-raymondng merged 8 commits into
mainfrom
bugfix/9174-no-time-column-dataset-download
Sep 15, 2026
Merged

utas-raymondng merged 8 commits into
mainfrom
bugfix/9174-no-time-column-dataset-download

Conversation

@shaunahu

@shaunahu shaunahu commented Sep 15, 2026

Copy link
Copy Markdown
Contributor

At init, if every requested key has no time column and is hive-partitioned by polygon, the job lists the polygon partition values from directory names only. It sorts them and cuts them into half-open ranges [lo, hi) (same logic as date split), with get_polygon_count_per_job() = 20 partitions per child job. These ranges replace date_ranges as the array job parameter, passed as polygon_ranges. Every other dataset still uses the date-range workflow, unchanged.

@shaunahu
shaunahu marked this pull request as ready for review September 15, 2026 04:01

@utas-raymondng utas-raymondng left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@utas-raymondng
utas-raymondng merged commit a188566 into main Sep 15, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants