Add insitubatch streaming ERA5 data source and hindcast recipe - #962

Open

emfdavid wants to merge 16 commits into

NVIDIA:mainfrom

emfdavid:insitubatch

Commits on Aug 4, 2026

Add insitubatch-backed initial-condition feed
emfdavid
committed
7b22d23
Generalize the insitubatch feed to a lead axis with store injection
emfdavid
committed
344e3a0
Add insitubatch hindcast IO benchmark recipe
emfdavid
committed
deb2ced
Pin released insitubatch 0.1.0 + use its public API
emfdavid
committed
9da88a2
Update hindcast recipe README setup for the pinned data extra
emfdavid
committed
18658b9
Use uv sync --extra data in the recipe setup (house style)
emfdavid
committed
d15f110
Add offline tests + CHANGELOG for the insitubatch feed
emfdavid
committed
4ee5d19
Enable + document the cross-run persistent cache in the insitubatch feed
emfdavid
committed
2517d22
Note the persist-write overhead in the cache cold wall
emfdavid
committed
0e52120
Sort recipe imports for the current ruff config
emfdavid
committed
d401977
Reject leads that read past the store edge in the insitubatch feed
emfdavid
committed
9f6c455
Meet the new GitHub CI gates in the hindcast recipe

emfdavid
and
claude
committed
f78c368
Re-measure the hindcast recipe over obstore on both sides

emfdavid
and
claude
committed
3374fcf
State the logging requirement plainly in the recipe README

emfdavid
and
claude
committed
d1df9df
Attribute the ARCO gap to assembly, not throughput

emfdavid
and
claude
committed
97cc393

Commits on Aug 5, 2026

Correct the predownload framing and re-measure §1 against a cached baseline

emfdavid
and
claude
committed
ebdc695