[Tracker] Pull request handoff SLA

# Pull request handoff SLA tracker

Review during the daily stand-up alongside the architecture/RFC decision tracker.

The SLA is one business day per handoff; weekends are excluded and public holidays are not modeled.
Drafts, bots, and PRs labeled `stale`, `paused`, or `do-not-track` are excluded.
Last refreshed: 2026-09-30T19:26+00:00

## Newly breached (17)

### Waiting on reviewers (6)

| PR | Waiting on | Reason | Handoff | SLA deadline | Overdue |
| --- | --- | --- | --- | --- | --- |
| [#3765 — fix(osworld): complete native AgentEnv evaluation and health reporting](https://github.com/NVIDIA-NeMo/Gym/pull/3765) | [@JeffPengCoder](https://github.com/JeffPengCoder) | review requested | 2026-09-29 12:33 UTC | 2026-09-30 12:33 UTC | 6h |
| [#3713 — docs: shorten benchmark onboarding guidance](https://github.com/NVIDIA-NeMo/Gym/pull/3713) | [@sephmard](https://github.com/sephmard) | review requested | 2026-09-29 14:54 UTC | 2026-09-30 14:54 UTC | 4h |
| [#3771 — feat(orchestration): add single-node Kubernetes support to `gym eval submit`](https://github.com/NVIDIA-NeMo/Gym/pull/3771) | [@prokotg](https://github.com/prokotg) | review requested | 2026-09-29 16:10 UTC | 2026-09-30 16:10 UTC | 3h |
| [#3775 — feat: add rubric-mean and fixed-baseline scoring to GenRM compare](https://github.com/NVIDIA-NeMo/Gym/pull/3775) | [@HeyyyyyyG](https://github.com/HeyyyyyyG), [@abukharin-nv](https://github.com/abukharin-nv), [@yfw](https://github.com/yfw) | review requested | 2026-09-29 18:39 UTC | 2026-09-30 18:39 UTC | 0h |
| [#3780 — Enable multinode K8](https://github.com/NVIDIA-NeMo/Gym/pull/3780) | [@prokotg](https://github.com/prokotg) | review requested | 2026-09-29 19:07 UTC | 2026-09-30 19:07 UTC | 0h |
| [#3575 — feat(agent): add dedicated OpenCode and Pi sandboxed evaluation](https://github.com/NVIDIA-NeMo/Gym/pull/3575) | [@yaoyu-33](https://github.com/yaoyu-33) | review requested | 2026-09-29 19:11 UTC | 2026-09-30 19:11 UTC | 0h |

### Waiting on authors (2)

| PR | Waiting on | Reason | Handoff | SLA deadline | Overdue |
| --- | --- | --- | --- | --- | --- |
| [#3668 — Add prebuilt Apex world sandbox support](https://github.com/NVIDIA-NeMo/Gym/pull/3668) | [@arti4nvj](https://github.com/arti4nvj) | changes requested | 2026-09-29 00:33 UTC | 2026-09-30 00:33 UTC | 18h |
| [#3759 — Mbagdasarova/service tier fix](https://github.com/NVIDIA-NeMo/Gym/pull/3759) | [@pachmu](https://github.com/pachmu) | changes requested | 2026-09-29 16:27 UTC | 2026-09-30 16:27 UTC | 2h |

### Needs review assignment (9)

| PR | Waiting on | Reason | Handoff | SLA deadline | Overdue |
| --- | --- | --- | --- | --- | --- |
| [#3738 — pjin/main-dev-20260928](https://github.com/NVIDIA-NeMo/Gym/pull/3738) | Maintainers | reviewer not assigned | 2026-09-28 20:54 UTC | 2026-09-29 20:54 UTC | 22h |
| [#3740 — [ApexAgents] Add opt-in weighted-average rubric scoring](https://github.com/NVIDIA-NeMo/Gym/pull/3740) | Maintainers | reviewer not assigned | 2026-09-28 21:07 UTC | 2026-09-29 21:07 UTC | 22h |
| [#3742 — [ApexAgents] Add a context window setting for Stirrup summarization](https://github.com/NVIDIA-NeMo/Gym/pull/3742) | Maintainers | reviewer not assigned | 2026-09-28 22:16 UTC | 2026-09-29 22:16 UTC | 21h |
| [#3700 — fix(cli): fail server suites on unrecognized exit codes](https://github.com/NVIDIA-NeMo/Gym/pull/3700) | Maintainers | reviewer not assigned | 2026-09-28 23:08 UTC | 2026-09-29 23:08 UTC | 20h |
| [#3652 — fix(sandbox): stop local subprocesses on cancellation](https://github.com/NVIDIA-NeMo/Gym/pull/3652) | Maintainers | reviewer not assigned | 2026-09-28 23:08 UTC | 2026-09-29 23:08 UTC | 20h |
| [#3672 — fix(eval): preserve per-rollout seeds with existing metadata](https://github.com/NVIDIA-NeMo/Gym/pull/3672) | Maintainers | reviewer not assigned | 2026-09-28 23:08 UTC | 2026-09-29 23:08 UTC | 20h |
| [#3694 — fix(capture): mask rollouts with unconfirmed terminal IDs](https://github.com/NVIDIA-NeMo/Gym/pull/3694) | Maintainers | reviewer not assigned | 2026-09-28 23:08 UTC | 2026-09-29 23:08 UTC | 20h |
| [#3767 — feat(formal-conjectures): add the Formal Conjectures benchmark on lean_proof](https://github.com/NVIDIA-NeMo/Gym/pull/3767) | Maintainers | reviewer not assigned | 2026-09-29 13:57 UTC | 2026-09-30 13:57 UTC | 5h |
| [#3769 — fix(health): evaluate the final top-level model call](https://github.com/NVIDIA-NeMo/Gym/pull/3769) | Maintainers | reviewer not assigned | 2026-09-29 14:39 UTC | 2026-09-30 14:39 UTC | 4h |

<details>
<summary><strong>Older breach backlog (162)</strong></summary>

### Waiting on reviewers (59)

| PR | Waiting on | Reason | Handoff | SLA deadline | Overdue |
| --- | --- | --- | --- | --- | --- |
| [#799 — fix: preserve optional fields in structured_outputs strictify_schema_json](https://github.com/NVIDIA-NeMo/Gym/pull/799) | [@jkyi-nvidia](https://github.com/jkyi-nvidia) | review requested | 2026-03-02 20:59 UTC | 2026-03-03 20:59 UTC | 150d 22h |
| [#879 — Yev/scicode env v1](https://github.com/NVIDIA-NeMo/Gym/pull/879) | [@dhruvnathawani](https://github.com/dhruvnathawani), [@jubick1337](https://github.com/jubick1337) | review requested | 2026-03-20 18:09 UTC | 2026-03-23 18:09 UTC | 137d 1h |
| [#946 — Turing/ Playwright-based CUA environment with multi-provider adapter support](https://github.com/NVIDIA-NeMo/Gym/pull/946) | [@bxyu-nvidia](https://github.com/bxyu-nvidia) | review requested | 2026-04-29 19:09 UTC | 2026-04-30 19:09 UTC | 109d 0h |
| [#1193 — docs: address repo-health audit nits in README and CONTRIBUTING](https://github.com/NVIDIA-NeMo/Gym/pull/1193) | [@cmunley1](https://github.com/cmunley1) | review requested | 2026-04-30 13:30 UTC | 2026-05-01 13:30 UTC | 108d 5h |
| [#1264 — feat: artifact-root resolution for external plugins](https://github.com/NVIDIA-NeMo/Gym/pull/1264) | [@ananthsub](https://github.com/ananthsub), [@bxyu-nvidia](https://github.com/bxyu-nvidia) | review requested | 2026-05-07 20:20 UTC | 2026-05-08 20:20 UTC | 102d 23h |
| [#1334 — structured_outputs: add LLM-as-a-judge semantic verification](https://github.com/NVIDIA-NeMo/Gym/pull/1334) | [@jkyi-nvidia](https://github.com/jkyi-nvidia) | review requested | 2026-05-18 20:37 UTC | 2026-05-19 20:37 UTC | 95d 22h |
| [#1491 — Add compute_eval benchmark and resource server](https://github.com/NVIDIA-NeMo/Gym/pull/1491) | [@ananthsub](https://github.com/ananthsub), [@bxyu-nvidia](https://github.com/bxyu-nvidia) | review requested | 2026-06-02 00:07 UTC | 2026-06-03 00:07 UTC | 85d 19h |
| [#1560 — docs: clarify resources server example-data contract and license validation](https://github.com/NVIDIA-NeMo/Gym/pull/1560) | [@cwing-nvidia](https://github.com/cwing-nvidia), [@lbliii](https://github.com/lbliii) | review requested | 2026-06-10 12:04 UTC | 2026-06-11 12:04 UTC | 79d 7h |
| [#1541 — Add SC_Bench benchmark](https://github.com/NVIDIA-NeMo/Gym/pull/1541) | [@adil-a](https://github.com/adil-a), [@ananthsub](https://github.com/ananthsub), [@bxyu-nvidia](https://github.com/bxyu-nvidia), [@cwing-nvidia](https://github.com/cwing-nvidia) | review requested | 2026-06-13 00:57 UTC | 2026-06-15 00:57 UTC | 77d 18h |
| [#1598 — Eshachar/openclaw swe](https://github.com/NVIDIA-NeMo/Gym/pull/1598) | [@sdevare-nv](https://github.com/sdevare-nv) | review requested | 2026-06-16 18:19 UTC | 2026-06-17 18:19 UTC | 75d 1h |
| [#1653 — docs: remove model recipe column from RL framework compatibility table](https://github.com/NVIDIA-NeMo/Gym/pull/1653) | [@cwing-nvidia](https://github.com/cwing-nvidia) | review requested | 2026-06-23 03:23 UTC | 2026-06-24 03:23 UTC | 70d 16h |
| [#1752 — fix: handle vllm context length errors in nano v3 recipe](https://github.com/NVIDIA-NeMo/Gym/pull/1752) | [@yfw](https://github.com/yfw) | review requested | 2026-06-26 05:53 UTC | 2026-06-29 05:53 UTC | 67d 13h |
| [#2026 — feat: Switchyard token-capture integration for OpenHands SWE runs (zero-fork)](https://github.com/NVIDIA-NeMo/Gym/pull/2026) | [@bxyu-nvidia](https://github.com/bxyu-nvidia) | review requested | 2026-07-14 22:36 UTC | 2026-07-15 22:36 UTC | 54d 20h |
| [#1964 — feat(model-server): add OpenAI-compatible /v1/embeddings endpoint](https://github.com/NVIDIA-NeMo/Gym/pull/1964) | [@ffrujeri](https://github.com/ffrujeri) | review requested | 2026-07-15 16:18 UTC | 2026-07-16 16:18 UTC | 54d 3h |
| [#1727 — fix(vllm_model): handle explicit null metadata in preprocessing](https://github.com/NVIDIA-NeMo/Gym/pull/1727) | [@ananthsub](https://github.com/ananthsub) | review requested | 2026-07-15 17:11 UTC | 2026-07-16 17:11 UTC | 54d 2h |
| [#2048 — feat: sandbox_agent swe resources server](https://github.com/NVIDIA-NeMo/Gym/pull/2048) | [@adil-a](https://github.com/adil-a), [@ananthsub](https://github.com/ananthsub), [@bxyu-nvidia](https://github.com/bxyu-nvidia), [@hemildesai](https://github.com/hemildesai) | review requested | 2026-07-15 21:13 UTC | 2026-07-16 21:13 UTC | 53d 22h |
| [#2052 — hermes_agent: repin to upstream hermes and fix the wrapper for its API](https://github.com/NVIDIA-NeMo/Gym/pull/2052) | [@Glorf](https://github.com/Glorf) | review requested | 2026-07-17 22:38 UTC | 2026-07-20 22:38 UTC | 51d 20h |
| [#2155 — [GDPVal] Fix Stirrup reference paths and make head-server wait configurable](https://github.com/NVIDIA-NeMo/Gym/pull/2155) | [@agronskiy](https://github.com/agronskiy) | review requested | 2026-07-29 16:40 UTC | 2026-07-30 16:40 UTC | 44d 2h |
| [#2160 — [GDPVal] Fix what reaches the rubric judge, and stop silent zeros](https://github.com/NVIDIA-NeMo/Gym/pull/2160) | [@agronskiy](https://github.com/agronskiy) | review requested | 2026-07-29 16:40 UTC | 2026-07-30 16:40 UTC | 44d 2h |
| [#2162 — [GDPVal] Add model-agnostic Slurm orchestration for multi-allocation rollouts](https://github.com/NVIDIA-NeMo/Gym/pull/2162) | [@agronskiy](https://github.com/agronskiy) | review requested | 2026-07-29 16:40 UTC | 2026-07-30 16:40 UTC | 44d 2h |
| [#2304 — default port range to the 5000-5999 band](https://github.com/NVIDIA-NeMo/Gym/pull/2304) | [@adil-a](https://github.com/adil-a) | review requested | 2026-08-04 13:48 UTC | 2026-08-05 13:48 UTC | 40d 5h |
| [#2311 — docs: rewrite Configure Agents index and document external agent harnesses](https://github.com/NVIDIA-NeMo/Gym/pull/2311) | [@cwing-nvidia](https://github.com/cwing-nvidia), [@lbliii](https://github.com/lbliii) | review requested | 2026-08-04 14:30 UTC | 2026-08-05 14:30 UTC | 40d 4h |
| [#2386 — feat: harden SWE against filesystem overflow](https://github.com/NVIDIA-NeMo/Gym/pull/2386) | [@sdevare-nv](https://github.com/sdevare-nv) | review requested | 2026-08-06 17:31 UTC | 2026-08-07 17:31 UTC | 38d 1h |
| [#2142 — Add EnterpriseOps-Gym benchmark: resources server, benchmark registration, and per-turn telemetry agent](https://github.com/NVIDIA-NeMo/Gym/pull/2142) | [@bxyu-nvidia](https://github.com/bxyu-nvidia), [@cwing-nvidia](https://github.com/cwing-nvidia) | review requested | 2026-08-08 08:52 UTC | 2026-08-10 08:52 UTC | 37d 10h |
| [#2481 — feat: swe_trace_converter change for the opencode backend](https://github.com/NVIDIA-NeMo/Gym/pull/2481) | [@bxyu-nvidia](https://github.com/bxyu-nvidia), [@sdevare-nv](https://github.com/sdevare-nv) | review requested | 2026-08-11 18:44 UTC | 2026-08-12 18:44 UTC | 35d 0h |
| [#2346 — feat(sandbox): add Tenki provider](https://github.com/NVIDIA-NeMo/Gym/pull/2346) | [@hemildesai](https://github.com/hemildesai) | review requested | 2026-08-12 16:45 UTC | 2026-08-13 16:45 UTC | 34d 2h |
| [#2592 — Fix compute_pass_majority_metrics: score unanswered rollouts as failures in pass@k](https://github.com/NVIDIA-NeMo/Gym/pull/2592) | [@gwarmstrong](https://github.com/gwarmstrong), [@jkyi-nvidia](https://github.com/jkyi-nvidia) | review requested | 2026-08-18 16:55 UTC | 2026-08-19 16:55 UTC | 30d 2h |
| [#2703 — docs(verifier): require verify to return the scored response](https://github.com/NVIDIA-NeMo/Gym/pull/2703) | [@mpatel31415](https://github.com/mpatel31415) | review requested | 2026-08-24 05:09 UTC | 2026-08-25 05:09 UTC | 26d 14h |
| [#2673 — fix: preserve structured MCP tool identity for verification](https://github.com/NVIDIA-NeMo/Gym/pull/2673) | [@adil-a](https://github.com/adil-a), [@bxyu-nvidia](https://github.com/bxyu-nvidia) | review requested | 2026-08-25 00:10 UTC | 2026-08-26 00:10 UTC | 25d 19h |
| [#2742 — chore(hermes_agent): use pinned upstream Hermes release](https://github.com/NVIDIA-NeMo/Gym/pull/2742) | [@Glorf](https://github.com/Glorf), [@ananthsub](https://github.com/ananthsub), [@laszkiewiczp](https://github.com/laszkiewiczp) | review requested | 2026-08-25 03:18 UTC | 2026-08-26 03:18 UTC | 25d 16h |
| [#2733 — feat(openclaw_agent): consume rollout-scoped Gym MCP metadata](https://github.com/NVIDIA-NeMo/Gym/pull/2733) | [@cmunley1](https://github.com/cmunley1), [@ffrujeri](https://github.com/ffrujeri) | review requested | 2026-08-25 04:28 UTC | 2026-08-26 04:28 UTC | 25d 14h |
| [#2771 — feat: add raw_rewards_and_lengths to group-level reward profile metrics](https://github.com/NVIDIA-NeMo/Gym/pull/2771) | [@bxyu-nvidia](https://github.com/bxyu-nvidia), [@jkyi-nvidia](https://github.com/jkyi-nvidia) | review requested | 2026-08-25 21:53 UTC | 2026-08-26 21:53 UTC | 24d 21h |
| [#2783 — refactor: decouple rollout identity from capture](https://github.com/NVIDIA-NeMo/Gym/pull/2783) | [@Glorf](https://github.com/Glorf), [@ffrujeri](https://github.com/ffrujeri), [@pthombre](https://github.com/pthombre) | review requested | 2026-08-26 08:14 UTC | 2026-08-27 08:14 UTC | 24d 11h |
| [#2758 — feat: sandbox provider image prepare hook + update prepare step in AnyTerminal ](https://github.com/NVIDIA-NeMo/Gym/pull/2758) | [@hemildesai](https://github.com/hemildesai) | review requested | 2026-08-26 16:17 UTC | 2026-08-27 16:17 UTC | 24d 3h |
| [#2732 — chore(data): apply the dataset decoupling migration (agent_ref out of data files)](https://github.com/NVIDIA-NeMo/Gym/pull/2732) | [@ananthsub](https://github.com/ananthsub) | review requested | 2026-08-26 23:21 UTC | 2026-08-27 23:21 UTC | 23d 20h |
| [#2866 — Add support for judging and rejudging saved responses](https://github.com/NVIDIA-NeMo/Gym/pull/2866) | [@bxyu-nvidia](https://github.com/bxyu-nvidia) | review requested | 2026-08-29 00:07 UTC | 2026-08-31 00:07 UTC | 22d 19h |
| [#2879 — feat(sandbox): IdeGYM sandbox provider](https://github.com/NVIDIA-NeMo/Gym/pull/2879) | [@hemildesai](https://github.com/hemildesai) | review requested | 2026-08-31 23:09 UTC | 2026-09-01 23:09 UTC | 20d 20h |
| [#3050 — fix(token-id-capture): fingerprint the served response dialect](https://github.com/NVIDIA-NeMo/Gym/pull/3050) | [@pthombre](https://github.com/pthombre) | review requested | 2026-09-03 08:30 UTC | 2026-09-04 08:30 UTC | 18d 10h |
| [#3058 — fix(code-gen): replace Manager proxies with bounded IPC](https://github.com/NVIDIA-NeMo/Gym/pull/3058) | [@fgalko-oss](https://github.com/fgalko-oss) | review requested | 2026-09-03 19:21 UTC | 2026-09-04 19:21 UTC | 18d 0h |
| [#3078 — docs: update NeMo RL tutorial container](https://github.com/NVIDIA-NeMo/Gym/pull/3078) | [@cwing-nvidia](https://github.com/cwing-nvidia), [@kajalj22](https://github.com/kajalj22), [@lbliii](https://github.com/lbliii), [@sephmard](https://github.com/sephmard) | review requested | 2026-09-04 00:19 UTC | 2026-09-07 00:19 UTC | 17d 19h |
| [#3117 — feat(server_utils): opt-in CRLF heartbeat so long HTTP/1.1 model calls survive Global Accelerator's 340s idle timeout](https://github.com/NVIDIA-NeMo/Gym/pull/3117) | [@ananthsub](https://github.com/ananthsub), [@kajalj22](https://github.com/kajalj22) | review requested | 2026-09-08 04:58 UTC | 2026-09-09 04:58 UTC | 15d 14h |
| [#3133 — docs: standardize verification task data convention](https://github.com/NVIDIA-NeMo/Gym/pull/3133) | [@adil-a](https://github.com/adil-a) | review requested | 2026-09-09 12:16 UTC | 2026-09-10 12:16 UTC | 14d 7h |
| [#3189 — fix(responses): preserve refusal conversion semantics](https://github.com/NVIDIA-NeMo/Gym/pull/3189) | [@bxyu-nvidia](https://github.com/bxyu-nvidia), [@cmunley1](https://github.com/cmunley1) | review requested | 2026-09-09 14:04 UTC | 2026-09-10 14:04 UTC | 14d 5h |
| [#2954 — docs: document gym env prefetch CLI #2937](https://github.com/NVIDIA-NeMo/Gym/pull/2954) | [@ritaneves](https://github.com/ritaneves) | review requested | 2026-09-09 16:54 UTC | 2026-09-10 16:54 UTC | 14d 2h |
| [#2580 — docs: fix Fern polish issues from NVBugs 6570461](https://github.com/NVIDIA-NeMo/Gym/pull/2580) | [@cwing-nvidia](https://github.com/cwing-nvidia), [@sephmard](https://github.com/sephmard) | review requested | 2026-09-09 16:55 UTC | 2026-09-10 16:55 UTC | 14d 2h |
| [#3314 — fix(responses): accept an empty include when downconverting to Chat Completions](https://github.com/NVIDIA-NeMo/Gym/pull/3314) | [@ananthsub](https://github.com/ananthsub) | review requested | 2026-09-15 03:38 UTC | 2026-09-16 03:38 UTC | 10d 15h |
| [#3317 — fix(responses): report unknown usage detail counters as 0 in the synthesized SSE stream](https://github.com/NVIDIA-NeMo/Gym/pull/3317) | [@yaoyu-33](https://github.com/yaoyu-33) | review requested | 2026-09-15 03:38 UTC | 2026-09-16 03:38 UTC | 10d 15h |
| [#3212 — feat(capture): expose complete rollout training traces](https://github.com/NVIDIA-NeMo/Gym/pull/3212) | [@ananthsub](https://github.com/ananthsub), [@bxyu-nvidia](https://github.com/bxyu-nvidia) | review requested | 2026-09-15 13:07 UTC | 2026-09-16 13:07 UTC | 10d 6h |
| [#3415 — Improve model retry controls and Gymnasium rollout handling](https://github.com/NVIDIA-NeMo/Gym/pull/3415) | [@bxyu-nvidia](https://github.com/bxyu-nvidia) | review requested | 2026-09-15 22:48 UTC | 2026-09-16 22:48 UTC | 9d 20h |
| [#3417 — Add AA-Briefcase-Lite benchmark and artifact-aware judging](https://github.com/NVIDIA-NeMo/Gym/pull/3417) | [@Kh4L](https://github.com/Kh4L), [@dznvidia](https://github.com/dznvidia) | review requested | 2026-09-16 00:38 UTC | 2026-09-17 00:38 UTC | 9d 18h |
| [#3508 — [ApexAgents] Checkpoint and resume rollouts across allocations](https://github.com/NVIDIA-NeMo/Gym/pull/3508) | [@arti4nvj](https://github.com/arti4nvj) | review requested | 2026-09-17 23:38 UTC | 2026-09-18 23:38 UTC | 7d 19h |
| [#3559 — feat(eval): count a rollout that produced no row as zero](https://github.com/NVIDIA-NeMo/Gym/pull/3559) | [@ananthsub](https://github.com/ananthsub), [@giuliolovisotto](https://github.com/giuliolovisotto) | review requested | 2026-09-19 20:38 UTC | 2026-09-21 20:38 UTC | 6d 22h |
| [#3611 — feat(combibench): add CombiBench Lean 4 combinatorics benchmark](https://github.com/NVIDIA-NeMo/Gym/pull/3611) | [@lilithgrigoryan](https://github.com/lilithgrigoryan) | review requested | 2026-09-22 12:01 UTC | 2026-09-23 12:01 UTC | 5d 7h |
| [#3348 — feat(translation_with_judge): add Indic-focused LLM-judge translation…](https://github.com/NVIDIA-NeMo/Gym/pull/3348) | [@yaoyu-33](https://github.com/yaoyu-33) | review requested | 2026-09-22 12:03 UTC | 2026-09-23 12:03 UTC | 5d 7h |
| [#3612 — feat(nmrarena): add NMRArena NMR structure elucidation benchmark](https://github.com/NVIDIA-NeMo/Gym/pull/3612) | [@lilithgrigoryan](https://github.com/lilithgrigoryan) | review requested | 2026-09-22 12:36 UTC | 2026-09-23 12:36 UTC | 5d 6h |
| [#3599 — feat(metrics): collect optional vLLM and router inference metrics](https://github.com/NVIDIA-NeMo/Gym/pull/3599) | [@oyilmaz-nvidia](https://github.com/oyilmaz-nvidia) | review requested | 2026-09-22 12:51 UTC | 2026-09-23 12:51 UTC | 5d 6h |
| [#3638 — feat(telemetry): count finished rollouts by outcome, class and reason](https://github.com/NVIDIA-NeMo/Gym/pull/3638) | [@yuhezhang-ai](https://github.com/yuhezhang-ai) | review requested | 2026-09-23 14:14 UTC | 2026-09-24 14:14 UTC | 4d 5h |
| [#3632 — feat(core): expose aiohttp pool wait telemetry](https://github.com/NVIDIA-NeMo/Gym/pull/3632) | [@kajalj22](https://github.com/kajalj22) | review requested | 2026-09-23 16:45 UTC | 2026-09-24 16:45 UTC | 4d 2h |
| [#3664 — fix(switchyard_model): match vllm_model for reasoning models; pin nemo-switchyard 0.3.0](https://github.com/NVIDIA-NeMo/Gym/pull/3664) | [@ananthsub](https://github.com/ananthsub), [@bxyu-nvidia](https://github.com/bxyu-nvidia) | review requested | 2026-09-25 00:04 UTC | 2026-09-28 00:04 UTC | 2d 19h |

### Waiting on authors (3)

| PR | Waiting on | Reason | Handoff | SLA deadline | Overdue |
| --- | --- | --- | --- | --- | --- |
| [#1600 — docs(fern): add SEO meta descriptions + headlines to nightly docs (#1589)](https://github.com/NVIDIA-NeMo/Gym/pull/1600) | [@lbliii](https://github.com/lbliii) | changes requested | 2026-06-29 14:05 UTC | 2026-06-30 14:05 UTC | 66d 5h |
| [#2339 — Katherine/gdpval devel staging](https://github.com/NVIDIA-NeMo/Gym/pull/2339) | [@katherineh123](https://github.com/katherineh123) | changes requested | 2026-08-09 22:03 UTC | 2026-08-10 22:03 UTC | 36d 21h |
| [#2570 — feat(vllm_model): optional session-affinity header for upstream routers](https://github.com/NVIDIA-NeMo/Gym/pull/2570) | [@aoshen02](https://github.com/aoshen02) | changes requested | 2026-08-18 16:53 UTC | 2026-08-19 16:53 UTC | 30d 2h |

### Needs review assignment (100)

| PR | Waiting on | Reason | Handoff | SLA deadline | Overdue |
| --- | --- | --- | --- | --- | --- |
| [#834 — Add Tau^2 Bench training environment](https://github.com/NVIDIA-NeMo/Gym/pull/834) | Maintainers | reviewer not assigned | 2026-03-06 22:23 UTC | 2026-03-09 22:23 UTC | 146d 21h |
| [#1103 — structured_outputs: support oneOf/anyOf branches and $defs/$ref schemas](https://github.com/NVIDIA-NeMo/Gym/pull/1103) | Maintainers | reviewer not assigned | 2026-04-21 05:08 UTC | 2026-04-22 05:08 UTC | 115d 14h |
| [#1233 — structured_outputs: extend XML type coercion to handle oneOf/anyOf/allOf composition](https://github.com/NVIDIA-NeMo/Gym/pull/1233) | Maintainers | reviewer not assigned | 2026-05-05 21:17 UTC | 2026-05-06 21:17 UTC | 104d 22h |
| [#1274 — Add audiobench_alpaca_audio benchmark + audiobench_judge resource server](https://github.com/NVIDIA-NeMo/Gym/pull/1274) | Maintainers | reviewer not assigned | 2026-05-08 20:49 UTC | 2026-05-11 20:49 UTC | 101d 22h |
| [#1315 — Add GitHub issue template for environment integrations](https://github.com/NVIDIA-NeMo/Gym/pull/1315) | Maintainers | reviewer not assigned | 2026-05-13 19:42 UTC | 2026-05-14 19:42 UTC | 98d 23h |
| [#1358 — feat(vllm_model): chunk long single-clip audio in chat_completions](https://github.com/NVIDIA-NeMo/Gym/pull/1358) | Maintainers | reviewer not assigned | 2026-05-18 21:04 UTC | 2026-05-19 21:04 UTC | 95d 22h |
| [#1429 — docs: clarify SWE-bench dataset downloads](https://github.com/NVIDIA-NeMo/Gym/pull/1429) | Maintainers | reviewer not assigned | 2026-05-27 08:53 UTC | 2026-05-28 08:53 UTC | 89d 10h |
| [#1590 — feat(equivalence_llm_judge): cap extracted-answer length sent to judge](https://github.com/NVIDIA-NeMo/Gym/pull/1590) | Maintainers | reviewer not assigned | 2026-06-12 22:06 UTC | 2026-06-15 22:06 UTC | 76d 21h |
| [#1720 — feat(instruction_following): add loose-mode evaluation and compute_metrics](https://github.com/NVIDIA-NeMo/Gym/pull/1720) | Maintainers | reviewer not assigned | 2026-06-25 01:12 UTC | 2026-06-26 01:12 UTC | 68d 18h |
| [#1745 — fix(config): seed no-model refs for prepare-data](https://github.com/NVIDIA-NeMo/Gym/pull/1745) | Maintainers | reviewer not assigned | 2026-06-26 00:31 UTC | 2026-06-29 00:31 UTC | 67d 18h |
| [#1797 — fix(inference_provider): normalize provider endpoint errors](https://github.com/NVIDIA-NeMo/Gym/pull/1797) | Maintainers | reviewer not assigned | 2026-06-27 04:43 UTC | 2026-06-29 04:43 UTC | 67d 14h |
| [#1800 — Harden SWE agent test file parsing](https://github.com/NVIDIA-NeMo/Gym/pull/1800) | Maintainers | reviewer not assigned | 2026-06-27 10:32 UTC | 2026-06-29 10:32 UTC | 67d 8h |
| [#1847 — Rgala/browsecomp search providers newstable](https://github.com/NVIDIA-NeMo/Gym/pull/1847) | Maintainers | reviewer not assigned | 2026-07-01 00:35 UTC | 2026-07-02 00:35 UTC | 64d 18h |
| [#1908 — Actions: sync project status to release label](https://github.com/NVIDIA-NeMo/Gym/pull/1908) | Maintainers | reviewer not assigned | 2026-07-02 13:16 UTC | 2026-07-03 13:16 UTC | 63d 6h |
| [#1939 — Tb e2e](https://github.com/NVIDIA-NeMo/Gym/pull/1939) | Maintainers | reviewer not assigned | 2026-07-06 18:22 UTC | 2026-07-07 18:22 UTC | 61d 1h |
| [#2080 — feat: Switchyard OpenCode integration](https://github.com/NVIDIA-NeMo/Gym/pull/2080) | Maintainers | reviewer not assigned | 2026-07-20 12:50 UTC | 2026-07-21 12:50 UTC | 51d 6h |
| [#2109 — fix(server_utils): use unpredictable per-process secret for session signing](https://github.com/NVIDIA-NeMo/Gym/pull/2109) | Maintainers | reviewer not assigned | 2026-07-22 21:53 UTC | 2026-07-23 21:53 UTC | 48d 21h |
| [#2027 — Simplify ModelCallRecord; Refactor call capture logic; Extend to agents](https://github.com/NVIDIA-NeMo/Gym/pull/2027) | Maintainers | reviewer not assigned | 2026-07-28 06:26 UTC | 2026-07-29 06:26 UTC | 45d 13h |
| [#2254 — fix(hermes_agent): never present fabricated tokens as policy output](https://github.com/NVIDIA-NeMo/Gym/pull/2254) | Maintainers | reviewer not assigned | 2026-07-30 21:27 UTC | 2026-07-31 21:27 UTC | 42d 21h |
| [#2437 — feat(agents): add aggregate metrics proxy helper](https://github.com/NVIDIA-NeMo/Gym/pull/2437) | Maintainers | reviewer not assigned | 2026-08-08 12:41 UTC | 2026-08-10 12:41 UTC | 37d 6h |
| [#2412 — fix(pinchbench): address the model server per rollout so capture attributes calls](https://github.com/NVIDIA-NeMo/Gym/pull/2412) | Maintainers | reviewer not assigned | 2026-08-07 13:59 UTC | 2026-08-10 13:59 UTC | 37d 5h |
| [#2513 — fix: serialize Jest in nv-internal SWE](https://github.com/NVIDIA-NeMo/Gym/pull/2513) | Maintainers | reviewer not assigned | 2026-08-12 13:56 UTC | 2026-08-13 13:56 UTC | 34d 5h |
| [#2526 — feat(core): add shared failure-routing helpers](https://github.com/NVIDIA-NeMo/Gym/pull/2526) | Maintainers | reviewer not assigned | 2026-08-13 02:08 UTC | 2026-08-14 02:08 UTC | 33d 17h |
| [#2527 — fix: bound model request retries](https://github.com/NVIDIA-NeMo/Gym/pull/2527) | Maintainers | reviewer not assigned | 2026-08-13 09:39 UTC | 2026-08-14 09:39 UTC | 33d 9h |
| [#2553 — feat: add OrcaRouter as a named inference provider](https://github.com/NVIDIA-NeMo/Gym/pull/2553) | Maintainers | reviewer not assigned | 2026-08-14 03:26 UTC | 2026-08-17 03:26 UTC | 32d 16h |
| [#2578 — [Super 3.5 evals] Apply measured full-rack vLLM configuration](https://github.com/NVIDIA-NeMo/Gym/pull/2578) | Maintainers | reviewer not assigned | 2026-08-17 18:10 UTC | 2026-08-18 18:10 UTC | 31d 1h |
| [#2594 — feat(swebench): configurable image namespace and arch for eval containers](https://github.com/NVIDIA-NeMo/Gym/pull/2594) | Maintainers | reviewer not assigned | 2026-08-18 14:50 UTC | 2026-08-19 14:50 UTC | 30d 4h |
| [#2602 — docs: mention Cline harness in SWE agents README](https://github.com/NVIDIA-NeMo/Gym/pull/2602) | Maintainers | reviewer not assigned | 2026-08-18 20:29 UTC | 2026-08-19 20:29 UTC | 29d 22h |
| [#2605 — Add live web client for Kuhn poker](https://github.com/NVIDIA-NeMo/Gym/pull/2605) | Maintainers | reviewer not assigned | 2026-08-19 01:15 UTC | 2026-08-20 01:15 UTC | 29d 18h |
| [#2700 — feat(gymv): add multimodal environment integration](https://github.com/NVIDIA-NeMo/Gym/pull/2700) | Maintainers | reviewer not assigned | 2026-08-24 04:01 UTC | 2026-08-25 04:01 UTC | 26d 15h |
| [#2772 — fix(sandbox): implement canonical task environment resolution](https://github.com/NVIDIA-NeMo/Gym/pull/2772) | Maintainers | reviewer not assigned | 2026-08-25 22:45 UTC | 2026-08-26 22:45 UTC | 24d 20h |
| [#2613 — feat(observability): return the environment session id and allow correlation without full capture](https://github.com/NVIDIA-NeMo/Gym/pull/2613) | Maintainers | reviewer not assigned | 2026-08-27 09:36 UTC | 2026-08-28 09:36 UTC | 23d 9h |
| [#2838 — fix: preserve batch wrapper exit status](https://github.com/NVIDIA-NeMo/Gym/pull/2838) | Maintainers | reviewer not assigned | 2026-08-28 04:26 UTC | 2026-08-31 04:26 UTC | 22d 15h |
| [#2841 — feat(primevul): add PrimeVul paired vulnerability-detection benchmark](https://github.com/NVIDIA-NeMo/Gym/pull/2841) | Maintainers | reviewer not assigned | 2026-08-28 08:45 UTC | 2026-08-31 08:45 UTC | 22d 10h |
| [#2836 — perf(vllm): derive required prefix token IDs in Gym](https://github.com/NVIDIA-NeMo/Gym/pull/2836) | Maintainers | reviewer not assigned | 2026-08-31 17:20 UTC | 2026-09-01 17:20 UTC | 21d 2h |
| [#2907 — fix(swerl_gen): gen_eval_scripts.py always exits with TypeError (no --image-dir option)](https://github.com/NVIDIA-NeMo/Gym/pull/2907) | Maintainers | reviewer not assigned | 2026-09-01 01:18 UTC | 2026-09-02 01:18 UTC | 20d 18h |
| [#2910 — keep resolved config out of process arguments](https://github.com/NVIDIA-NeMo/Gym/pull/2910) | Maintainers | reviewer not assigned | 2026-09-01 03:16 UTC | 2026-09-02 03:16 UTC | 20d 16h |
| [#2915 — test(ci): AUT-2197 catch untestable component directories](https://github.com/NVIDIA-NeMo/Gym/pull/2915) | Maintainers | reviewer not assigned | 2026-09-01 06:51 UTC | 2026-09-02 06:51 UTC | 20d 12h |
| [#2923 — Merge main into gdpval-devel](https://github.com/NVIDIA-NeMo/Gym/pull/2923) | Maintainers | reviewer not assigned | 2026-09-01 11:42 UTC | 2026-09-02 11:42 UTC | 20d 7h |
| [#2978 — fix(osworld): stabilize long-horizon Molt rollouts](https://github.com/NVIDIA-NeMo/Gym/pull/2978) | Maintainers | reviewer not assigned | 2026-09-02 15:38 UTC | 2026-09-03 15:38 UTC | 19d 3h |
| [#2980 — feat(anyterminal): OpenSandbox oracle config, resource knobs, cgroup metrics, TB2.1 prepare](https://github.com/NVIDIA-NeMo/Gym/pull/2980) | Maintainers | reviewer not assigned | 2026-09-02 17:43 UTC | 2026-09-03 17:43 UTC | 19d 1h |
| [#2932 — [GDPVal] Merge main into gdpval-devel](https://github.com/NVIDIA-NeMo/Gym/pull/2932) | Maintainers | reviewer not assigned | 2026-09-03 17:12 UTC | 2026-09-04 17:12 UTC | 18d 2h |
| [#3123 — docs(skills): align repository skills with current contracts](https://github.com/NVIDIA-NeMo/Gym/pull/3123) | Maintainers | reviewer not assigned | 2026-09-05 05:26 UTC | 2026-09-07 05:26 UTC | 17d 14h |
| [#3085 — feat(nooa-agent): add native lifecycle integration and capability example](https://github.com/NVIDIA-NeMo/Gym/pull/3085) | Maintainers | reviewer not assigned | 2026-09-04 12:06 UTC | 2026-09-07 12:06 UTC | 17d 7h |
| [#3096 —  feat: add SAV tracking verifier resources server](https://github.com/NVIDIA-NeMo/Gym/pull/3096) | Maintainers | reviewer not assigned | 2026-09-04 18:27 UTC | 2026-09-07 18:27 UTC | 17d 0h |
| [#3132 — [ApexAgents] Serve GLM-5.2 with CUDA graphs, pin replicas to one rack, tolerate partial readiness](https://github.com/NVIDIA-NeMo/Gym/pull/3132) | Maintainers | reviewer not assigned | 2026-09-05 21:55 UTC | 2026-09-07 21:55 UTC | 16d 21h |
| [#3109 — feat(aviary): support post-terminal model response](https://github.com/NVIDIA-NeMo/Gym/pull/3109) | Maintainers | reviewer not assigned | 2026-09-04 22:04 UTC | 2026-09-07 22:04 UTC | 16d 21h |
| [#3209 — feat(benchmarks): remove the dataset-level agent pin](https://github.com/NVIDIA-NeMo/Gym/pull/3209) | Maintainers | reviewer not assigned | 2026-09-10 05:34 UTC | 2026-09-11 05:34 UTC | 13d 13h |
| [#3318 — Jnolan/gdpval hermes upstream](https://github.com/NVIDIA-NeMo/Gym/pull/3318) | Maintainers | reviewer not assigned | 2026-09-11 08:11 UTC | 2026-09-14 08:11 UTC | 12d 11h |
| [#3372 — feat(cli): add `gym eval intake` to submit a rundir to a benchmark-run data layer](https://github.com/NVIDIA-NeMo/Gym/pull/3372) | Maintainers | reviewer not assigned | 2026-09-14 17:42 UTC | 2026-09-15 17:42 UTC | 11d 1h |
| [#3412 — feat(checkpoint): prefix token level recovery](https://github.com/NVIDIA-NeMo/Gym/pull/3412) | Maintainers | reviewer not assigned | 2026-09-15 18:17 UTC | 2026-09-16 18:17 UTC | 10d 1h |
| [#3430 — Add critpt_custom_grader: a sandboxed, locally executed grader for CritPt-style problems](https://github.com/NVIDIA-NeMo/Gym/pull/3430) | Maintainers | reviewer not assigned | 2026-09-16 23:56 UTC | 2026-09-17 23:56 UTC | 8d 19h |
| [#3494 — feat: post-train environment](https://github.com/NVIDIA-NeMo/Gym/pull/3494) | Maintainers | reviewer not assigned | 2026-09-17 16:55 UTC | 2026-09-18 16:55 UTC | 8d 2h |
| [#3502 — feat: Allow explicit input files in eval runs](https://github.com/NVIDIA-NeMo/Gym/pull/3502) | Maintainers | reviewer not assigned | 2026-09-17 20:45 UTC | 2026-09-18 20:45 UTC | 7d 22h |
| [#3503 — feat(browsecomp): add Brave search provider](https://github.com/NVIDIA-NeMo/Gym/pull/3503) | Maintainers | reviewer not assigned | 2026-09-17 21:32 UTC | 2026-09-18 21:32 UTC | 7d 21h |
| [#3504 — feat(video): add SA-V tracks verifier](https://github.com/NVIDIA-NeMo/Gym/pull/3504) | Maintainers | reviewer not assigned | 2026-09-17 21:52 UTC | 2026-09-18 21:52 UTC | 7d 21h |
| [#3507 — feat: add SAV tracks verifier resources server](https://github.com/NVIDIA-NeMo/Gym/pull/3507) | Maintainers | reviewer not assigned | 2026-09-17 23:20 UTC | 2026-09-18 23:20 UTC | 7d 20h |
| [#3560 — feat(core): add a warm process pool for CPU-heavy verification](https://github.com/NVIDIA-NeMo/Gym/pull/3560) | Maintainers | reviewer not assigned | 2026-09-20 00:05 UTC | 2026-09-21 00:05 UTC | 7d 19h |
| [#3512 — docs(example_session_state_mgmt): document in-memory session state](https://github.com/NVIDIA-NeMo/Gym/pull/3512) | Maintainers | reviewer not assigned | 2026-09-18 01:59 UTC | 2026-09-21 01:59 UTC | 7d 17h |
| [#3520 — fix(terminus): parallel tool calls formatting](https://github.com/NVIDIA-NeMo/Gym/pull/3520) | Maintainers | reviewer not assigned | 2026-09-18 07:42 UTC | 2026-09-21 07:42 UTC | 7d 11h |
| [#3526 — feat(inference-provider): add Doubleword flex configuration](https://github.com/NVIDIA-NeMo/Gym/pull/3526) | Maintainers | reviewer not assigned | 2026-09-18 11:15 UTC | 2026-09-21 11:15 UTC | 7d 8h |
| [#3146 — Add the Blobfish enterprise-operations resources server and ERPBench-100](https://github.com/NVIDIA-NeMo/Gym/pull/3146) | Maintainers | reviewer not assigned | 2026-09-20 15:30 UTC | 2026-09-21 15:30 UTC | 7d 3h |
| [#3561 — fix(config): fail fast with a clean error on a malformed head_server block](https://github.com/NVIDIA-NeMo/Gym/pull/3561) | Maintainers | reviewer not assigned | 2026-09-20 19:36 UTC | 2026-09-21 19:36 UTC | 6d 23h |
| [#3556 — feat(sandbox): support Docker pipe process sessions](https://github.com/NVIDIA-NeMo/Gym/pull/3556) | Maintainers | reviewer not assigned | 2026-09-19 20:24 UTC | 2026-09-21 20:24 UTC | 6d 23h |
| [#3548 — feat(checkpoint): add indirect prompt injection state recovery](https://github.com/NVIDIA-NeMo/Gym/pull/3548) | Maintainers | reviewer not assigned | 2026-09-18 22:51 UTC | 2026-09-21 22:51 UTC | 6d 20h |
| [#3563 — feat(checkpoint): multi-worker support for policy model server](https://github.com/NVIDIA-NeMo/Gym/pull/3563) | Maintainers | reviewer not assigned | 2026-09-21 03:43 UTC | 2026-09-22 03:43 UTC | 6d 15h |
| [#3511 — feat(agent): add sandboxed Hermes](https://github.com/NVIDIA-NeMo/Gym/pull/3511) | Maintainers | reviewer not assigned | 2026-09-21 15:33 UTC | 2026-09-22 15:33 UTC | 6d 3h |
| [#3585 — feat(kidbench): add KIDBench child-facing safety benchmark](https://github.com/NVIDIA-NeMo/Gym/pull/3585) | Maintainers | reviewer not assigned | 2026-09-21 23:28 UTC | 2026-09-22 23:28 UTC | 5d 19h |
| [#3586 — fix(cli): exclude exact matches from did-you-mean suggestions](https://github.com/NVIDIA-NeMo/Gym/pull/3586) | Maintainers | reviewer not assigned | 2026-09-22 00:25 UTC | 2026-09-23 00:25 UTC | 5d 19h |
| [#3587 — feat(injecagent): add InjecAgent indirect prompt injection benchmark](https://github.com/NVIDIA-NeMo/Gym/pull/3587) | Maintainers | reviewer not assigned | 2026-09-22 00:44 UTC | 2026-09-23 00:44 UTC | 5d 18h |
| [#3588 — feat(facts-parametric): add official public benchmark](https://github.com/NVIDIA-NeMo/Gym/pull/3588) | Maintainers | reviewer not assigned | 2026-09-22 00:47 UTC | 2026-09-23 00:47 UTC | 5d 18h |
| [#3567 — feat(asb): add Agent Security Bench environment](https://github.com/NVIDIA-NeMo/Gym/pull/3567) | Maintainers | reviewer not assigned | 2026-09-22 02:06 UTC | 2026-09-23 02:06 UTC | 5d 17h |
| [#3590 — feat(indic_gsm8k): add Indic GSM8K benchmark](https://github.com/NVIDIA-NeMo/Gym/pull/3590) | Maintainers | reviewer not assigned | 2026-09-22 03:50 UTC | 2026-09-23 03:50 UTC | 5d 15h |
| [#3591 — fix(core): isolate runtime, sandbox and model transport contracts](https://github.com/NVIDIA-NeMo/Gym/pull/3591) | Maintainers | reviewer not assigned | 2026-09-22 04:08 UTC | 2026-09-23 04:08 UTC | 5d 15h |
| [#3595 — feat(toolalignbench): add reproducible benchmark environment](https://github.com/NVIDIA-NeMo/Gym/pull/3595) | Maintainers | reviewer not assigned | 2026-09-22 07:13 UTC | 2026-09-23 07:13 UTC | 5d 12h |
| [#3598 — feat(indic_arc_c): add Indic ARC-Challenge benchmark](https://github.com/NVIDIA-NeMo/Gym/pull/3598) | Maintainers | reviewer not assigned | 2026-09-22 08:16 UTC | 2026-09-23 08:16 UTC | 5d 11h |
| [#3600 — feat(launcher): add Slurm benchmark launcher and model profiles](https://github.com/NVIDIA-NeMo/Gym/pull/3600) | Maintainers | reviewer not assigned | 2026-09-22 08:55 UTC | 2026-09-23 08:55 UTC | 5d 10h |
| [#3602 — feat(launcher): add fast benchmark profiles and named resumable runs](https://github.com/NVIDIA-NeMo/Gym/pull/3602) | Maintainers | reviewer not assigned | 2026-09-22 09:08 UTC | 2026-09-23 09:08 UTC | 5d 10h |
| [#3603 — feat(indic gpqa_diamond): add Indic GPQA Diamond benchmark](https://github.com/NVIDIA-NeMo/Gym/pull/3603) | Maintainers | reviewer not assigned | 2026-09-22 09:09 UTC | 2026-09-23 09:09 UTC | 5d 10h |
| [#3608 — feat(in22-indic): add IN22 translation evaluation](https://github.com/NVIDIA-NeMo/Gym/pull/3608) | Maintainers | reviewer not assigned | 2026-09-22 10:59 UTC | 2026-09-23 10:59 UTC | 5d 8h |
| [#3594 — feat(even-handedness): add Anthropic Political Even-handedness benchmark](https://github.com/NVIDIA-NeMo/Gym/pull/3594) | Maintainers | reviewer not assigned | 2026-09-22 14:52 UTC | 2026-09-23 14:52 UTC | 5d 4h |
| [#3617 — feat(safe_child_llm): add Safe-Child-LLM developmental safety benchmark](https://github.com/NVIDIA-NeMo/Gym/pull/3617) | Maintainers | reviewer not assigned | 2026-09-22 15:06 UTC | 2026-09-23 15:06 UTC | 5d 4h |
| [#3620 — feat(vera_mh): add VERA-MH clinical-rubric safety benchmark](https://github.com/NVIDIA-NeMo/Gym/pull/3620) | Maintainers | reviewer not assigned | 2026-09-22 16:09 UTC | 2026-09-23 16:09 UTC | 5d 3h |
| [#3628 — feat(facts-multimodal): add image factuality benchmark](https://github.com/NVIDIA-NeMo/Gym/pull/3628) | Maintainers | reviewer not assigned | 2026-09-22 20:16 UTC | 2026-09-23 20:16 UTC | 4d 23h |
| [#3626 — feat(agent): run Pi inside native task sandboxes](https://github.com/NVIDIA-NeMo/Gym/pull/3626) | Maintainers | reviewer not assigned | 2026-09-22 20:54 UTC | 2026-09-23 20:54 UTC | 4d 22h |
| [#3634 — feat(checkpoint): resume proof refinement agent turns](https://github.com/NVIDIA-NeMo/Gym/pull/3634) | Maintainers | reviewer not assigned | 2026-09-22 22:19 UTC | 2026-09-23 22:19 UTC | 4d 21h |
| [#3642 — [ApexAgents] Relay policy traffic over a unix socket for network-isolated sandboxes](https://github.com/NVIDIA-NeMo/Gym/pull/3642) | Maintainers | reviewer not assigned | 2026-09-23 00:53 UTC | 2026-09-24 00:53 UTC | 4d 18h |
| [#3644 — feat(indic mbpp): add Indic MBPP ](https://github.com/NVIDIA-NeMo/Gym/pull/3644) | Maintainers | reviewer not assigned | 2026-09-23 01:11 UTC | 2026-09-24 01:11 UTC | 4d 18h |
| [#3645 — feat(benchmarks): add Indic MATH-500](https://github.com/NVIDIA-NeMo/Gym/pull/3645) | Maintainers | reviewer not assigned | 2026-09-23 01:56 UTC | 2026-09-24 01:56 UTC | 4d 17h |
| [#3650 — feat(exploitbench): add ExploitBench V8 capability-ladder benchmark](https://github.com/NVIDIA-NeMo/Gym/pull/3650) | Maintainers | reviewer not assigned | 2026-09-23 06:34 UTC | 2026-09-24 06:34 UTC | 4d 12h |
| [#3651 — feat(agentdyn): add AgentDyn indirect prompt-injection benchmark](https://github.com/NVIDIA-NeMo/Gym/pull/3651) | Maintainers | reviewer not assigned | 2026-09-23 06:36 UTC | 2026-09-24 06:36 UTC | 4d 12h |
| [#3655 — fix(orchestration): write job.sh owner-only](https://github.com/NVIDIA-NeMo/Gym/pull/3655) | Maintainers | reviewer not assigned | 2026-09-23 09:39 UTC | 2026-09-24 09:39 UTC | 4d 9h |
| [#3657 — feat(orchestration): express prefill/decode disaggregation](https://github.com/NVIDIA-NeMo/Gym/pull/3657) | Maintainers | reviewer not assigned | 2026-09-23 09:40 UTC | 2026-09-24 09:40 UTC | 4d 9h |
| [#3659 — [GDPVal] Coerce a rendered paths list nested inside the finish argument](https://github.com/NVIDIA-NeMo/Gym/pull/3659) | Maintainers | reviewer not assigned | 2026-09-23 10:24 UTC | 2026-09-24 10:24 UTC | 4d 9h |
| [#3661 — feat(facts-grounding-v2): add public benchmark adapter](https://github.com/NVIDIA-NeMo/Gym/pull/3661) | Maintainers | reviewer not assigned | 2026-09-23 14:58 UTC | 2026-09-24 14:58 UTC | 4d 4h |
| [#3679 — fix: stop leaking credentials in resolved configs and debug request logs](https://github.com/NVIDIA-NeMo/Gym/pull/3679) | Maintainers | reviewer not assigned | 2026-09-24 14:07 UTC | 2026-09-25 14:07 UTC | 3d 5h |
| [#3695 — feat(indicifeval): add IndicIFEval Trans benchmark](https://github.com/NVIDIA-NeMo/Gym/pull/3695) | Maintainers | reviewer not assigned | 2026-09-25 14:25 UTC | 2026-09-28 14:25 UTC | 2d 5h |
| [#3697 — fix(vllm): AUT-2414 constrain SQLAlchemy below 2.1](https://github.com/NVIDIA-NeMo/Gym/pull/3697) | Maintainers | reviewer not assigned | 2026-09-25 18:17 UTC | 2026-09-28 18:17 UTC | 2d 1h |
| [#3704 — feat(mimo-music): add ABC composition resources server](https://github.com/NVIDIA-NeMo/Gym/pull/3704) | Maintainers | reviewer not assigned | 2026-09-28 04:29 UTC | 2026-09-29 04:29 UTC | 1d 14h |
| [#3708 — feat(orchestration): let the driver install a benchmark's own package](https://github.com/NVIDIA-NeMo/Gym/pull/3708) | Maintainers | reviewer not assigned | 2026-09-28 10:56 UTC | 2026-09-29 10:56 UTC | 1d 8h |

</details>

Navigation Menu

[Tracker] Pull request handoff SLA #3402

Pull request handoff SLA tracker

Newly breached (17)

Waiting on reviewers (6)

Waiting on authors (2)

Needs review assignment (9)

Waiting on reviewers (59)

Waiting on authors (3)

Needs review assignment (100)

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

PR	Waiting on	Reason	Handoff	SLA deadline	Overdue
#3765 — fix(osworld): complete native AgentEnv evaluation and health reporting	@JeffPengCoder	review requested	2026-09-29 12:33 UTC	2026-09-30 12:33 UTC	6h
#3713 — docs: shorten benchmark onboarding guidance	@sephmard	review requested	2026-09-29 14:54 UTC	2026-09-30 14:54 UTC	4h
#3771 — feat(orchestration): add single-node Kubernetes support to `gym eval submit`	@prokotg	review requested	2026-09-29 16:10 UTC	2026-09-30 16:10 UTC	3h
#3775 — feat: add rubric-mean and fixed-baseline scoring to GenRM compare	@HeyyyyyyG, @abukharin-nv, @yfw	review requested	2026-09-29 18:39 UTC	2026-09-30 18:39 UTC	0h
#3780 — Enable multinode K8	@prokotg	review requested	2026-09-29 19:07 UTC	2026-09-30 19:07 UTC	0h
#3575 — feat(agent): add dedicated OpenCode and Pi sandboxed evaluation	@yaoyu-33	review requested	2026-09-29 19:11 UTC	2026-09-30 19:11 UTC	0h

PR	Waiting on	Reason	Handoff	SLA deadline	Overdue
#3668 — Add prebuilt Apex world sandbox support	@arti4nvj	changes requested	2026-09-29 00:33 UTC	2026-09-30 00:33 UTC	18h
#3759 — Mbagdasarova/service tier fix	@pachmu	changes requested	2026-09-29 16:27 UTC	2026-09-30 16:27 UTC	2h

PR	Waiting on	Reason	Handoff	SLA deadline	Overdue
#3738 — pjin/main-dev-20260928	Maintainers	reviewer not assigned	2026-09-28 20:54 UTC	2026-09-29 20:54 UTC	22h
#3740 — [ApexAgents] Add opt-in weighted-average rubric scoring	Maintainers	reviewer not assigned	2026-09-28 21:07 UTC	2026-09-29 21:07 UTC	22h
#3742 — [ApexAgents] Add a context window setting for Stirrup summarization	Maintainers	reviewer not assigned	2026-09-28 22:16 UTC	2026-09-29 22:16 UTC	21h
#3700 — fix(cli): fail server suites on unrecognized exit codes	Maintainers	reviewer not assigned	2026-09-28 23:08 UTC	2026-09-29 23:08 UTC	20h
#3652 — fix(sandbox): stop local subprocesses on cancellation	Maintainers	reviewer not assigned	2026-09-28 23:08 UTC	2026-09-29 23:08 UTC	20h
#3672 — fix(eval): preserve per-rollout seeds with existing metadata	Maintainers	reviewer not assigned	2026-09-28 23:08 UTC	2026-09-29 23:08 UTC	20h
#3694 — fix(capture): mask rollouts with unconfirmed terminal IDs	Maintainers	reviewer not assigned	2026-09-28 23:08 UTC	2026-09-29 23:08 UTC	20h
#3767 — feat(formal-conjectures): add the Formal Conjectures benchmark on lean_proof	Maintainers	reviewer not assigned	2026-09-29 13:57 UTC	2026-09-30 13:57 UTC	5h
#3769 — fix(health): evaluate the final top-level model call	Maintainers	reviewer not assigned	2026-09-29 14:39 UTC	2026-09-30 14:39 UTC	4h

PR	Waiting on	Reason	Handoff	SLA deadline	Overdue
#799 — fix: preserve optional fields in structured_outputs strictify_schema_json	@jkyi-nvidia	review requested	2026-03-02 20:59 UTC	2026-03-03 20:59 UTC	150d 22h
#879 — Yev/scicode env v1	@dhruvnathawani, @jubick1337	review requested	2026-03-20 18:09 UTC	2026-03-23 18:09 UTC	137d 1h
#946 — Turing/ Playwright-based CUA environment with multi-provider adapter support	@bxyu-nvidia	review requested	2026-04-29 19:09 UTC	2026-04-30 19:09 UTC	109d 0h
#1193 — docs: address repo-health audit nits in README and CONTRIBUTING	@cmunley1	review requested	2026-04-30 13:30 UTC	2026-05-01 13:30 UTC	108d 5h
#1264 — feat: artifact-root resolution for external plugins	@ananthsub, @bxyu-nvidia	review requested	2026-05-07 20:20 UTC	2026-05-08 20:20 UTC	102d 23h
#1334 — structured_outputs: add LLM-as-a-judge semantic verification	@jkyi-nvidia	review requested	2026-05-18 20:37 UTC	2026-05-19 20:37 UTC	95d 22h
#1491 — Add compute_eval benchmark and resource server	@ananthsub, @bxyu-nvidia	review requested	2026-06-02 00:07 UTC	2026-06-03 00:07 UTC	85d 19h
#1560 — docs: clarify resources server example-data contract and license validation	@cwing-nvidia, @lbliii	review requested	2026-06-10 12:04 UTC	2026-06-11 12:04 UTC	79d 7h
#1541 — Add SC_Bench benchmark	@adil-a, @ananthsub, @bxyu-nvidia, @cwing-nvidia	review requested	2026-06-13 00:57 UTC	2026-06-15 00:57 UTC	77d 18h
#1598 — Eshachar/openclaw swe	@sdevare-nv	review requested	2026-06-16 18:19 UTC	2026-06-17 18:19 UTC	75d 1h
#1653 — docs: remove model recipe column from RL framework compatibility table	@cwing-nvidia	review requested	2026-06-23 03:23 UTC	2026-06-24 03:23 UTC	70d 16h
#1752 — fix: handle vllm context length errors in nano v3 recipe	@yfw	review requested	2026-06-26 05:53 UTC	2026-06-29 05:53 UTC	67d 13h
#2026 — feat: Switchyard token-capture integration for OpenHands SWE runs (zero-fork)	@bxyu-nvidia	review requested	2026-07-14 22:36 UTC	2026-07-15 22:36 UTC	54d 20h
#1964 — feat(model-server): add OpenAI-compatible /v1/embeddings endpoint	@ffrujeri	review requested	2026-07-15 16:18 UTC	2026-07-16 16:18 UTC	54d 3h
#1727 — fix(vllm_model): handle explicit null metadata in preprocessing	@ananthsub	review requested	2026-07-15 17:11 UTC	2026-07-16 17:11 UTC	54d 2h
#2048 — feat: sandbox_agent swe resources server	@adil-a, @ananthsub, @bxyu-nvidia, @hemildesai	review requested	2026-07-15 21:13 UTC	2026-07-16 21:13 UTC	53d 22h
#2052 — hermes_agent: repin to upstream hermes and fix the wrapper for its API	@Glorf	review requested	2026-07-17 22:38 UTC	2026-07-20 22:38 UTC	51d 20h
#2155 — [GDPVal] Fix Stirrup reference paths and make head-server wait configurable	@agronskiy	review requested	2026-07-29 16:40 UTC	2026-07-30 16:40 UTC	44d 2h
#2160 — [GDPVal] Fix what reaches the rubric judge, and stop silent zeros	@agronskiy	review requested	2026-07-29 16:40 UTC	2026-07-30 16:40 UTC	44d 2h
#2162 — [GDPVal] Add model-agnostic Slurm orchestration for multi-allocation rollouts	@agronskiy	review requested	2026-07-29 16:40 UTC	2026-07-30 16:40 UTC	44d 2h
#2304 — default port range to the 5000-5999 band	@adil-a	review requested	2026-08-04 13:48 UTC	2026-08-05 13:48 UTC	40d 5h
#2311 — docs: rewrite Configure Agents index and document external agent harnesses	@cwing-nvidia, @lbliii	review requested	2026-08-04 14:30 UTC	2026-08-05 14:30 UTC	40d 4h
#2386 — feat: harden SWE against filesystem overflow	@sdevare-nv	review requested	2026-08-06 17:31 UTC	2026-08-07 17:31 UTC	38d 1h
#2142 — Add EnterpriseOps-Gym benchmark: resources server, benchmark registration, and per-turn telemetry agent	@bxyu-nvidia, @cwing-nvidia	review requested	2026-08-08 08:52 UTC	2026-08-10 08:52 UTC	37d 10h
#2481 — feat: swe_trace_converter change for the opencode backend	@bxyu-nvidia, @sdevare-nv	review requested	2026-08-11 18:44 UTC	2026-08-12 18:44 UTC	35d 0h
#2346 — feat(sandbox): add Tenki provider	@hemildesai	review requested	2026-08-12 16:45 UTC	2026-08-13 16:45 UTC	34d 2h
#2592 — Fix compute_pass_majority_metrics: score unanswered rollouts as failures in pass@k	@gwarmstrong, @jkyi-nvidia	review requested	2026-08-18 16:55 UTC	2026-08-19 16:55 UTC	30d 2h
#2703 — docs(verifier): require verify to return the scored response	@mpatel31415	review requested	2026-08-24 05:09 UTC	2026-08-25 05:09 UTC	26d 14h
#2673 — fix: preserve structured MCP tool identity for verification	@adil-a, @bxyu-nvidia	review requested	2026-08-25 00:10 UTC	2026-08-26 00:10 UTC	25d 19h
#2742 — chore(hermes_agent): use pinned upstream Hermes release	@Glorf, @ananthsub, @laszkiewiczp	review requested	2026-08-25 03:18 UTC	2026-08-26 03:18 UTC	25d 16h
#2733 — feat(openclaw_agent): consume rollout-scoped Gym MCP metadata	@cmunley1, @ffrujeri	review requested	2026-08-25 04:28 UTC	2026-08-26 04:28 UTC	25d 14h
#2771 — feat: add raw_rewards_and_lengths to group-level reward profile metrics	@bxyu-nvidia, @jkyi-nvidia	review requested	2026-08-25 21:53 UTC	2026-08-26 21:53 UTC	24d 21h
#2783 — refactor: decouple rollout identity from capture	@Glorf, @ffrujeri, @pthombre	review requested	2026-08-26 08:14 UTC	2026-08-27 08:14 UTC	24d 11h
#2758 — feat: sandbox provider image prepare hook + update prepare step in AnyTerminal	@hemildesai	review requested	2026-08-26 16:17 UTC	2026-08-27 16:17 UTC	24d 3h
#2732 — chore(data): apply the dataset decoupling migration (agent_ref out of data files)	@ananthsub	review requested	2026-08-26 23:21 UTC	2026-08-27 23:21 UTC	23d 20h
#2866 — Add support for judging and rejudging saved responses	@bxyu-nvidia	review requested	2026-08-29 00:07 UTC	2026-08-31 00:07 UTC	22d 19h
#2879 — feat(sandbox): IdeGYM sandbox provider	@hemildesai	review requested	2026-08-31 23:09 UTC	2026-09-01 23:09 UTC	20d 20h
#3050 — fix(token-id-capture): fingerprint the served response dialect	@pthombre	review requested	2026-09-03 08:30 UTC	2026-09-04 08:30 UTC	18d 10h
#3058 — fix(code-gen): replace Manager proxies with bounded IPC	@fgalko-oss	review requested	2026-09-03 19:21 UTC	2026-09-04 19:21 UTC	18d 0h
#3078 — docs: update NeMo RL tutorial container	@cwing-nvidia, @kajalj22, @lbliii, @sephmard	review requested	2026-09-04 00:19 UTC	2026-09-07 00:19 UTC	17d 19h
#3117 — feat(server_utils): opt-in CRLF heartbeat so long HTTP/1.1 model calls survive Global Accelerator's 340s idle timeout	@ananthsub, @kajalj22	review requested	2026-09-08 04:58 UTC	2026-09-09 04:58 UTC	15d 14h
#3133 — docs: standardize verification task data convention	@adil-a	review requested	2026-09-09 12:16 UTC	2026-09-10 12:16 UTC	14d 7h
#3189 — fix(responses): preserve refusal conversion semantics	@bxyu-nvidia, @cmunley1	review requested	2026-09-09 14:04 UTC	2026-09-10 14:04 UTC	14d 5h
#2954 — docs: document gym env prefetch CLI #2937	@ritaneves	review requested	2026-09-09 16:54 UTC	2026-09-10 16:54 UTC	14d 2h
#2580 — docs: fix Fern polish issues from NVBugs 6570461	@cwing-nvidia, @sephmard	review requested	2026-09-09 16:55 UTC	2026-09-10 16:55 UTC	14d 2h
#3314 — fix(responses): accept an empty include when downconverting to Chat Completions	@ananthsub	review requested	2026-09-15 03:38 UTC	2026-09-16 03:38 UTC	10d 15h
#3317 — fix(responses): report unknown usage detail counters as 0 in the synthesized SSE stream	@yaoyu-33	review requested	2026-09-15 03:38 UTC	2026-09-16 03:38 UTC	10d 15h
#3212 — feat(capture): expose complete rollout training traces	@ananthsub, @bxyu-nvidia	review requested	2026-09-15 13:07 UTC	2026-09-16 13:07 UTC	10d 6h
#3415 — Improve model retry controls and Gymnasium rollout handling	@bxyu-nvidia	review requested	2026-09-15 22:48 UTC	2026-09-16 22:48 UTC	9d 20h
#3417 — Add AA-Briefcase-Lite benchmark and artifact-aware judging	@Kh4L, @dznvidia	review requested	2026-09-16 00:38 UTC	2026-09-17 00:38 UTC	9d 18h
#3508 — [ApexAgents] Checkpoint and resume rollouts across allocations	@arti4nvj	review requested	2026-09-17 23:38 UTC	2026-09-18 23:38 UTC	7d 19h
#3559 — feat(eval): count a rollout that produced no row as zero	@ananthsub, @giuliolovisotto	review requested	2026-09-19 20:38 UTC	2026-09-21 20:38 UTC	6d 22h
#3611 — feat(combibench): add CombiBench Lean 4 combinatorics benchmark	@lilithgrigoryan	review requested	2026-09-22 12:01 UTC	2026-09-23 12:01 UTC	5d 7h
#3348 — feat(translation_with_judge): add Indic-focused LLM-judge translation…	@yaoyu-33	review requested	2026-09-22 12:03 UTC	2026-09-23 12:03 UTC	5d 7h
#3612 — feat(nmrarena): add NMRArena NMR structure elucidation benchmark	@lilithgrigoryan	review requested	2026-09-22 12:36 UTC	2026-09-23 12:36 UTC	5d 6h
#3599 — feat(metrics): collect optional vLLM and router inference metrics	@oyilmaz-nvidia	review requested	2026-09-22 12:51 UTC	2026-09-23 12:51 UTC	5d 6h
#3638 — feat(telemetry): count finished rollouts by outcome, class and reason	@yuhezhang-ai	review requested	2026-09-23 14:14 UTC	2026-09-24 14:14 UTC	4d 5h
#3632 — feat(core): expose aiohttp pool wait telemetry	@kajalj22	review requested	2026-09-23 16:45 UTC	2026-09-24 16:45 UTC	4d 2h
#3664 — fix(switchyard_model): match vllm_model for reasoning models; pin nemo-switchyard 0.3.0	@ananthsub, @bxyu-nvidia	review requested	2026-09-25 00:04 UTC	2026-09-28 00:04 UTC	2d 19h

PR	Waiting on	Reason	Handoff	SLA deadline	Overdue
#1600 — docs(fern): add SEO meta descriptions + headlines to nightly docs (#1589)	@lbliii	changes requested	2026-06-29 14:05 UTC	2026-06-30 14:05 UTC	66d 5h
#2339 — Katherine/gdpval devel staging	@katherineh123	changes requested	2026-08-09 22:03 UTC	2026-08-10 22:03 UTC	36d 21h
#2570 — feat(vllm_model): optional session-affinity header for upstream routers	@aoshen02	changes requested	2026-08-18 16:53 UTC	2026-08-19 16:53 UTC	30d 2h

PR	Waiting on	Reason	Handoff	SLA deadline	Overdue
#834 — Add Tau^2 Bench training environment	Maintainers	reviewer not assigned	2026-03-06 22:23 UTC	2026-03-09 22:23 UTC	146d 21h
#1103 — structured_outputs: support oneOf/anyOf branches and $defs/$ref schemas	Maintainers	reviewer not assigned	2026-04-21 05:08 UTC	2026-04-22 05:08 UTC	115d 14h
#1233 — structured_outputs: extend XML type coercion to handle oneOf/anyOf/allOf composition	Maintainers	reviewer not assigned	2026-05-05 21:17 UTC	2026-05-06 21:17 UTC	104d 22h
#1274 — Add audiobench_alpaca_audio benchmark + audiobench_judge resource server	Maintainers	reviewer not assigned	2026-05-08 20:49 UTC	2026-05-11 20:49 UTC	101d 22h
#1315 — Add GitHub issue template for environment integrations	Maintainers	reviewer not assigned	2026-05-13 19:42 UTC	2026-05-14 19:42 UTC	98d 23h
#1358 — feat(vllm_model): chunk long single-clip audio in chat_completions	Maintainers	reviewer not assigned	2026-05-18 21:04 UTC	2026-05-19 21:04 UTC	95d 22h
#1429 — docs: clarify SWE-bench dataset downloads	Maintainers	reviewer not assigned	2026-05-27 08:53 UTC	2026-05-28 08:53 UTC	89d 10h
#1590 — feat(equivalence_llm_judge): cap extracted-answer length sent to judge	Maintainers	reviewer not assigned	2026-06-12 22:06 UTC	2026-06-15 22:06 UTC	76d 21h
#1720 — feat(instruction_following): add loose-mode evaluation and compute_metrics	Maintainers	reviewer not assigned	2026-06-25 01:12 UTC	2026-06-26 01:12 UTC	68d 18h
#1745 — fix(config): seed no-model refs for prepare-data	Maintainers	reviewer not assigned	2026-06-26 00:31 UTC	2026-06-29 00:31 UTC	67d 18h
#1797 — fix(inference_provider): normalize provider endpoint errors	Maintainers	reviewer not assigned	2026-06-27 04:43 UTC	2026-06-29 04:43 UTC	67d 14h
#1800 — Harden SWE agent test file parsing	Maintainers	reviewer not assigned	2026-06-27 10:32 UTC	2026-06-29 10:32 UTC	67d 8h
#1847 — Rgala/browsecomp search providers newstable	Maintainers	reviewer not assigned	2026-07-01 00:35 UTC	2026-07-02 00:35 UTC	64d 18h
#1908 — Actions: sync project status to release label	Maintainers	reviewer not assigned	2026-07-02 13:16 UTC	2026-07-03 13:16 UTC	63d 6h
#1939 — Tb e2e	Maintainers	reviewer not assigned	2026-07-06 18:22 UTC	2026-07-07 18:22 UTC	61d 1h
#2080 — feat: Switchyard OpenCode integration	Maintainers	reviewer not assigned	2026-07-20 12:50 UTC	2026-07-21 12:50 UTC	51d 6h
#2109 — fix(server_utils): use unpredictable per-process secret for session signing	Maintainers	reviewer not assigned	2026-07-22 21:53 UTC	2026-07-23 21:53 UTC	48d 21h
#2027 — Simplify ModelCallRecord; Refactor call capture logic; Extend to agents	Maintainers	reviewer not assigned	2026-07-28 06:26 UTC	2026-07-29 06:26 UTC	45d 13h
#2254 — fix(hermes_agent): never present fabricated tokens as policy output	Maintainers	reviewer not assigned	2026-07-30 21:27 UTC	2026-07-31 21:27 UTC	42d 21h
#2437 — feat(agents): add aggregate metrics proxy helper	Maintainers	reviewer not assigned	2026-08-08 12:41 UTC	2026-08-10 12:41 UTC	37d 6h
#2412 — fix(pinchbench): address the model server per rollout so capture attributes calls	Maintainers	reviewer not assigned	2026-08-07 13:59 UTC	2026-08-10 13:59 UTC	37d 5h
#2513 — fix: serialize Jest in nv-internal SWE	Maintainers	reviewer not assigned	2026-08-12 13:56 UTC	2026-08-13 13:56 UTC	34d 5h
#2526 — feat(core): add shared failure-routing helpers	Maintainers	reviewer not assigned	2026-08-13 02:08 UTC	2026-08-14 02:08 UTC	33d 17h
#2527 — fix: bound model request retries	Maintainers	reviewer not assigned	2026-08-13 09:39 UTC	2026-08-14 09:39 UTC	33d 9h
#2553 — feat: add OrcaRouter as a named inference provider	Maintainers	reviewer not assigned	2026-08-14 03:26 UTC	2026-08-17 03:26 UTC	32d 16h
#2578 — [Super 3.5 evals] Apply measured full-rack vLLM configuration	Maintainers	reviewer not assigned	2026-08-17 18:10 UTC	2026-08-18 18:10 UTC	31d 1h
#2594 — feat(swebench): configurable image namespace and arch for eval containers	Maintainers	reviewer not assigned	2026-08-18 14:50 UTC	2026-08-19 14:50 UTC	30d 4h
#2602 — docs: mention Cline harness in SWE agents README	Maintainers	reviewer not assigned	2026-08-18 20:29 UTC	2026-08-19 20:29 UTC	29d 22h
#2605 — Add live web client for Kuhn poker	Maintainers	reviewer not assigned	2026-08-19 01:15 UTC	2026-08-20 01:15 UTC	29d 18h
#2700 — feat(gymv): add multimodal environment integration	Maintainers	reviewer not assigned	2026-08-24 04:01 UTC	2026-08-25 04:01 UTC	26d 15h
#2772 — fix(sandbox): implement canonical task environment resolution	Maintainers	reviewer not assigned	2026-08-25 22:45 UTC	2026-08-26 22:45 UTC	24d 20h
#2613 — feat(observability): return the environment session id and allow correlation without full capture	Maintainers	reviewer not assigned	2026-08-27 09:36 UTC	2026-08-28 09:36 UTC	23d 9h
#2838 — fix: preserve batch wrapper exit status	Maintainers	reviewer not assigned	2026-08-28 04:26 UTC	2026-08-31 04:26 UTC	22d 15h
#2841 — feat(primevul): add PrimeVul paired vulnerability-detection benchmark	Maintainers	reviewer not assigned	2026-08-28 08:45 UTC	2026-08-31 08:45 UTC	22d 10h
#2836 — perf(vllm): derive required prefix token IDs in Gym	Maintainers	reviewer not assigned	2026-08-31 17:20 UTC	2026-09-01 17:20 UTC	21d 2h
#2907 — fix(swerl_gen): gen_eval_scripts.py always exits with TypeError (no --image-dir option)	Maintainers	reviewer not assigned	2026-09-01 01:18 UTC	2026-09-02 01:18 UTC	20d 18h
#2910 — keep resolved config out of process arguments	Maintainers	reviewer not assigned	2026-09-01 03:16 UTC	2026-09-02 03:16 UTC	20d 16h
#2915 — test(ci): AUT-2197 catch untestable component directories	Maintainers	reviewer not assigned	2026-09-01 06:51 UTC	2026-09-02 06:51 UTC	20d 12h
#2923 — Merge main into gdpval-devel	Maintainers	reviewer not assigned	2026-09-01 11:42 UTC	2026-09-02 11:42 UTC	20d 7h
#2978 — fix(osworld): stabilize long-horizon Molt rollouts	Maintainers	reviewer not assigned	2026-09-02 15:38 UTC	2026-09-03 15:38 UTC	19d 3h
#2980 — feat(anyterminal): OpenSandbox oracle config, resource knobs, cgroup metrics, TB2.1 prepare	Maintainers	reviewer not assigned	2026-09-02 17:43 UTC	2026-09-03 17:43 UTC	19d 1h
#2932 — [GDPVal] Merge main into gdpval-devel	Maintainers	reviewer not assigned	2026-09-03 17:12 UTC	2026-09-04 17:12 UTC	18d 2h
#3123 — docs(skills): align repository skills with current contracts	Maintainers	reviewer not assigned	2026-09-05 05:26 UTC	2026-09-07 05:26 UTC	17d 14h
#3085 — feat(nooa-agent): add native lifecycle integration and capability example	Maintainers	reviewer not assigned	2026-09-04 12:06 UTC	2026-09-07 12:06 UTC	17d 7h
#3096 — feat: add SAV tracking verifier resources server	Maintainers	reviewer not assigned	2026-09-04 18:27 UTC	2026-09-07 18:27 UTC	17d 0h
#3132 — [ApexAgents] Serve GLM-5.2 with CUDA graphs, pin replicas to one rack, tolerate partial readiness	Maintainers	reviewer not assigned	2026-09-05 21:55 UTC	2026-09-07 21:55 UTC	16d 21h
#3109 — feat(aviary): support post-terminal model response	Maintainers	reviewer not assigned	2026-09-04 22:04 UTC	2026-09-07 22:04 UTC	16d 21h
#3209 — feat(benchmarks): remove the dataset-level agent pin	Maintainers	reviewer not assigned	2026-09-10 05:34 UTC	2026-09-11 05:34 UTC	13d 13h
#3318 — Jnolan/gdpval hermes upstream	Maintainers	reviewer not assigned	2026-09-11 08:11 UTC	2026-09-14 08:11 UTC	12d 11h
#3372 — feat(cli): add `gym eval intake` to submit a rundir to a benchmark-run data layer	Maintainers	reviewer not assigned	2026-09-14 17:42 UTC	2026-09-15 17:42 UTC	11d 1h
#3412 — feat(checkpoint): prefix token level recovery	Maintainers	reviewer not assigned	2026-09-15 18:17 UTC	2026-09-16 18:17 UTC	10d 1h
#3430 — Add critpt_custom_grader: a sandboxed, locally executed grader for CritPt-style problems	Maintainers	reviewer not assigned	2026-09-16 23:56 UTC	2026-09-17 23:56 UTC	8d 19h
#3494 — feat: post-train environment	Maintainers	reviewer not assigned	2026-09-17 16:55 UTC	2026-09-18 16:55 UTC	8d 2h
#3502 — feat: Allow explicit input files in eval runs	Maintainers	reviewer not assigned	2026-09-17 20:45 UTC	2026-09-18 20:45 UTC	7d 22h
#3503 — feat(browsecomp): add Brave search provider	Maintainers	reviewer not assigned	2026-09-17 21:32 UTC	2026-09-18 21:32 UTC	7d 21h
#3504 — feat(video): add SA-V tracks verifier	Maintainers	reviewer not assigned	2026-09-17 21:52 UTC	2026-09-18 21:52 UTC	7d 21h
#3507 — feat: add SAV tracks verifier resources server	Maintainers	reviewer not assigned	2026-09-17 23:20 UTC	2026-09-18 23:20 UTC	7d 20h
#3560 — feat(core): add a warm process pool for CPU-heavy verification	Maintainers	reviewer not assigned	2026-09-20 00:05 UTC	2026-09-21 00:05 UTC	7d 19h
#3512 — docs(example_session_state_mgmt): document in-memory session state	Maintainers	reviewer not assigned	2026-09-18 01:59 UTC	2026-09-21 01:59 UTC	7d 17h
#3520 — fix(terminus): parallel tool calls formatting	Maintainers	reviewer not assigned	2026-09-18 07:42 UTC	2026-09-21 07:42 UTC	7d 11h
#3526 — feat(inference-provider): add Doubleword flex configuration	Maintainers	reviewer not assigned	2026-09-18 11:15 UTC	2026-09-21 11:15 UTC	7d 8h
#3146 — Add the Blobfish enterprise-operations resources server and ERPBench-100	Maintainers	reviewer not assigned	2026-09-20 15:30 UTC	2026-09-21 15:30 UTC	7d 3h
#3561 — fix(config): fail fast with a clean error on a malformed head_server block	Maintainers	reviewer not assigned	2026-09-20 19:36 UTC	2026-09-21 19:36 UTC	6d 23h
#3556 — feat(sandbox): support Docker pipe process sessions	Maintainers	reviewer not assigned	2026-09-19 20:24 UTC	2026-09-21 20:24 UTC	6d 23h
#3548 — feat(checkpoint): add indirect prompt injection state recovery	Maintainers	reviewer not assigned	2026-09-18 22:51 UTC	2026-09-21 22:51 UTC	6d 20h
#3563 — feat(checkpoint): multi-worker support for policy model server	Maintainers	reviewer not assigned	2026-09-21 03:43 UTC	2026-09-22 03:43 UTC	6d 15h
#3511 — feat(agent): add sandboxed Hermes	Maintainers	reviewer not assigned	2026-09-21 15:33 UTC	2026-09-22 15:33 UTC	6d 3h
#3585 — feat(kidbench): add KIDBench child-facing safety benchmark	Maintainers	reviewer not assigned	2026-09-21 23:28 UTC	2026-09-22 23:28 UTC	5d 19h
#3586 — fix(cli): exclude exact matches from did-you-mean suggestions	Maintainers	reviewer not assigned	2026-09-22 00:25 UTC	2026-09-23 00:25 UTC	5d 19h
#3587 — feat(injecagent): add InjecAgent indirect prompt injection benchmark	Maintainers	reviewer not assigned	2026-09-22 00:44 UTC	2026-09-23 00:44 UTC	5d 18h
#3588 — feat(facts-parametric): add official public benchmark	Maintainers	reviewer not assigned	2026-09-22 00:47 UTC	2026-09-23 00:47 UTC	5d 18h
#3567 — feat(asb): add Agent Security Bench environment	Maintainers	reviewer not assigned	2026-09-22 02:06 UTC	2026-09-23 02:06 UTC	5d 17h
#3590 — feat(indic_gsm8k): add Indic GSM8K benchmark	Maintainers	reviewer not assigned	2026-09-22 03:50 UTC	2026-09-23 03:50 UTC	5d 15h
#3591 — fix(core): isolate runtime, sandbox and model transport contracts	Maintainers	reviewer not assigned	2026-09-22 04:08 UTC	2026-09-23 04:08 UTC	5d 15h
#3595 — feat(toolalignbench): add reproducible benchmark environment	Maintainers	reviewer not assigned	2026-09-22 07:13 UTC	2026-09-23 07:13 UTC	5d 12h
#3598 — feat(indic_arc_c): add Indic ARC-Challenge benchmark	Maintainers	reviewer not assigned	2026-09-22 08:16 UTC	2026-09-23 08:16 UTC	5d 11h
#3600 — feat(launcher): add Slurm benchmark launcher and model profiles	Maintainers	reviewer not assigned	2026-09-22 08:55 UTC	2026-09-23 08:55 UTC	5d 10h
#3602 — feat(launcher): add fast benchmark profiles and named resumable runs	Maintainers	reviewer not assigned	2026-09-22 09:08 UTC	2026-09-23 09:08 UTC	5d 10h
#3603 — feat(indic gpqa_diamond): add Indic GPQA Diamond benchmark	Maintainers	reviewer not assigned	2026-09-22 09:09 UTC	2026-09-23 09:09 UTC	5d 10h
#3608 — feat(in22-indic): add IN22 translation evaluation	Maintainers	reviewer not assigned	2026-09-22 10:59 UTC	2026-09-23 10:59 UTC	5d 8h
#3594 — feat(even-handedness): add Anthropic Political Even-handedness benchmark	Maintainers	reviewer not assigned	2026-09-22 14:52 UTC	2026-09-23 14:52 UTC	5d 4h
#3617 — feat(safe_child_llm): add Safe-Child-LLM developmental safety benchmark	Maintainers	reviewer not assigned	2026-09-22 15:06 UTC	2026-09-23 15:06 UTC	5d 4h
#3620 — feat(vera_mh): add VERA-MH clinical-rubric safety benchmark	Maintainers	reviewer not assigned	2026-09-22 16:09 UTC	2026-09-23 16:09 UTC	5d 3h
#3628 — feat(facts-multimodal): add image factuality benchmark	Maintainers	reviewer not assigned	2026-09-22 20:16 UTC	2026-09-23 20:16 UTC	4d 23h
#3626 — feat(agent): run Pi inside native task sandboxes	Maintainers	reviewer not assigned	2026-09-22 20:54 UTC	2026-09-23 20:54 UTC	4d 22h
#3634 — feat(checkpoint): resume proof refinement agent turns	Maintainers	reviewer not assigned	2026-09-22 22:19 UTC	2026-09-23 22:19 UTC	4d 21h
#3642 — [ApexAgents] Relay policy traffic over a unix socket for network-isolated sandboxes	Maintainers	reviewer not assigned	2026-09-23 00:53 UTC	2026-09-24 00:53 UTC	4d 18h
#3644 — feat(indic mbpp): add Indic MBPP	Maintainers	reviewer not assigned	2026-09-23 01:11 UTC	2026-09-24 01:11 UTC	4d 18h
#3645 — feat(benchmarks): add Indic MATH-500	Maintainers	reviewer not assigned	2026-09-23 01:56 UTC	2026-09-24 01:56 UTC	4d 17h
#3650 — feat(exploitbench): add ExploitBench V8 capability-ladder benchmark	Maintainers	reviewer not assigned	2026-09-23 06:34 UTC	2026-09-24 06:34 UTC	4d 12h
#3651 — feat(agentdyn): add AgentDyn indirect prompt-injection benchmark	Maintainers	reviewer not assigned	2026-09-23 06:36 UTC	2026-09-24 06:36 UTC	4d 12h
#3655 — fix(orchestration): write job.sh owner-only	Maintainers	reviewer not assigned	2026-09-23 09:39 UTC	2026-09-24 09:39 UTC	4d 9h
#3657 — feat(orchestration): express prefill/decode disaggregation	Maintainers	reviewer not assigned	2026-09-23 09:40 UTC	2026-09-24 09:40 UTC	4d 9h
#3659 — [GDPVal] Coerce a rendered paths list nested inside the finish argument	Maintainers	reviewer not assigned	2026-09-23 10:24 UTC	2026-09-24 10:24 UTC	4d 9h
#3661 — feat(facts-grounding-v2): add public benchmark adapter	Maintainers	reviewer not assigned	2026-09-23 14:58 UTC	2026-09-24 14:58 UTC	4d 4h
#3679 — fix: stop leaking credentials in resolved configs and debug request logs	Maintainers	reviewer not assigned	2026-09-24 14:07 UTC	2026-09-25 14:07 UTC	3d 5h
#3695 — feat(indicifeval): add IndicIFEval Trans benchmark	Maintainers	reviewer not assigned	2026-09-25 14:25 UTC	2026-09-28 14:25 UTC	2d 5h
#3697 — fix(vllm): AUT-2414 constrain SQLAlchemy below 2.1	Maintainers	reviewer not assigned	2026-09-25 18:17 UTC	2026-09-28 18:17 UTC	2d 1h
#3704 — feat(mimo-music): add ABC composition resources server	Maintainers	reviewer not assigned	2026-09-28 04:29 UTC	2026-09-29 04:29 UTC	1d 14h
#3708 — feat(orchestration): let the driver install a benchmark's own package	Maintainers	reviewer not assigned	2026-09-28 10:56 UTC	2026-09-29 10:56 UTC	1d 8h

[Tracker] Pull request handoff SLA #3402

Description

Pull request handoff SLA tracker

Newly breached (17)

Waiting on reviewers (6)

Waiting on authors (2)

Needs review assignment (9)

Waiting on reviewers (59)

Waiting on authors (3)

Needs review assignment (100)

Activity

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions