Repository navigation
Swarm tranches: agentic depth, measured perf, reliability, UX/AX - #2
Merged
Merged
Conversation
Performance (all live-measured on maple-2bit-mlx):
- Decode ~30.6 -> ~75-90 tok/s: shared per-step (pos,eps) array removes
24 GPU syncs/token, fused MoE kernels (maple_moe_upgate/down) replace
gather_qmm dispatch pair on decode, GenerationBatch B==1 fast path.
- Opt-in --kv-bits quantizes the 6 full-attn KV caches past a start
token; practical context ceiling 24k -> 61k (sliding layers stay exact).
- Persistent multi-entry prompt cache (manifest + per-entry safetensors,
atomic commit) + warm prefill on server-ready/thread-switch.
- Checkpoint maple.py synced to repo impl — served code was stale.
Agent harness:
- Batch {actions:[...]} envelopes, plan.revise, bounded shell.exec,
memory.note, experiment.suggest, world.place, agent.self/world.state
introspection, lane fallback (receipted fallbackFrom), input-repair
retry, decide margin+confidence gates, channel rejoin for split
content/reasoning envelopes, failure-hint observations.
- Dream: agentic action-trace SFT rows, dream.dataset.preview, idle-dream
proposals, dream:start budget fix.
- Threads window: search, checkpoints, fork, lifecycle — all via host
commands.
Reliability:
- durable_io: atomic writes, quarantine + integrity.recovered on
corruption; context_broker wedged-TCC-dir boot freeze fixed via
detached probe child; queue drain/leapfrog/restore-payload fixes;
health monitor + bounded auto-resume; pending intents persist.
UI: window extraction, ctxSlices/eventBuffer, notification center,
status chips, dock badges, window cycling, honest busy/disabled states,
Escape/focus hygiene, operate-mode hardening.
Eval: tool-use benchmark 11->27 tasks + calibration artifacts;
e2e_autonomy_surface + e2e_soak against real main.cjs.
Verified: 521/521 host - 288/291 UI - 63/63 test_server.py - build clean.
Generated with [Devin](https://devin.ai)
Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Six swarm tranches of work on Hemlock — all gates green (521/521 host · 288/291 UI · 63/63 test_server.py · build clean).
Performance — decode ~30.6 → ~75–90 tok/s (live-measured): shared per-step position array kills 24 GPU syncs/token, fused MoE Metal kernels replace the
gather_qmmdispatch pair, B==1 sampler fast path. Opt-in--kv-bitslifts the practical context ceiling 24k → 61k. Persistent multi-entry prompt cache + warm prefill = cache-hot first steps.Agent harness — batch action envelopes,
plan.revise, boundedshell.exec,memory.note,experiment.suggest,world.place,agent.self/world.state, lane fallback with honestfallbackFromreceipts, input-repair retry, decide confidence+margin gates, channel rejoin. Dream trains on durable agentic action traces with a dataset preview; idle-dream proposes (never starts) cycles.Reliability —
durable_ioatomic writes + quarantine recovery, wedged-TCC-dir boot freeze fixed via detached probe child, queue drain/leapfrog/restore fixes, health monitor + bounded auto-resume, pending intents persist across restarts.UX/AX — Threads window (search/checkpoints/fork), notification center, status chips, dock badges, window cycling + focus handoff, operate-mode hardening.
Test plan
npm run test:agent— 521/521npm run test:ui— 288/291 (3 pre-existing skips)pytest tests/test_server.py— 63/63npm run build— cleanGenerated with Devin