Expose optional response payload observations

[0xMassi]

Response payload observations are now available to applications through an optional task-scoped observer. The observer records bytes actually read, preserves partial reads on failures and cancellation, and follows spawned crawl work. Gateway metadata contains only its authority.

The measurement is decoded response payload, not wire transfer or a billing metric. It excludes request traffic, protocol overhead, and redirect bodies consumed internally by the HTTP client.

Validation: 786 core workspace tests passed, plus the interrupted-stream network test. Release builds, CLI/MCP/self-hosted REST public and unsafe-address checks, and Docker CLI/REST checks passed. Independent review approved the change.

Draft pending the hosted staging integration gate. Candidate: 228fea711c960f03aa420913eba4b5bd407afc59; integration tag: rc/v0.6.22-transfer.1. No final release or main promotion yet.

[coderabbitai]

Important

Draft PR not reviewed

Draft PRs are not automatically reviewed by default.

• Trigger a manual review

To automatically review draft PRs, update your CodeRabbit configuration:

reviews:
  auto_review:
    drafts: true

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands.}

[0xMassi]

Superseded. crates/webclaw-fetch/src/transfer.rs on main is byte-identical to this branch, and client.rs already records observations through transfer::Attempt. The work shipped with the v2 release; this branch is the earlier iteration, 24 commits behind and conflicting. Closing and deleting the branch.