test(protocol): record the fixtures from live sessions

The fixtures were written from the backend's protocol structs because no
account was available. Running the recorder against a real session replaced 10
of the 18, and the differences are the point of having recorded them.

Four assumptions were wrong. `session:input_state` on an open composer carries
no detail; `session:llm_thinking` is often a bare placeholder rather than a
tool_call; a `session:history` page returns `messages: null` and omits the
cursor once exhausted; `session:state` during a conversation holds "chat". The
tests asserted a scenario where they should have asserted a shape — a recording
catches whichever instance the session produced, so conditions an ordinary
session never reaches are now constructed by the test that needs them.

The recorder's redaction had two faults, both found by reading what it wrote.
Its phone pattern matched bare digit runs, so it rewrote message ids into a
fake phone number; it now requires a leading "+" or separators, and identifier
fields are exempt outright. And it scrubbed only phones and emails, while a
form carries the account details it is asking for — a name, an address, an
account number, a PIN, all pulled from the account's knowledge base, with the
server's placeholders built from the same values. Both sides are now replaced
wholesale, along with the account and session ids the recording ran under.

The live prompt was a bill negotiation, which the agent spends six minutes
thinking about. Asking it to call a friend gets the same coverage in forty
seconds.

Two observations from live traffic. `session:text` never arrived during a turn
in any run: the composer reopens on streaming increments alone and the complete
message is the durable record, so the README now says to assemble from parts.
And `FormField` carries `description` and `source` on the wire, which the model
was dropping.

Verified: 94 offline tests and 8 live tests pass, ruff clean, build clean.
Eight fixtures remain derived — no ordinary session reaches a restriction, a
credit-blocked task, or a rich content document.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

Author: a7vinx

README.md

@@ -58,6 +58,11 @@ payloads, and semantics change compatibly or with notice.
 
 Payloads may gain fields at any time — tolerate fields you do not recognise.
 
+A turn commonly delivers `session:text_part` alone: the composer reopens once
+the agent has finished speaking, and the complete `session:text` is the durable
+record, read back from history. Assemble the parts by `message_id` rather than
+waiting for the complete message to arrive live.
+
 ## Everything else passes through
 
 The server emits many more events. The SDK delivers every one of them unchanged

src/pine_assistant/models/form.py

@@ -13,7 +13,9 @@ class FormField(BaseModel):
     name: str
     type: str = "text"
     label: str | None = None
+    description: str | None = None
     placeholder: str | None = None
+    source: str | None = None
     is_required: bool | None = None
     pii_level: str | None = None
     prefilled: str | None = None

tests/integration/record_fixtures.py

@@ -26,29 +26,78 @@
 from typing import Any
 
 from pine_assistant import AsyncPineAI, S2CEvent, is_supported_event
+from tests.protocol.fake import SESSION_ID as PLACEHOLDER_SESSION_ID
 
 FIXTURES = pathlib.Path(__file__).resolve().parents[1] / "protocol" / "fixtures"
-DEFAULT_PROMPT = "Help me negotiate my Comcast internet bill down to $50/month."
+DEFAULT_PROMPT = "Call my friend and ask what time Saturday's dinner starts."
 
 # Values that identify a person or an account never reach a checked-in fixture.
+# The phone pattern requires a leading "+" or separators: Pine's identifiers are
+# long digit runs, and a looser pattern rewrites them into a fake phone number.
 REDACTIONS = (
-    (re.compile(r"\+?\d[\d\-\s().]{7,}\d"), "+15555550100"),
+    (re.compile(r"\+\d[\d\-\s().]{7,}\d"), "+15555550100"),
+    (re.compile(r"\b\d{3}[-.\s]\d{3}[-.\s]\d{4}\b"), "+15555550100"),
     (re.compile(r"[\w.+-]+@[\w-]+\.[\w.]+"), "someone@example.com"),
 )
 
+# Fields whose value is the user's own data. A form carries the account details
+# it is asking for — names, addresses, account numbers, PINs — and the server
+# builds its placeholders from them, so both sides are replaced wholesale rather
+# than pattern-matched. A form's submitted `content` goes too — it is a mapping
+# of answers, unlike the `content` string on a text or state event.
+# The key stays, the shape stays, the value does not.
+USER_DATA_KEYS = frozenset({"prefilled", "placeholder"})
+USER_DATA_PLACEHOLDER = "[redacted]"
+
+# The account and session a recording ran under are not part of the shape being
+# recorded, and a fixture carrying a real session id cannot be replayed into a
+# flow test — the client would filter it out as belonging elsewhere.
+PLACEHOLDER_USER_ID = "100000000000000001"
+
+# Identifier fields are never redacted — they are opaque numbers, and rewriting
+# one destroys the shape the fixture exists to record.
+OPAQUE_KEYS = frozenset({
+    "id", "event_id", "message_id", "session_id", "request_id", "operation_id",
+    "quoted_message_id", "thinking_id", "turn_id", "revision", "next_message_id",
+    "max_message_revision", "since_revision", "device_id", "user_id",
+})
+
 
 def redact(value: Any) -> Any:
     if isinstance(value, str):
         for pattern, replacement in REDACTIONS:
             value = pattern.sub(replacement, value)
         return value
     if isinstance(value, dict):
-        return {k: redact(v) for k, v in value.items()}
+        out = {}
+        for k, v in value.items():
+            if k in OPAQUE_KEYS:
+                out[k] = v
+            elif k in USER_DATA_KEYS and isinstance(v, str) and v:
+                out[k] = USER_DATA_PLACEHOLDER
+            elif k == "content" and isinstance(v, dict) and v:
+                out[k] = {key: USER_DATA_PLACEHOLDER for key in v}
+            else:
+                out[k] = redact(v)
+        return out
     if isinstance(value, list):
         return [redact(v) for v in value]
     return value
 
 
+def anonymize(envelope: dict[str, Any]) -> dict[str, Any]:
+    """Replace the identities the recording ran under. Redaction cannot reach
+    them: an account id is an opaque number, exempt from pattern matching so it
+    does not get rewritten into a fake phone number."""
+    source = envelope.get("metadata", {}).get("source")
+    if isinstance(source, dict) and source.get("user_id"):
+        source["user_id"] = PLACEHOLDER_USER_ID
+    payload = envelope.get("payload")
+    if isinstance(payload, dict) and payload.get("session_id"):
+        payload["session_id"] = PLACEHOLDER_SESSION_ID
+    return envelope
+
+
 async def record(prompt: str, raw_dir: pathlib.Path | None) -> dict[str, dict[str, Any]]:
     token = os.environ.get("PINE_ACCESS_TOKEN", "")
     user_id = os.environ.get("PINE_USER_ID", "")
@@ -104,7 +153,7 @@ def write_fixtures(seen: dict[str, dict[str, Any]]) -> tuple[list[str], list[str
             continue
         name = event_type.replace("session:", "")
         FIXTURES.joinpath(f"{name}.json").write_text(
-            json.dumps(redact(envelope), indent=2) + "\n"
+            json.dumps(anonymize(redact(envelope)), indent=2) + "\n"
         )
         provenance[event_type] = {
             "source": "recorded", "derived_from": None, "recorded_at": now,

tests/integration/test_live.py

@@ -21,7 +21,7 @@
 
 pytestmark = pytest.mark.skipif(SKIP, reason="PINE_INTEGRATION not set")
 
-PROMPT = "Help me negotiate my Comcast internet bill down to $50/month."
+PROMPT = "Call my friend and ask what time Saturday's dinner starts."
 
 
 def make_client() -> AsyncPineAI:
@@ -78,13 +78,19 @@ async def test_create_list_get_delete(self):
 
 class TestSupportedSurface:
     async def test_a_turn_produces_a_substantive_response(self, session):
-        """Text, a rich document, or a form — all inside the scope."""
+        """Streamed text, a complete message, a rich document, or a form.
+
+        A turn often ends on streaming increments alone: the composer reopens
+        once the agent has finished speaking, and the complete `session:text`
+        is the durable record, read back from history rather than awaited here.
+        """
         client, sid = session
         events = [e async for e in client.chat(sid, PROMPT)]
 
         types = {e.type for e in events}
         assert types & {
             S2CEvent.SESSION_TEXT.value,
+            S2CEvent.SESSION_TEXT_PART.value,
             S2CEvent.SESSION_RICH_CONTENT.value,
             S2CEvent.SESSION_FORM_TO_USER.value,
         }, f"no substantive response; saw {sorted(types)}"

tests/protocol/fixtures/form_to_user.json

@@ -1,32 +1,151 @@
 {
   "metadata": {
-    "event_id": "00000000-0000-4000-8000-956047064724",
-    "request_id": "00000000-0000-4000-8000-000000000001",
-    "timestamp": "2026-08-08T00:00:00Z",
+    "event_id": "ad1590eb-8050-4fbc-872b-4c6f232a2b65",
+    "group_id": "53144355-7b24-43e2-9bcb-6048993ffcdc",
+    "is_required_action": true,
+    "is_volatile": false,
+    "request_id": "7f8f3223-0659-4e03-a4eb-d85743b67728",
     "source": {
-      "role": "agent"
+      "role": "agent",
+      "user_id": "100000000000000001"
     },
-    "is_volatile": false
+    "timestamp": "2026-08-08T13:39:54Z"
   },
-  "type": "session:form_to_user",
   "payload": {
-    "session_id": "1900000000000000001",
-    "message_id": "1900000000000000101",
-    "type": "session:form_to_user",
     "data": {
-      "message_to_user": "I need your account details.",
       "form": {
         "fields": [
           {
-            "name": "account_number",
-            "type": "text",
-            "label": "Account number",
+            "description": "Xfinity 16-digit account number required to identify your account during negotiation.",
+            "is_required": true,
+            "name": "Account Number",
+            "pii_level": "L2",
+            "placeholder": "[redacted]",
+            "prefilled": "[redacted]",
+            "source": "knowledge_base",
+            "type": "text"
+          },
+          {
+            "description": "4-digit account security PIN for Xfinity customer service authentication.",
             "is_required": true,
-            "pii_level": "high"
+            "name": "Account PIN",
+            "pii_level": "L3",
+            "placeholder": "[redacted]",
+            "prefilled": "[redacted]",
+            "source": "knowledge_base",
+            "type": "text"
+          },
+          {
+            "description": "Service location address associated with your Xfinity internet subscription.",
+            "is_required": true,
+            "name": "Service Address",
+            "pii_level": "L3",
+            "placeholder": "[redacted]",
+            "prefilled": "[redacted]",
+            "source": "knowledge_base",
+            "type": "text"
+          },
+          {
+            "description": "Primary phone number registered on your Xfinity account for identity verification.",
+            "is_required": true,
+            "name": "Phone Number on File",
+            "pii_level": "L2",
+            "placeholder": "[redacted]",
+            "prefilled": "[redacted]",
+            "source": "knowledge_base",
+            "type": "text"
+          },
+          {
+            "description": "Last 4 digits of SSN used as fallback account verification by Xfinity reps.",
+            "name": "Last Four Digits of SSN",
+            "pii_level": "L2",
+            "placeholder": "[redacted]",
+            "prefilled": "[redacted]",
+            "source": "knowledge_base",
+            "type": "text"
+          },
+          {
+            "description": "Your current Xfinity internet speed tier. Knowing this helps determine upgrade/retention promo paths.",
+            "is_required": true,
+            "name": "Current Internet Plan",
+            "options": [
+              "Gigabit Extra (1200 Mbps)",
+              "Superfast (800 Mbps / Blast!)",
+              "Fast (500 Mbps) / Connect More (300 Mbps)",
+              "Gigabit (1000 Mbps)",
+              "Other / Not Sure"
+            ],
+            "pii_level": "L1",
+            "placeholder": "[redacted]",
+            "prefilled": "[redacted]",
+            "source": "agent",
+            "type": "radio"
+          },
+          {
+            "description": "Xfinity provides monthly discounts ($10/mo for bank account, $5/mo for credit card) when enrolled in Autopay.",
+            "is_required": true,
+            "name": "Autopay Method Preference",
+            "options": [
+              "I (Charles) am willing to switch autopay to Bank Account for maximum discount ($10/mo savings)",
+              "I (Charles) prefer keeping Credit/Debit Card Autopay ($5/mo savings)",
+              "I (Charles) do not want to enroll in Autopay"
+            ],
+            "pii_level": "L1",
+            "placeholder": "[redacted]",
+            "source": "knowledge_base",
+            "type": "radio"
+          },
+          {
+            "description": "Xfinity gateway equipment rental is typically $15/mo. We can negotiate to waive it or discuss equipment options.",
+            "is_required": true,
+            "name": "Equipment Preference",
+            "options": [
+              "You (Pine) should negotiate to include or waive the Xfinity Gateway rental fee",
+              "I (Charles) will purchase my own modem/router to eliminate the $15/mo rental fee",
+              "I (Charles) prefer to keep paying for the Xfinity Gateway rental as-is"
+            ],
+            "pii_level": "L1",
+            "placeholder": "[redacted]",
+            "source": "agent",
+            "type": "radio"
+          },
+          {
+            "description": "Promotional pricing often requires a 1-year or 2-year price lock contract.",
+            "is_required": true,
+            "name": "Term Commitment Preference",
+            "options": [
+              "I (Charles) am willing to accept a 1-year or 2-year price guarantee contract to reach $50/mo",
+              "I (Charles) prefer a no-contract plan only"
+            ],
+            "pii_level": "L1",
+            "placeholder": "[redacted]",
+            "source": "agent",
+            "type": "radio"
+          },
+          {
+            "description": "If the exact $50/month rate on your current tier is unavailable, select acceptable fallback options.",
+            "is_required": true,
+            "name": "Negotiation Flexibility",
+            "options": [
+              "Plans with a slightly higher price (e.g., $60 - $75/month)",
+              "Plans with lower internet speeds (e.g., 300 Mbps or 500 Mbps)",
+              "Plans with a 1-year or 2-year contract or price guarantee",
+              "Switching autopay method to bank account for maximum discount",
+              "None: only my preferred plan at $50/month is acceptable"
+            ],
+            "pii_level": "L1",
+            "placeholder": "[redacted]",
+            "source": "agent",
+            "type": "multiselect"
           }
-        ],
-        "is_submitted": false
-      }
-    }
-  }
+        ]
+      },
+      "message_to_user": "I'm on it! I've put together a game plan to negotiate your Comcast bill down to $50/month and checked out what options and competitor rates we can use as leverage. I just need a couple of quick details from you to get started\u2014please check the form I sent over!"
+    },
+    "message_id": "816303810342297600",
+    "revision": "3008941",
+    "session_id": "1900000000000000001",
+    "type": "session:form_to_user"
+  },
+  "type": "session:form_to_user"
 }

tests/protocol/fixtures/history.json

@@ -1,22 +1,21 @@
 {
   "metadata": {
-    "event_id": "00000000-0000-4000-8000-096445077343",
-    "request_id": "00000000-0000-4000-8000-000000000001",
-    "timestamp": "2026-08-08T00:00:00Z",
+    "event_id": "698064fe-5890-4f33-a5df-8f6c997624bc",
+    "request_id": "05c25164-29ac-4596-80e9-76196533a3e6",
+    "timestamp": "2026-08-08T13:40:31Z",
     "source": {
-      "role": "system"
+      "role": "system",
+      "user_id": "100000000000000001"
     },
     "is_volatile": false
   },
   "type": "session:history",
   "payload": {
     "session_id": "1900000000000000001",
-    "message_id": "1900000000000000101",
     "type": "session:history",
     "data": {
-      "messages": [],
-      "next_message_id": "1900000000000000090",
-      "order": "desc"
+      "messages": null,
+      "order": "DESC"
     }
   }
 }

tests/protocol/fixtures/input_state.json

@@ -1,8 +1,7 @@
 {
   "metadata": {
-    "event_id": "00000000-0000-4000-8000-409211220820",
-    "request_id": "00000000-0000-4000-8000-000000000001",
-    "timestamp": "2026-08-08T00:00:00Z",
+    "event_id": "4850bdc9-d79b-40f5-9580-2dadd7ea7b51",
+    "timestamp": "2026-08-08T13:40:31Z",
     "source": {
       "role": "system"
     },
@@ -11,12 +10,11 @@
   "type": "session:input_state",
   "payload": {
     "session_id": "1900000000000000001",
-    "message_id": "1900000000000000101",
+    "message_id": "816303965535735808",
     "type": "session:input_state",
     "data": {
-      "content": "input_disabled",
-      "detail": "Please confirm the order to start executing the task.",
-      "code": "task_ready"
+      "content": "waiting_input",
+      "code": "default"
     }
   }
 }