Skip to content

Robustness in the face of LLM goofs#10

Merged
jtoman merged 1 commit intomasterfrom
jtoman/robustness
Feb 23, 2026
Merged

Robustness in the face of LLM goofs#10
jtoman merged 1 commit intomasterfrom
jtoman/robustness

Conversation

@jtoman
Copy link
Copy Markdown
Contributor

@jtoman jtoman commented Feb 20, 2026

  1. When the LLM fails to call a tool, graphcore will currently loop pointlessly between tool and tool_result nodes. This PR adds new routing for a node which send a reminder about tool calls instead.
  2. LLMs failing to follow tool calling schemas is distressingly common: when a pydantic validation error occurs, pass this back to the llm instead of crashing

1. When the LLM fails to call a tool, graphcore will currently loop
   pointlessly between tool and tool_result nodes. This PR adds new routing
   for a node which send a reminder about tool calls instead.
2. LLMs failing to follow tool calling schemas is distressingly common:
   when a pydantic validation error occurs, pass this back to the llm
   instead of crashing
@jtoman jtoman requested a review from shellygr February 20, 2026 22:48
@jtoman jtoman merged commit 7f698e7 into master Feb 23, 2026
1 check passed
@jtoman jtoman deleted the jtoman/robustness branch March 20, 2026 20:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants