Skip to content

test: Smoke-test a run per repeat (do not merge) - #388

Closed
jaydgoss wants to merge 1 commit into
mainfrom
jaygoss/smoke-test-run-per-repeat
Closed

jaydgoss wants to merge 1 commit into
mainfrom
jaygoss/smoke-test-run-per-repeat

Conversation

@jaydgoss

Copy link
Copy Markdown
Member

Empty commit to run ai-evals:llms_txt:sonnet-5.5:x2 after getsentry/sentry-for-ai-evals#137 and #387, so each repeat uploads into its own run. Close once the run is checked.

@jaydgoss jaydgoss added the ai-evals:llms_txt:sonnet-5.5:x2 Run the llms_txt evals on Sonnet 5.5, twice per side label Oct 30, 2026
@sentry-evals

sentry-evals Bot commented Oct 30, 2026 •

Copy link
Copy Markdown

Sentry Evals

sentry-for-ai-evals:llms_txt:sonnet-5.5:x2 (Comparison)

Run Status Passed Failed Errored Cost Tokens Duration
Head Passed 1 0 0 $0.35 1.3M 145.80s
Base Passed 1 0 0 $0.27 765.5k 94.71s
Diff 0 0 0 🔴 +$0.07 (+27.3%) 🔴 +579.2k (+75.6%) 🔴 +51.09s (+53.9%)

@jaydgoss jaydgoss closed this Oct 30, 2026
@jaydgoss
jaydgoss deleted the jaygoss/smoke-test-run-per-repeat branch October 30, 2026 18:14
@linear-code

linear-code Bot commented Oct 30, 2026

Copy link
Copy Markdown

VDY-327

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ai-evals:llms_txt:sonnet-5.5:x2 Run the llms_txt evals on Sonnet 5.5, twice per side

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant