Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,7 @@ The format is based on Keep a Changelog and this project follows Semantic Versio

## [Unreleased]

- **Legacy Runs API cleanup** — removed the orphaned public `/runs` list/delete routes, their route-specific service, and route-only tests now that Results deletion uses `/results-view/runs/:runId`, while retaining the underlying run/result tables for active benchmark, evaluation, retention, and cleanup flows.
- **Datasets editor checkpoint** — added a Datasets page and JSONL dataset-file API for creating, editing, saving, and deleting dataset item files under `INFERHARNESS_BENCHMARK_DATASET_ROOT`, with synced `dataset_manifest` documents, copy-down editing for repeated fields, and clamped long-prompt display.
- **Benchmark plan cleanup** — removed the transitional inline `/benchmark/plans/run` execution API and stale `INFERHARNESS_TEST_TEMPLATES_DIR` example so plan execution goes through persisted `benchmark_plan` documents.
- **Tool-call assertion metric** — benchmark tool-call templates now include `tool_call_assertion_pass`, a single-turn pass/fail metric requiring exact expected tool selection and structurally matching arguments while keeping assertion failures as quality metrics rather than execution failures.
Expand Down
21 changes: 0 additions & 21 deletions backend/src/api/routes/runs.ts

This file was deleted.

2 changes: 0 additions & 2 deletions backend/src/api/server.ts
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,6 @@ import { fileURLToPath } from 'url';
import { getDb, resolvedDbPath, runSchema } from '../models/db.js';
import { registerAuth } from './middleware/auth.js';
import { registerResultsViewRoutes } from './routes/results-view.js';
import { registerRunsRoutes } from './routes/runs.js';
import { registerInferenceServersRoutes } from './routes/inference-servers.js';
import { registerModelsRoutes } from './routes/models.js';
import { registerSystemRoutes } from './routes/system.js';
Expand Down Expand Up @@ -99,7 +98,6 @@ export function createServer() {

registerSystemRoutes(app);
registerInferenceServersRoutes(app);
registerRunsRoutes(app);
registerModelsRoutes(app);
registerResultsViewRoutes(app);
registerEvalInferenceRoutes(app);
Expand Down
67 changes: 0 additions & 67 deletions backend/src/services/run-service.ts

This file was deleted.

29 changes: 0 additions & 29 deletions backend/tests/integration/runs-history.test.ts

This file was deleted.

175 changes: 0 additions & 175 deletions backend/tests/integration/runs-single.test.ts

This file was deleted.

16 changes: 6 additions & 10 deletions frontend/tests/e2e/results-dashboard.spec.ts
Original file line number Diff line number Diff line change
Expand Up @@ -347,6 +347,12 @@ test('deletes a run from the run detail drawer after confirmation', async ({ pag
});

await page.route('**/results-view/runs/run-dashboard-1', async (route) => {
if (route.request().method() === 'DELETE') {
deleteRequests += 1;
deleted = true;
await route.fulfill({ status: 204 });
return;
}
if (deleted) {
await route.fulfill({
status: 404,
Expand Down Expand Up @@ -375,16 +381,6 @@ test('deletes a run from the run detail drawer after confirmation', async ({ pag
});
});

await page.route('**/runs/run-dashboard-1', async (route) => {
if (route.request().method() !== 'DELETE') {
await route.fallback();
return;
}
deleteRequests += 1;
deleted = true;
await route.fulfill({ status: 204 });
});

page.on('dialog', async (dialog) => {
dialogCount += 1;
if (dialogCount === 1) {
Expand Down
Loading