Skip to content

Add a pure RegressionReport service - #307

Open
aliceinwire wants to merge 1 commit into
kernelci:mainfrom
aliceinwire:improvements
Open

Add a pure RegressionReport service#307
aliceinwire wants to merge 1 commit into
kernelci:mainfrom
aliceinwire:improvements

Conversation

@aliceinwire

Copy link
Copy Markdown
Member
  • Classifies regressions, fixes, unstable results, persistent failures, new results, and missing results.
  • Preserves duplicate executions using occurrence indexes rather than collapsing them into dictionary entries.
  • Uses origin, platform, architecture, compiler, configuration, path, and result type as the comparison identity.
  • Incorporates Dashboard tree-report classifications for history-aware regression, fixed, and unstable detection.

Comment thread kcidev/api.py Outdated
Comment thread kcidev/api.py Outdated
Comment thread kcidev/libs/regression.py Outdated
Comment thread kcidev/libs/regression.py Outdated
Comment thread kcidev/libs/regression.py
Comment thread kcidev/libs/regression.py
Comment thread kcidev/subcommands/results/__init__.py Outdated
Comment thread kcidev/subcommands/results/__init__.py
Comment thread kcidev/subcommands/results/__init__.py
Comment thread kcidev/api.py
report = RegressionReport.compare(
base, head, base_results, head_results, history
)
if include_issues:

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This issues one request per regression and per persistent_fail; on a big commit that's thousands of sequential calls. Worth capping it or making include_issues opt-in.

Comment thread tests/test_regression.py
@@ -0,0 +1,88 @@
import json

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could we add coverage for the history branches, the gate command (exit codes and --fail-on parsing), and duplicate count mismatches (base 2 / head 1)? Those paths hold most of the issues above and are currently untested.

@aliceinwire
aliceinwire force-pushed the improvements branch 10 times, most recently from e3604c2 to 5021f47 Compare September 2, 2026 11:30
- Classifies regressions, fixes, unstable results, persistent failures, new results, and missing results.
- Preserves duplicate executions using occurrence indexes rather than collapsing them into dictionary entries.
- Uses origin, platform, architecture, compiler, configuration, path, and result type as the comparison identity.
- Incorporates Dashboard tree-report classifications for history-aware regression, fixed, and unstable detection.

Signed-off-by: Arisu Tachibana <arisu.tachibana@miraclelinux.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants