Skip to content

Preflight Test Results Summary#793

Merged
matthewborden merged 30 commits intomainfrom
preflight-show-summary-api
Apr 22, 2026
Merged

Preflight Test Results Summary#793
matthewborden merged 30 commits intomainfrom
preflight-show-summary-api

Conversation

@matthewborden
Copy link
Copy Markdown
Contributor

This branch adds a server-aggregated test summary to bk preflight so the final output is more useful once a build completes.

The summary shows per-run results for the build, where each run maps to a test suite, and includes aggregated passed / failed / skipped counts. Failed tests are filtered to group-only-failed, so the summary excludes tests where at least one execution wasn't failed.

A new --await-test-results[=] flag lets bk preflight wait for Test Engine results to be processed before fetching the final summary. When enabled without a value, it waits for the default duration
before loading the aggregated results.

In interactive output, the TUI shows the top 5 failed test results alongside the per-run summary. In JSON output, the summary includes up to the top 100 failed test results.

This change depends on the server-side preflight summary implementation in buildkite/buildkite#29097 (https://github.com/buildkite/buildkite/pull/29097).

@matthewborden matthewborden marked this pull request as ready for review April 21, 2026 06:03
@matthewborden matthewborden requested review from a team as code owners April 21, 2026 06:03
@matthewborden matthewborden force-pushed the preflight-show-summary-api branch from fde95fe to bd7cf33 Compare April 21, 2026 06:57
mcncl and others added 26 commits April 21, 2026 17:07
Changed the way that the CLI implements rate limits and the back off. We've removed the dependency on `roko`, which shouldn't be required with the availability of the `RateLimit-` headers that we can get from client calls.
Builds can have multiple runs for the same suite.
@matthewborden matthewborden force-pushed the preflight-show-summary-api branch from bd7cf33 to 4b35824 Compare April 21, 2026 07:10
Copy link
Copy Markdown
Member

@wolfeidau wolfeidau left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

couple of low priority things.

Comment thread cmd/preflight/preflight.go
Comment thread go.mod Outdated
@matthewborden matthewborden force-pushed the preflight-show-summary-api branch from 03e9e77 to a8845ce Compare April 22, 2026 01:46
@matthewborden matthewborden merged commit f77b4d0 into main Apr 22, 2026
4 checks passed
@matthewborden matthewborden deleted the preflight-show-summary-api branch April 22, 2026 03:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants