Skip to content

Impact Efficiency Report - 2026-06-16 #39551

Description

@github-actions

Executive Summary

In the 180-day window (2025-12-18–2026-06-16), the highest-impact work was two bug fixes for core sample-replay failures (PR #37863, PR #37565), delivering 170/205 total objective value (83%) in the bug/compiler category. A third merged outcome—PR #38185 (linter-miner)—added 35 units under improvement. AIC data is unavailable (workflow-logs.json: 0 runs recorded); Impact Efficiency cannot be computed. Four rejected documentation outcomes from Daily Documentation Healer/Updater contributed zero accepted value, while 993 of 1,000 analyzed PRs (99.3%) lacked a traceable Closes #N link.

Summary

Metric Value
PRs analyzed with linked issue merged: 3, closed: 4, open excluded: 0
PRs excluded (no linked closing issue) 993 (merged: 497, closed: 496)
Safe output outcomes analyzed 0
Outcomes mapped to objectives 7
Unmapped outcomes 0
Accepted outcome count 3
Total outcome value 205
AI Credits 0 (precomputed: 0 runs recorded)
Impact Efficiency not computable (AI Credits = 0)

Agentic Work by Objective

Bug (value: 85) — 2 accepted outcomes, total value: 170, AIC: 0, IE: n/a

Improvement (value: 35) — 1 accepted outcome, total value: 35, AIC: 0, IE: n/a

Highest AIC-consuming category: cannot determine (no AIC data).

Which Workflows Drove That Impact

Workflow Accepted outcomes Total value Value share AIC Impact Efficiency
Linter Miner (inferred from title) 1 35 17.1% — n/a
Daily Documentation Healer 0 0 0% — n/a
Daily Documentation Updater 0 0 0% — n/a

Unattributed (not ranked): 2 accepted outcomes, value 170 (82.9%) — PR #37863, PR #37565. Only PR Description Updater footer found in bodies; creating workflow unknown.

  • Most total value (named workflow): Linter Miner — PR #38185 (improvement, 35 pts)
  • Largest share of delivered value: Unattributed bucket (170/205 = 82.9%)
  • Most AIC: cannot determine

Top Outcomes by Outcome Value

Outcome Workflow Type Root Objective Obj Value Outcome Value
PR #37863 Fix push_to_pull_request_branch Unattributed PR merged #37835 bug 85 85
PR #37565 Fix sample replay checkout lookup Unattributed PR merged #37545 bug 85 85
PR #38185 [linter-miner] execcommandwithoutcontext Linter Miner PR merged #38143 improvement 35 35
PR #36767 Self-healing docs 2026-06-04 Daily Doc Healer PR closed #36275 improvement 35 0
PR #36371 Self-healing docs 2026-06-02 Daily Doc Healer PR closed #34686 improvement 35 0
PR #35906 Update docs 2026-05-30 Daily Doc Updater PR closed #35506 improvement 35 0
PR #35330 Self-healing docs 2026-05-28 Daily Doc Healer PR closed #34686 improvement 35 0

All 7 in-scope outcomes listed.

Unmapped Outcomes

None. All 7 analyzed outcomes had root issue labels matching the objective mapping.

Interpretation

Accepted outcome count vs Impact Efficiency: 3 of 7 in-scope outcomes were accepted (43%). Bug fixes drove 83% of value (170/205). Impact Efficiency cannot be computed (AIC = 0 from deterministic source).

Key findings:

  • Bug category delivered highest per-outcome value (85 pts each): Two compiler/sample-replay fixes dominate the window.
  • 82.9% of delivered value is unattributed: The most impactful outcomes have no confirmed creating workflow.
  • Documentation workflows delivered 0 accepted value: 4 PRs created, all rejected. These consume AIC (unquantified) with no measurable return.
  • Low linked-issue rate (0.7%): The primary data-quality gap. 993 PRs excluded for lack of Closes #N.

Data Quality

PR root tracing: 993/1,000 PRs (99.3%) excluded for lacking Closes #N. Highest-priority fix.

Safe-output coverage: 0 safe-output outcomes recorded (safe-output-issue-summary.json: all zeros).

Workflow attribution: 2/3 accepted outcomes are unattributed (66.7%; 170 value pts). PR #38185 uses title-inferred attribution only. workflow-logs.json had 0 runs — attribution relies entirely on PR body metadata.

AI Credits: Deterministic precomputed source (workflow-logs.json: 0 runs). Total AIC = 0. Impact Efficiency undefined. No live fallback invoked. AIC values in PR bodies (e.g., "389.9 AIC" from PR Description Updater) belong to secondary workflows and were excluded.

Human Work

Because workflow-logs.json has 0 runs, all 500 merged PRs technically qualify (no matching run). Count is inflated by empty log data — ~131 workflow-attribution comments exist in merged PR bodies, indicating many are workflow-generated.

Metric Count
Total merged PRs with no matching run 500 (all)
With linked closing issue 3
Without linked closing issue 497
Mapped (of linked) 3
Unmapped (of linked) 0

By objective (linked-issue merged PRs):

Bug (value 85): PR #37863 (→ #37835), PR #37565 (→ #37545) — total value: 170

Improvement (value 35): PR #38185 (→ #38143) — likely workflow-generated ([linter-miner] prefix); appears here due to empty logs — total value: 35

Generated by 📊 Impact Efficiency Report · 852.9 AIC · ⌖ 14.5 AIC · ⊞ 22.5K · ◷

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions