Skip to content

[Outcome Report] Safe output outcomes report for 2026-09-28 #63892

Description

@github-actions

Workflow Health — 2026-09-28

Executive read: Outcome quality is weak (51.72% acceptance), unresolved volume is concentrated in PR Sous Chef and Issue Monster, and PR Sous Chef is underdefined while most other workflows are still in flight.

Workflow Status Lifecycle health References
PR Sous Chef 🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜ ⚪ underdefined 🟨 #63890 · 🟨 #63889 · 🟨 #63875 · 🟨 #63874 · 🟨 #63869 · 🟨 #63868 · 🟨 #63866 · 🟨 #63864 · 🟨 #63863 · 🟨 #63862 · 🟨 #63861 · 🟨 #63859 · 🟨 #63857 · 🟨 #63856 · 🟨 #63855 · ⬜ run 36359519232 · ⬜ run 36358857627 · ⬜ run 36358282184 · ⬜ run 36356447332 · ⬜ run 36355662874 · ⬜ run 36355041503 · ⬜ run 36354544063 · ⬜ run 36353320817 · ⬜ run 36352727547 · ⬜ run 36350577416 · ⬜ run 36349765424 · ⬜ run 36348658485 · ⬜ run 36347689331 · ⬜ run 36346663279 · ⬜ run 36344769284 · ⬜ run 36343584314 · ⬜ run 36342128135 · ⬜ run 36341114329
Issue Monster 🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟩🟩🟩 🟢 resolving 🟨 #57728 · 🟨 #57981 · 🟨 #61166 · 🟨 #57981 · 🟨 #57728 · 🟨 #61166 · 🟨 #57728 · 🟨 #57981 · 🟨 #61166 · 🟨 #57728 · 🟨 #57981 · 🟨 #61166 · 🟨 #57728 · 🟨 #57981 · 🟨 #61166 · 🟨 #61166 · 🟨 #57981 · 🟨 #57728 · 🟨 #61166 · 🟨 #57981 · 🟨 #57728 · 🟨 #57728 · 🟨 #57981 · 🟨 #61166 · 🟨 #57728 · 🟨 #57981 · 🟨 #61166 · 🟨 #57981 · 🟨 #57728 · 🟨 #61166 · 🟨 #61166 · 🟨 #57728 · 🟨 #57981 · 🟨 #61166 · 🟨 #57981 · 🟨 #57728 · 🟨 #61166 · 🟩 #61165 · 🟩 #63483 · 🟩 #61165
Status check workflow fixing 🟨🟨🟨🟨🟨🟨🟥🟥⬜🟥🟥⬜🟥🟥🟨🟩⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜ ⚪ underdefined 🟨 #63241 · 🟨 #63496 · 🟨 #63241 · 🟨 #63496 · 🟨 #63241 · 🟨 #63496 · 🟥 #63496 · 🟥 #63241 · ⬜ run 36334311673 · 🟥 #63496 · 🟥 #63241 · ⬜ run 36333689443 · 🟥 #63241 · 🟥 #63496 · 🟨 #63241 · 🟩 #63496 · ⬜ run 36333017097 · ⬜ run 36329787694 · ⬜ run 36327662878 · ⬜ run 36326182284 · ⬜ run 36325522348 · ⬜ run 36323274768 · ⬜ run 36322581304 · ⬜ run 36321415233 · ⬜ run 36319850343 · ⬜ run 36318856069 · ⬜ run 36317242268 · ⬜ run 36316494939 · ⬜ run 36315729129 · ⬜ run 36314924582 · ⬜ run 36314169208 · ⬜ run 36312067436 · ⬜ run 36310962033
CODEOWNERS Assistant 🟨🟨 🟡 in flight 🟨 #63888 · 🟨 #63887
Review Rotation Assistant 🟨🟨 🟡 in flight 🟨 #63877 · 🟨 #63876
Review Summary Assistant 🟨🟨 🟡 in flight 🟨 #63873 · 🟨 #63870
Daily spec maintenance issues 🟨🟨 🟡 in flight 🟨 #63865 · 🟨 #63860
Daily Spec Coverage Review 🟨 🟡 in flight 🟨 #63872
Agent Persona Explorer 🟨 🟡 in flight 🟨 #63851
Copilot PR Draft Critic 🟩 🟢 resolving 🟩 #63854
Daily Regulatory Report Generator 🟩⬜ ⚪ underdefined 🟩 #63513 · ⬜ #63882
Regular expression helper 🟩 🟢 resolving 🟩 #63885
Issue2PR Agent 🟩 🟢 resolving 🟩 #63853
CI Insights Keeper 🟩 🟢 resolving 🟩 #63884
PR Hype Bot 🟩 🟢 resolving 🟩 #63883
CLI UX Critic 🟩 🟢 resolving 🟩 #63880
PR Changelog Assistant 🟩 🟢 resolving 🟩 #63879
PR Test Plan Assistant 🟩 🟢 resolving 🟩 #63878
Daily Project Performance Summary Generator (Using MCP Scripts) 🟩 🟢 resolving 🟩 #63871
Daily Runbook Drift Auditor 🟩 🟢 resolving 🟩 #63867
Daily Dependency Report Generator 🟩 🟢 resolving 🟩 #63847
Project Lifecycle Assistant 🟩 🟢 resolving 🟩 #63845
Terminal Transcript Wrangler 🟩 🟢 resolving 🟩 #63844
Weekly issue metrics report 🟩 🟢 resolving 🟩 #63843
Daily Secrets Analysis Agent ⬜ ⚪ underdefined ⬜ #63858
Daily Issues Report Generator ⬜ ⚪ underdefined ⬜ #63846
Copilot PR Prompt Pattern Analysis ⬜ ⚪ underdefined ⬜ #63881
Contribution Check ⬜ ⚪ underdefined ⬜ run 36349520446

Legend:

  • Status: 🟩 accepted · 🟥 rejected · 🟨 pending · ⬜ unknown
  • Lifecycle health: 🟢 resolving · 🟡 in flight · 🟠 aging · 🔴 stuck · ⚪ underdefined
  • References: one linked item per status emoji, in the same order as the Status column

🔴 Action Items

  1. Highest-waste workflows — Status check workflow fixing (~18% rejected) and Issue Monster (~0% rejected but heavy unresolved volume) are the top attention workflows by waste/volume; any workflow crossing 25% waste should trigger prompt/safe-output review.
  2. Stuck pending items — No items are pending >48h in this cycle; no workflows classify as 🔴 stuck from available cache history.
  3. Underdefined workflows — PR Sous Chef, Status check workflow fixing, Contribution Check, Daily Secrets Analysis Agent, Daily Issues Report Generator, Copilot PR Prompt Pattern Analysis, and Daily Regulatory Report Generator need clearer acceptance/rejection criteria or stronger evaluators.
  4. Low zero-touch workflows — Zero-touch rate is 0% (0/15 accepted): all accepted items require visible human engagement, indicating output quality should be improved.
  5. High ignored rate — Ignored is 5/118 (4.24%), below the 30% alert threshold.
  6. Data quality: fallback evaluations — fallback_exists_only_count is 0 (0%), so no weak fallback-signal inflation is detected.
Detailed metrics, evidence quality, workflow counts, and trends

Outcome Scorecard — 2026-09-28

Metric Value Status
Acceptance rate 51.72% 🔴 <60%
Zero-touch rate 0.00% 🔴 <25%
Waste rate 11.86% 🟡 10-25%
Median time to resolution — —
Accepted 15 / 118 —
— strong evidence 1 merged, completed, approved
— medium evidence 14 engaged, retained
— weak evidence 0 existence only
Rejected 14 —
Ignored 5 no observable follow-up
Zero-touch 0 / 15 —
Pending 52 —
Runs checked 61 —

Per-Workflow Breakdown

Workflow Accepted Rejected Ignored Pending Acceptance Zero-touch
Status check workflow fixing 1 6 0 7 14.29% 0.00%
Issue Monster 3 0 0 37 100.00% 0.00%
PR Sous Chef 0 0 0 15 — —
Daily Regulatory Report Generator 1 0 1 0 100.00% 0.00%
CODEOWNERS Assistant 0 0 0 2 — —
Review Rotation Assistant 0 0 0 2 — —
Review Summary Assistant 0 0 0 2 — —
Daily spec maintenance issues 0 0 0 2 — —
Agent Persona Explorer 0 0 0 1 — —
Contribution Check 0 0 0 0 — —
Copilot PR Prompt Pattern Analysis 0 0 1 0 — —
Daily Issues Report Generator 0 0 1 0 — —
Daily Secrets Analysis Agent 0 0 1 0 — —
Daily Spec Coverage Review 0 0 0 1 — —
CI Insights Keeper 1 0 0 0 100.00% 0.00%
CLI UX Critic 1 0 0 0 100.00% 0.00%
Copilot PR Draft Critic 1 0 0 0 100.00% 0.00%
Daily Dependency Report Generator 1 0 0 0 100.00% 0.00%
Daily Project Performance Summary Generator (Using MCP Scripts) 1 0 0 0 100.00% 0.00%
Daily Runbook Drift Auditor 1 0 0 0 100.00% 0.00%
Issue2PR Agent 1 0 0 0 100.00% 0.00%
PR Changelog Assistant 1 0 0 0 100.00% 0.00%
PR Hype Bot 1 0 0 0 100.00% 0.00%
PR Test Plan Assistant 1 0 0 0 100.00% 0.00%
Project Lifecycle Assistant 1 0 0 0 100.00% 0.00%
Regular expression helper 1 0 0 0 100.00% 0.00%
Terminal Transcript Wrangler 1 0 0 0 100.00% 0.00%
Weekly issue metrics report 1 0 0 0 100.00% 0.00%

Trend Signal

  • ⬇️ Regressing: acceptance rate moved from 100.00% to 51.72% (−48.28pp), and waste rate moved from 0.00% to 11.86% (+11.86pp).
  • ➡️ Stable: zero-touch rate remained at 0.00%.

📊 Measured by Outcome Collector · codex · gpt53codex · 17.4 AIC · ⌖ 4.96 AIC · ⊞ 15.9K

  • expires on Oct 4, 2026, 4:22 PM UTC-08:00

Activity

  1. github-actions commented on Oct 5, 2026

    @github-actions
    ContributorAuthor

    This issue was automatically closed because it expired on 2026-10-05T00:22:06.543Z.

    Closed by Workflow

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions