Repository navigation
Deep Report #425
deep-report.lock.yml
on: schedule
Annotations
5 errors, 5 warnings, and 3 notices
|
agent
Agent reported that it could not complete the task\n[51] untimed execution/agent agent.execution categories=[\"http_400_response_error\"] errorCodes=[400] exitCode=1\n```\nUses the `pi` engine — same engine as \"AI Moderator,\" which shows a similar failure signature and is worth checking for the same root cause. Suggests investigating a bad/deprecated model id or malformed request in the `pi` engine call. Also: once fixed, consider downgrading its model (narrow read-only \"issue_response\" task) to `gpt-4.1-mini`/`claude-haiku-4-5`.\n\n**Other note:** `action_required` (24.5% of runs) is mostly GitHub's approval gate for Copilot-authored PR branches, not real failures — recommend excluding from failure-rate dashboards.\n\n**Tracked elsewhere:** Not mentioned as already filed.\n\n## #65832 — Prompt Clustering Analysis (2026-10-05)\n\n**Summary:** Clustered 544 copilot-agent PRs (last 30 days) into 6 themes; overall 82.4% merge rate. No cluster is a statistically significant outlier (all within ±8.2 pts of overall). Routine/narrow tasks (version bumps 93%, Sous Chef bot self-fixes 91%) outperform the broad catch-all \"General Workflow & Agent Features\" cluster (271 PRs, 50% of total, 78.2% — lowest but not significant).\n\n**FILEABLE:** None — this is a narrative/metrics report with no code defect. Two tooling gaps noted: `agenticworkflows logs` returned `HTTP 403: API rate limit exceeded for installation` when querying 30-day copilot-engine run metrics; and `prompt-cache/pr-full-data/` cache is 11 days stale, covering only 327/544 PRs in-window, limiting root-cause depth.\n\n**Tracked elsewhere:** None mentioned.\n\n## #65837 — Typist: Go Type Consistency Analysis (2026-10-05)\n\n**Summary:** Scanned 1,426 non-test `.go` files; zero `interface{}` remains in production code. Found 2 genuine duplicate-type clusters and one major repeated-pattern hotspot: `pkg/parser` hand-writes `value.(map[string]any)` assertions 161 times across 20 files despite `pkg/typeutil` already providing `LookupMap`/`LookupString`/`LookupBool`/`LookupStringPath` helpers — only `pkg/parser/frontmatter_hash.go` actually uses them.\n\n**FILEABLE:**\n1. `pkg/parser/frontmatter_hash.go:572` (`type runtimeImportReference struct{ path string; startLine int; endLine int }`) duplicates `pkg/workflow/runtime_import_validation.go:38` (same struct, field named `importPath`). Fix: export parser's version, have workflow package reuse it (~30 min).\n2. `pkg/workflow/compiler_yaml_graders.go:86` (writer, 13-field `graderManifestEntry`) vs `pkg/cli/audit_report_graders.go:67` (reader, 5-field subset) — no shared source of truth; a silent-break risk if writer fields are renamed. Fix: extract shared 5 fields into `pkg/types` (~1 hr).\n3. `pkg/parser/mcp.go:99` — example of the repeated assertion pattern: `mcpServers, ok := mcpServersSection.(map[string]any)` should become `typeutil.LookupMap(...)`. Affected files include `yaml_import.go`, `schema_deprecation.go`, `mcp.go`, `schema_suggestions.go`, `import_field_extractor.go`, `import_schema_validation.go`, `tools_merger.go`, `schema_triggers.go`, `schema_validation.go`, `content_extractor.go`, `schema_compiler.go`, and others (4-6 hrs, mechanical).\n4. Optional: `pkg/types/input_definition.go:18` (`InputDefinition.Default any`) and `pkg/parser/import_observability.go:16-18` (`observabilityImportEndpoint.Headers any`) — both have known, small concrete type sets documented only in comments; could be made compiler-enforced.\n\n**Tracked elsewhere:** None mentioned — these are freshly surfaced findings.\n\n## #65850 — MCP Structural Analysis (2026-10-05)\n\n**Summary:** First-ever run (no history), rated 10 GitHub MCP tools; average usefulness 2.9/5. Core finding: `_meta.serverInfo` repeats a base64 server-icon payload on every direct MCP call, adding ~900 near-fixed tokens regardless of payload size — worst case `get_label` (~140-char record cost ~962 tokens, >6x overhead).\n\n**FILEABLE:** Not a code file in this repo — it's a GitHub MCP server/gateway behavior issue (external dependency)
|
|
agent
Agent reported that it could not complete the task\n[51] untimed execution/agent agent.execution categories=[\"http_400_response_error\"] errorCodes=[400] exitCode=1\n```\nUses the `pi` engine — same engine as \"AI Moderator,\" which shows a similar failure signature and is worth checking for the same root cause. Suggests investigating a bad/deprecated model id or malformed request in the `pi` engine call. Also: once fixed, consider downgrading its model (narrow read-only \"issue_response\" task) to `gpt-4.1-mini`/`claude-haiku-4-5`.\n\n**Other note:** `action_required` (24.5% of runs) is mostly GitHub's approval gate for Copilot-authored PR branches, not real failures — recommend excluding from failure-rate dashboards.\n\n**Tracked elsewhere:** Not mentioned as already filed.\n\n## #65832 — Prompt Clustering Analysis (2026-10-05)\n\n**Summary:** Clustered 544 copilot-agent PRs (last 30 days) into 6 themes; overall 82.4% merge rate. No cluster is a statistically significant outlier (all within ±8.2 pts of overall). Routine/narrow tasks (version bumps 93%, Sous Chef bot self-fixes 91%) outperform the broad catch-all \"General Workflow & Agent Features\" cluster (271 PRs, 50% of total, 78.2% — lowest but not significant).\n\n**FILEABLE:** None — this is a narrative/metrics report with no code defect. Two tooling gaps noted: `agenticworkflows logs` returned `HTTP 403: API rate limit exceeded for installation` when querying 30-day copilot-engine run metrics; and `prompt-cache/pr-full-data/` cache is 11 days stale, covering only 327/544 PRs in-window, limiting root-cause depth.\n\n**Tracked elsewhere:** None mentioned.\n\n## #65837 — Typist: Go Type Consistency Analysis (2026-10-05)\n\n**Summary:** Scanned 1,426 non-test `.go` files; zero `interface{}` remains in production code. Found 2 genuine duplicate-type clusters and one major repeated-pattern hotspot: `pkg/parser` hand-writes `value.(map[string]any)` assertions 161 times across 20 files despite `pkg/typeutil` already providing `LookupMap`/`LookupString`/`LookupBool`/`LookupStringPath` helpers — only `pkg/parser/frontmatter_hash.go` actually uses them.\n\n**FILEABLE:**\n1. `pkg/parser/frontmatter_hash.go:572` (`type runtimeImportReference struct{ path string; startLine int; endLine int }`) duplicates `pkg/workflow/runtime_import_validation.go:38` (same struct, field named `importPath`). Fix: export parser's version, have workflow package reuse it (~30 min).\n2. `pkg/workflow/compiler_yaml_graders.go:86` (writer, 13-field `graderManifestEntry`) vs `pkg/cli/audit_report_graders.go:67` (reader, 5-field subset) — no shared source of truth; a silent-break risk if writer fields are renamed. Fix: extract shared 5 fields into `pkg/types` (~1 hr).\n3. `pkg/parser/mcp.go:99` — example of the repeated assertion pattern: `mcpServers, ok := mcpServersSection.(map[string]any)` should become `typeutil.LookupMap(...)`. Affected files include `yaml_import.go`, `schema_deprecation.go`, `mcp.go`, `schema_suggestions.go`, `import_field_extractor.go`, `import_schema_validation.go`, `tools_merger.go`, `schema_triggers.go`, `schema_validation.go`, `content_extractor.go`, `schema_compiler.go`, and others (4-6 hrs, mechanical).\n4. Optional: `pkg/types/input_definition.go:18` (`InputDefinition.Default any`) and `pkg/parser/import_observability.go:16-18` (`observabilityImportEndpoint.Headers any`) — both have known, small concrete type sets documented only in comments; could be made compiler-enforced.\n\n**Tracked elsewhere:** None mentioned — these are freshly surfaced findings.\n\n## #65850 — MCP Structural Analysis (2026-10-05)\n\n**Summary:** First-ever run (no history), rated 10 GitHub MCP tools; average usefulness 2.9/5. Core finding: `_meta.serverInfo` repeats a base64 server-icon payload on every direct MCP call, adding ~900 near-fixed tokens regardless of payload size — worst case `get_label` (~140-char record cost ~962 tokens, >6x overhead).\n\n**FILEABLE:** Not a code file in this repo — it's a GitHub MCP server/gateway behavior issue (external dependency)
|
|
agent
Agent reported that it could not complete the task\n [51] untimed execution/agent agent.execution categories=[\"http_400_response_error\"] errorCodes=[400] errorTypes=[] exitCode=1\n ```\n- Correlated burst-window failures, same second across different workflows on the same PR branch (`copilot/fix-linter-flags-omission`): [§37265294850](https://github.com/github/gh-aw/actions/runs/37265294850) (Agentic Commands, failure) and run 37265294729 (AI Moderator, failure), both `created_at: 2026-10-05T04:51:28Z`.\n- Did not obtain token/cost usage for this period — the tool path that normally surfaces that (`agenticworkflows logs`) is the one that stalled; worth a follow-up with a narrower per-workflow query (e.g. `workflow_name` + small `count`) rather than a repo-wide sweep.\n\n</details>\n\n**References:**\n- [§37291067866](https://github.com/github/gh-aw/actions/runs/37291067866) — Issue Monster, latest failure (http_400_response_error)\n- [§37265294850](https://github.com/github/gh-aw/actions/runs/37265294850) — Agentic Commands, burst-window failure\n- [§37265339163](https://github.com/github/gh-aw/actions/runs/37265339163) — Agentic Commands, action_required (approval-gated, not a code failure)\n\n> Generated by [🔍 Weekly Workflow Analysis](https://github.com/github/gh-aw/actions/runs/37291459948) · claude · agent · 339.9 AIC · ⌖ 7.49 AIC · ⊞ 6.3K · [◷](https://github.com/search?q=repo%3Agithub%2Fgh-aw+%22gh-aw-workflow-call-id%3A+github%2Fgh-aw%2Fexample-workflow-analyzer%22&type=discussions)\n> - [x] expires <!-- gh-aw-expires: 2026-10-06T09:53:43.686Z --> on Oct 6, 2026, 1:53 AM UTC-08:00\n\n<!-- gh-aw-agentic-workflow: Weekly Workflow Analysis, engine: claude, model: agent, id: 37291459948, workflow_id: example-workflow-analyzer, run: https://github.com/github/gh-aw/actions/runs/37291459948 -->\n\n<!-- gh-aw-workflow-id: example-workflow-analyzer -->\n<!-- gh-aw-workflow-call-id: github/gh-aw/example-workflow-analyzer -->","is_error":false}]},"parent_tool_use_id":"toolu_01WyshxspwB5tciHmRAFu9RH","session_id":"0926f793-2919-4663-9ba3-000459d9efef","uuid":"7ab95230-58dd-464d-8bae-e7da02bd24f8","timestamp":"2026-10-05T12:43:37.776Z","subagent_type":"general-purpose","task_description":"Extract findings from 6 new discussions"}
|
|
safe_outputs
Unable to download artifact(s): Artifact not found for name: safe-outputs-upload-artifacts
Please ensure that your artifact is not expired and the artifact was uploaded using a compatible version of toolkit/upload-artifact.
For more information, visit the GitHub Artifacts FAQ: https://github.com/actions/toolkit/blob/main/packages/artifact/docs/faq.md
|
|
conclusion
Agent reported that it could not complete the task [51] untimed execution/agent agent.execution categories=["http_400_response_error"] errorCodes=[400] exitCode=1 ``` Uses the `pi` engine — same engine as "AI Moderator," which shows a similar failure signature and is worth checking for the same root cause. Suggests investigating a bad/deprecated model id or malformed request in the `pi` engine call. Also: once fixed, consider downgrading its model (narrow read-only "issue_response" task) to `gpt-4.1-mini`/`claude-haiku-4-5`. **Other note:** `action_required` (24.5% of runs) is mostly GitHub's approval gate for Copilot-authored PR branches, not real failures — recommend excluding from failure-rate dashboards. **Tracked elsewhere:** Not mentioned as already filed. ## #65832 — Prompt Clustering Analysis (2026-10-05) **Summary:** Clustered 544 copilot-agent PRs (last 30 days) into 6 themes; overall 82.4% merge rate. No cluster is a statistically significant outlier (all within ±8.2 pts of overall). Routine/narrow tasks (version bumps 93%, Sous Chef bot self-fixes 91%) outperform the broad catch-all "General Workflow & Agent Features" cluster (271 PRs, 50% of total, 78.2% — lowest but not significant). **FILEABLE:** None — this is a narrative/metrics report with no code defect. Two tooling gaps noted: `agenticworkflows logs` returned `HTTP 403: API rate limit exceeded for installation` when querying 30-day copilot-engine run metrics; and `prompt-cache/pr-full-data/` cache is 11 days stale, covering only 327/544 PRs in-window, limiting root-cause depth. **Tracked elsewhere:** None mentioned. ## #65837 — Typist: Go Type Consistency Analysis (2026-10-05) **Summary:** Scanned 1,426 non-test `.go` files; zero `interface{}` remains in production code. Found 2 genuine duplicate-type clusters and one major repeated-pattern hotspot: `pkg/parser` hand-writes `value.(map[string]any)` assertions 161 times across 20 files despite `pkg/typeutil` already providing `LookupMap`/`LookupString`/`LookupBool`/`LookupStringPath` helpers — only `pkg/parser/frontmatter_hash.go` actually uses them. **FILEABLE:** 1. `pkg/parser/frontmatter_hash.go:572` (`type runtimeImportReference struct{ path string; startLine int; endLine int }`) duplicates `pkg/workflow/runtime_import_validation.go:38` (same struct, field named `importPath`). Fix: export parser's version, have workflow package reuse it (~30 min). 2. `pkg/workflow/compiler_yaml_graders.go:86` (writer, 13-field `graderManifestEntry`) vs `pkg/cli/audit_report_graders.go:67` (reader, 5-field subset) — no shared source of truth; a silent-break risk if writer fields are renamed. Fix: extract shared 5 fields into `pkg/types` (~1 hr). 3. `pkg/parser/mcp.go:99` — example of the repeated assertion pattern: `mcpServers, ok := mcpServersSection.(map[string]any)` should become `typeutil.LookupMap(...)`. Affected files include `yaml_import.go`, `schema_deprecation.go`, `mcp.go`, `schema_suggestions.go`, `import_field_extractor.go`, `import_schema_validation.go`, `tools_merger.go`, `schema_triggers.go`, `schema_validation.go`, `content_extractor.go`, `schema_compiler.go`, and others (4-6 hrs, mechanical). 4. Optional: `pkg/types/input_definition.go:18` (`InputDefinition.Default any`) and `pkg/parser/import_observability.go:16-18` (`observabilityImportEndpoint.Headers any`) — both have known, small concrete type sets documented only in comments; could be made compiler-enforced. **Tracked elsewhere:** None mentioned — these are freshly surfaced findings. ## #65850 — MCP Structural Analysis (2026-10-05) **Summary:** First-ever run (no history), rated 10 GitHub MCP tools; average usefulness 2.9/5. Core finding: `_meta.serverInfo` repeats a base64 server-icon payload on every direct MCP call, adding ~900 near-fixed tokens regardless of payload size — worst case `get_label` (~140-char record cost ~962 tokens, >6x overhead). **FILEABLE:** Not a code file in this repo — it's a GitHub MCP server/gateway behavior issue (external dependency), not a gh-aw source defect. Concrete ask
|
|
agent
Skipping inaccessible directory during secret redaction: /tmp/gh-aw/aw-mcp
|
|
agent
Removed symbolic link before artifact upload: /tmp/gh-aw/latest
|
|
safe_outputs
Title dedup search (recently closed issues) truncated for github/gh-aw: fetched 200 of 5539 results (cap 2 pages)
|
|
safe_outputs
Title dedup search (open issues) truncated for github/gh-aw: fetched 200 of 384 results (cap 2 pages)
|
|
evals
Removed symbolic link before artifact upload: /tmp/gh-aw/latest
|
|
agent
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
|
|
detection
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
|
|
evals
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
agent
|
1.1 MB |
sha256:eaab2a3289863496053ce7a11861396a9a2c5dbb00235e5c4b412fe6db2ee443
|
|
|
agent-output-fallback
|
12.5 KB |
sha256:842021dce0030d939a3e95eb261a0a715f1961f73e72b287ab41c67862fce4cb
|
|
|
cache-memory
|
140 MB |
sha256:0f51ae3d707f6c17feb20c111a635fc11be905cf8210d3347c245171fded58a9
|
|
|
deepreport-experiment
|
5.61 KB |
sha256:2297018b75ddfe2414d28cec63310da2e41983e8d5a96fd786ed5d566cfa9ace
|
|
|
detection
|
21.3 KB |
sha256:50b310098143aadc1b39e91f6a68ecc7b49b55810ca98f0b4a687b944e59fb77
|
|
|
evals
|
1.21 KB |
sha256:ae085e0cb54ac6eac8bbb633a75e0c42c50e1133599ec368dd4ee2ab4c64953f
|
|
|
github~gh-aw~GZA9UJ.dockerbuild
|
23.6 KB |
sha256:1df7c88dd113b803165d36506186e747205c88e7629bba31f667ddff26b5cd7f
|
|
|
info
|
621 Bytes |
sha256:6cd3cacf4bfaf75d983d739a8b667b18fea0e111d3f05c03563938a1a0275d39
|
|
|
safe-outputs-items
|
632 Bytes |
sha256:a2ccaf75c7a9b1300210915d61db8b5a87b51c9f39df3912df77e023dfab8945
|
|
|
usage
|
122 KB |
sha256:b610d47feada0dff1a68e1f5e6915e22a127c62fa6a06454189a150d04bb9805
|
|