Preserve model routing attribution in audit and logs by Copilot · Pull Request #67114 · github/gh-aw

Copilot · 2026-10-09T05:02:42Z

Agent artifact flattening discarded final routing metadata, and unified sessions omitted workflow metadata and the harness outcome. As a result, audit and logs could report AWF’s selected endpoint instead of the endpoint and effort actually used by the harness.

Preserve agent metadata: Stage the agent artifact before flattening so nested files survive; publish the final aw_info.json for existing consumers and prefer it in usage artifacts.
Record unified-session attribution: Emit workflow.info and model_routing.outcome; document their routing fields and the existing firewall.model_routing fields in the specification and schema.
Use session data in audit and logs: Read model, status, applied effort, and effective/selected endpoints from the unified session, retaining aw_info.json and AWF routing logs as fallbacks. Invalidate cached summaries from the prior schema version.

Example session events:

{"type":"workflow.info","data":{"model":"claude-sonnet-5","requestedModel":"agent","modelRouting":{"effectiveEndpoint":"/v1/messages","selectedEndpoint":"/chat/completions"}}}
{"type":"model_routing.outcome","data":{"status":"selected","effectiveEndpoint":"/v1/messages","selectedEndpoint":"/chat/completions","appliedEffort":"medium"}}

Fixes audit/logs: agent job's final aw_info.json and harness routing outcome are lost (deleted on download, absent from aw_session.jsonl) #67113

Co-authored-by: SivaKesava1 <11771739+SivaKesava1@users.noreply.github.com>

SivaKesava1 · 2026-10-09T05:58:43Z

@copilot resolve merge conflicts

Copilot

🟡 Changes recommended

Production outcome writers omit promised endpoints, audit comparisons discard them, and endpoint-distinct route ordering is unstable.

2 open findings

Persist endpoint fields in model routing outcome events · New
Include endpoints in audit route comparison and change detection · New

What changed in this PR

Preserves harness-selected model-routing attribution across artifact downloads, unified sessions, audit reports, and logs.

Changes:

Preserves final agent metadata while flattening artifacts.
Adds workflow and routing-outcome session events.
Consumes session attribution and updates schemas, cache versions, documentation, and tests.

File	Description
`schemas/logs.schema.json`	Adds endpoint fields to logs schemas.
`schemas/logs-jsonl.schema.json`	Adds endpoints and bumps cache schema.
`schemas/audit.schema.json`	Exposes routing endpoints in audits.
`pkg/cli/model_routing.go`	Merges session routing attribution.
`pkg/cli/model_routing_test.go`	Tests session attribution.
`pkg/cli/model_routing_session.go`	Parses routing session events.
`pkg/cli/logs_report.go`	Reports endpoint attribution.
`pkg/cli/logs_models.go`	Adds selected endpoint metadata.
`pkg/cli/logs_flatten_test.go`	Tests nested artifact preservation.
`pkg/cli/logs_download_flatten.go`	Safely stages and flattens agent artifacts.
`pkg/cli/logs_cached_json.go`	Invalidates and updates cached attribution.
`pkg/cli/logs_cached_json_test.go`	Updates cache-version tests.
`pkg/cli/audit_report_render.go`	Renders effective and selected endpoints.
`pkg/cli/audit_expanded.go`	Adds session metadata fallback.
`docs/src/content/docs/specs/unified-agent-session-specification.md`	Documents routing events and fields.
`docs/public/schemas/unified-session.schema.json`	Extends the public session schema.
`actions/setup/sh/collect_usage_artifact_files.sh`	Prefers final agent metadata.
`actions/setup/sh/collect_usage_artifact_files_test.sh`	Tests final metadata collection.
`actions/setup/js/unified_session.test.cjs`	Tests routing session collection.
`actions/setup/js/unified_session.cjs`	Emits workflow and routing events.
`actions/setup/js/unified_session_render.test.cjs`	Tests endpoint rendering.
`actions/setup/js/unified_session_render.cjs`	Renders routing events.
`actions/setup/js/unified_session_payload.test.cjs`	Tests workflow metadata normalization.
`actions/setup/js/unified_session_payload.cjs`	Normalizes routing payloads.
`actions/setup/js/types/unified_session.d.ts`	Adds routing event types.

🧠 Review effort: Balanced

💡 Add a code-review agent skill for context-aware, tailored reviews. Learn more in the docs.

…s-loss # Conflicts: # pkg/cli/audit_report_render.go # pkg/cli/logs_report.go # pkg/cli/model_routing.go # pkg/cli/model_routing_test.go # schemas/logs.schema.json Co-authored-by: SivaKesava1 <11771739+SivaKesava1@users.noreply.github.com>

Copilot · 2026-10-09T06:14:39Z

@copilot resolve merge conflicts

Resolved the conflicts by merging main; merge commit ec02768 preserves both routing changes and the incoming endpoint summary updates.

gh-aw-bot · 2026-10-09T06:45:43Z

Warning

Threat Detection Engine Failure — The analysis engine could not complete. This is a tooling failure, not a security finding.

What happened

The threat detection engine failed to produce results.

Review the workflow run logs for details.

@copilot address the following outstanding work in one pass:

Update this branch with the latest main using make merge-main, resolving any conflicts and preserving the intended changes.
Review (actions/setup/js/unified_session.cjs:441): The new event cannot contain the endpoint fields promised by T-UAS-070 in real runs. recordAWFModelRoutingOutcome currently drops endpoint and selected_endpoint, and the Claude, Codex, Copilot, and Pi harness calls do not pass them; a direct call with both fields serializes only status/model/effort. Consequently these fields are present only in this fabricated collector test, while production model_routing.outcome events omit them. Thread the resolved selection endpoints through each harness call and persist validated endpoint fields in the outcome writer. - Preserve model routing attribution in audit and logs #67114 (comment)
Review (pkg/cli/model_routing.go:84): The new endpoint attribution is still discarded by audit comparisons. modelRoutingComparisonRoute copies only model, effort, mode, and router version into AuditComparisonRoute, and sameModelRoutingRoute checks only those fields. Thus an audit diff where the effective endpoint changes while the selected route stays the same reports no endpoint and leaves model_routing_changed false. Propagate both endpoints through the comparison type, schema, equality check, and tests. - Preserve model routing attribution in audit and logs #67114 (comment)

Push the necessary fixes, reply to each listed review thread and resolve it when addressed. Ignore feedback already answered or resolved. Use the pr-finisher skill and stop when only human review or CI remains; do not trigger CI.

Sous-chef head: ec02768
Sous-chef work: 326436fb72cf3401e1bfd76275f259c2e349f3d4a5d93581c6cf56aaddaea466 4fe44e53555163220d76652fcb5c0d4daf671288df9ff17a5db89a29d1b73595
Sous-chef state: 3ed79d793af37a636da7d1a9bb24510075454d4021e824f0fb494dae8df5cfc2

Generated by 👨‍🍳 PR Sous Chef · pi · haiku45 · 4.93 AIC · ⊞ 1K · ◷
_{Comment /souschef to run again}

Co-authored-by: gh-aw-bot <259018956+gh-aw-bot@users.noreply.github.com>

Co-authored-by: SivaKesava1 <11771739+SivaKesava1@users.noreply.github.com>

SivaKesava1 · 2026-10-09T16:23:16Z

Verified 514fc721 in our sandbox (routed workflows compiled at this head, default AWF v0.28.50):

Run	`aw_session.jsonl`	`gh aw audit --json` `model_routing`
37956765407 Claude t01	`workflow.info` (`model: claude-sonnet-5`, `modelRouting` with effective/selected endpoints) and `model_routing.outcome` (`effectiveEndpoint: /v1/messages`, `selectedEndpoint: /chat/completions`, `appliedEffort: medium`)	`status: selected`, `effective_endpoint: /v1/messages`, `selected_endpoint: /chat/completions`, `model_effort: medium`
37956778256 pi t10	same events; `claude-opus-5`, `appliedEffort: max`	`effective_endpoint: /v1/messages`, `selected_endpoint: /chat/completions`

The download fix also works on artifacts from before this PR. gh aw audit 37890995735 (a Claude run on main from before this change) now keeps both aw_info.json and agent/aw_info.json with routing, and shows effective_endpoint: /v1/messages. Before this PR, audit only saw the activation copy (model: agent, no routing).

@copilot /pr-finisher

…s-loss Co-authored-by: SivaKesava1 <11771739+SivaKesava1@users.noreply.github.com>

SivaKesava1 · 2026-10-09T16:54:47Z

Ready for review. Sandbox-verified at 514fc721 (fresh Claude and pi routed runs plus an older run: workflow.info and model_routing.outcome are in aw_session.jsonl, and audit shows effective and selected endpoints). The later commits only regenerate the log schemas and merge main. Both review threads are addressed and resolved. The current CI failures (lint-go-custom in pkg/workqueue/replay.go, verify-integration-build on an undefined parseMaintenanceJobs in a work-queue test, work_queue_*.test.cjs, and impacted-go-tests in unrelated CLI tests) come from work-queue changes on main, not from this PR.

Initial plan

5ef2442

Copilot AI assigned Copilot and SivaKesava1 Oct 9, 2026

Copilot started work on behalf of SivaKesava1 October 9, 2026 05:03 View session

Copilot AI linked an issue Oct 9, 2026 that may be closed by this pull request

audit/logs: agent job's final aw_info.json and harness routing outcome are lost (deleted on download, absent from aw_session.jsonl) #67113

Closed

Preserve model routing session attribution

15da676

Co-authored-by: SivaKesava1 <11771739+SivaKesava1@users.noreply.github.com>

SivaKesava1 marked this pull request as ready for review October 9, 2026 05:54

Copilot AI balanced review requested due to automatic review settings October 9, 2026 05:54

Copilot started reviewing on behalf of SivaKesava1 October 9, 2026 05:55 View session

Copilot AI changed the title ~~[WIP] Fix loss of final aw_info.json and harness routing outcome in audit/logs~~ Preserve model routing attribution in audit and logs Oct 9, 2026

Copilot finished work on behalf of SivaKesava1 October 9, 2026 05:56

Copilot AI requested a review from SivaKesava1 October 9, 2026 05:56

Copilot AI reviewed Oct 9, 2026

View reviewed changes

Comment thread actions/setup/js/unified_session.cjs

Comment thread pkg/cli/model_routing.go

Copilot started work on behalf of SivaKesava1 October 9, 2026 06:02 View session

Copilot finished work on behalf of SivaKesava1 October 9, 2026 06:15

github-actions Bot mentioned this pull request Oct 9, 2026

[pr-sous-chef] PR Sous Chef 🍳 – Nudges Posted #67031

Closed

Copilot started work on behalf of gh-aw-bot October 9, 2026 06:46 View session

github-actions Bot mentioned this pull request Oct 9, 2026

[PR Triage Report] 2026-10-09 Copilot PR triage #67139

Closed

Preserve model routing endpoints in audit comparisons

514fc72

Co-authored-by: gh-aw-bot <259018956+gh-aw-bot@users.noreply.github.com>

Copilot finished work on behalf of gh-aw-bot October 9, 2026 07:09

Copilot AI requested a review from gh-aw-bot October 9, 2026 07:09

github-actions Bot mentioned this pull request Oct 9, 2026

[Contribution Check Report] Contribution Check — 2026-10-09 #67078

Closed

Copilot started work to fix failing Actions workflow(s) on behalf of SivaKesava1 October 9, 2026 16:12 View session

github-actions Bot mentioned this pull request Oct 9, 2026

[pr-sous-chef] PR Sous Chef 🍳 – Nudge Report #67171

Closed

Regenerate log output schemas

91e00a5

Co-authored-by: SivaKesava1 <11771739+SivaKesava1@users.noreply.github.com>

Copilot finished work on behalf of SivaKesava1 October 9, 2026 16:22

Copilot started work on behalf of SivaKesava1 October 9, 2026 16:26 View session

Copilot started work to fix failing Actions workflow(s) on behalf of SivaKesava1 October 9, 2026 16:29 View session

Merge remote-tracking branch 'origin/main' into copilot/fix-audit-log…

be5e481

…s-loss Co-authored-by: SivaKesava1 <11771739+SivaKesava1@users.noreply.github.com>

Copilot finished work on behalf of SivaKesava1 October 9, 2026 16:36

Copilot started work to fix failing Actions workflow(s) on behalf of SivaKesava1 October 9, 2026 16:39 View session

Copilot finished work on behalf of SivaKesava1 October 9, 2026 16:45

Copilot finished work on behalf of SivaKesava1 October 9, 2026 16:46

SivaKesava1 requested a review from pelikhan October 9, 2026 16:54

Merge branch 'main' into copilot/fix-audit-logs-loss

5d593b0

pelikhan merged commit 29b5ac2 into main Oct 9, 2026
42 of 46 checks passed

pelikhan deleted the copilot/fix-audit-logs-loss branch October 9, 2026 17:06

SivaKesava1 mentioned this pull request Oct 9, 2026

OpenTelemetry: export a sparse set of model-routing attributes and document them #67237

Closed

Copilot AI mentioned this pull request Oct 9, 2026

Export sparse model-routing attributes to OpenTelemetry #67240

Merged

SivaKesava1 mentioned this pull request Oct 9, 2026

Tests: golden routed-run fixtures for gh aw audit model routing and token usage #67250

Closed

Copilot AI mentioned this pull request Oct 9, 2026

Add golden coverage for routed model audit analysis #67253

Merged

This was referenced Oct 9, 2026

Add cross-module model-routing contract coverage #67254

Merged

Model routing attribution: agent-writable awf-routing-outcome.json overrides runner-written routing in the unified session and audit #67279

Closed

Copilot AI mentioned this pull request Oct 9, 2026

Keep harness routing outcomes advisory to model attribution #67280

Merged

github-actions Bot mentioned this pull request Oct 10, 2026

[PR Triage Report] 2026-10-10 #67427

Closed

Navigation Menu

Repository navigation

Preserve model routing attribution in audit and logs - #67114

Preserve model routing attribution in audit and logs#67114
pelikhan merged 7 commits into
mainfrom
copilot/fix-audit-logs-loss

Copilot AI commented Oct 9, 2026 •

edited

Loading

Uh oh!

SivaKesava1 commented Oct 9, 2026

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Uh oh!

Copilot AI commented Oct 9, 2026

Uh oh!

gh-aw-bot commented Oct 9, 2026

Uh oh!

SivaKesava1 commented Oct 9, 2026

Uh oh!

SivaKesava1 commented Oct 9, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Conversation

Copilot AI commented Oct 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

SivaKesava1 commented Oct 9, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

🟡 Changes recommended

Uh oh!

Uh oh!

Uh oh!

Copilot AI commented Oct 9, 2026

Uh oh!

gh-aw-bot commented Oct 9, 2026

Uh oh!

SivaKesava1 commented Oct 9, 2026

Uh oh!

SivaKesava1 commented Oct 9, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Copilot AI commented Oct 9, 2026 •

edited

Loading