Skip to content
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge main and expand smoke fallback coverage across engines and runt…
…imes

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
  • Loading branch information
pelikhan and Copilot committed Oct 7, 2026
commit 94543b584c9b2ce70be16d78796c40588cae968c

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

6 changes: 3 additions & 3 deletions .github/workflows/smoke-claude.lock.yml

Large diffs are not rendered by default.

3 changes: 3 additions & 0 deletions .github/workflows/smoke-claude.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,9 @@ max-turns: 100
model: claude-sonnet-4-6
engine:
id: claude
fallback-models:
- anthropic/claude-haiku-4-5
- anthropic/claude-sonnet-5
bare: true
inlined-imports: true
imports:
Expand Down
20 changes: 10 additions & 10 deletions .github/workflows/smoke-codex.lock.yml

Large diffs are not rendered by default.

6 changes: 5 additions & 1 deletion .github/workflows/smoke-codex.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,11 @@ permissions:
issues: read
pull-requests: read
name: Smoke Codex
engine: codex
engine:
id: codex
fallback-models:
- openai/gpt-5.4
- openai/gpt-5.4-mini
imports:
- shared/gh.md
- shared/reporting-otlp.md
Expand Down
22 changes: 12 additions & 10 deletions .github/workflows/smoke-copilot-arm.lock.yml

Large diffs are not rendered by default.

6 changes: 5 additions & 1 deletion .github/workflows/smoke-copilot-arm.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,11 @@ permissions:
discussions: read
actions: read
name: Smoke Copilot ARM64
engine: copilot
engine:
id: copilot
fallback-models:
- copilot/gpt-5.4
- copilot/claude-sonnet-5
runs-on: ubuntu-24.04-arm
imports:
- shared/gh.md
Expand Down
14 changes: 7 additions & 7 deletions .github/workflows/smoke-copilot-sdk.lock.yml

Large diffs are not rendered by default.

5 changes: 4 additions & 1 deletion .github/workflows/smoke-copilot-sdk.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,9 +16,12 @@ on:
permissions:
contents: read
name: Smoke Copilot SDK
model: gpt-5.4
model: copilot/gpt-5.4
engine:
id: copilot
fallback-models:
- copilot/claude-sonnet-5
- copilot/gpt-5.4-mini
copilot-sdk: true
bare: true
imports:
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/smoke-deepseek-harness.lock.yml

Large diffs are not rendered by default.

14 changes: 4 additions & 10 deletions .github/workflows/smoke-gemini.lock.yml

Large diffs are not rendered by default.

3 changes: 3 additions & 0 deletions .github/workflows/smoke-gemini.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,9 @@ experiments:
tags: [cost_optimization, smoke_tests]
engine:
id: gemini
fallback-models:
- gemini/gemini-3.8-flash
- gemini/gemini-2.5-pro
strict: true
imports:
- shared/reporting-otlp.md
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/smoke-github-claude.lock.yml

Large diffs are not rendered by default.

3 changes: 3 additions & 0 deletions .github/workflows/smoke-github-claude.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,9 @@ model: claude-haiku-4.5
engine:
id: claude
model-provider: github
fallback-models:
- copilot/claude-sonnet-5
- copilot/claude-sonnet-4.6
bare: true
strict: true
imports:
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/smoke-pi.lock.yml

Large diffs are not rendered by default.

3 changes: 3 additions & 0 deletions .github/workflows/smoke-pi.md
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,9 @@ name: Smoke Pi
model: copilot/auto
engine:
id: pi
fallback-models:
- copilot/gpt-5.4
- copilot/claude-sonnet-5
max-tool-calls: 80
strict: true
sandbox:
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/smoke-service-ports.lock.yml

Large diffs are not rendered by default.

6 changes: 5 additions & 1 deletion .github/workflows/smoke-service-ports.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,11 @@ permissions:
issues: read
pull-requests: read
name: Smoke Service Ports
engine: pi
engine:
id: pi
fallback-models:
- copilot/gpt-5.4
- copilot/gpt-5.4-mini
model: copilot/gpt-5.3-codex
strict: true
sandbox:
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/smoke-work-queue.lock.yml

Large diffs are not rendered by default.

3 changes: 3 additions & 0 deletions .github/workflows/smoke-work-queue.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,9 @@ permissions:
engine:
id: copilot
model: copilot/gpt-5.3-codex
fallback-models:
- copilot/gpt-5.4
- copilot/gpt-5.4-mini
sandbox:
agent:
id: awf
Expand Down
2 changes: 2 additions & 0 deletions docs/src/content/docs/reference/engines.md
Original file line number Diff line number Diff line change
Expand Up @@ -494,6 +494,8 @@ AWF v0.28.44 supports concrete same-provider chains only. Cross-provider chains

AWF's `token-usage.jsonl` records the actual serving model and `model_fallback` evidence; gh-aw uses that evidence for `aw_info.json`, telemetry, and generated output attribution.

The repository's smoke workflows configure fallback chains across Copilot, Claude, Codex, Gemini, and Pi. Additional coverage includes Copilot SDK (`smoke-copilot-sdk`), ARM64 (`smoke-copilot-arm`), Claude on GitHub inference (`smoke-github-claude`), published service ports with `docker-sudo-iptables` (`smoke-service-ports`), and Cloud Hypervisor (`smoke-work-queue`). These workflows exercise their existing tasks with fallback enabled; they do not force provider failures or prove that a model switch occurred.

Codex has no gh-aw-supplied default model. Set `engine.model`, a phase-specific `GH_AW_MODEL_*_CODEX` repository variable, or `GH_AW_DEFAULT_MODEL_CODEX` explicitly; an empty model selection never introduces an implicit `gpt-5.4` recovery model.

### Copilot SDK Support
Expand Down
Loading
You are viewing a condensed version of this merge commit. You can view the full changes here.