Repository navigation
Commit d534c31
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?v=4&size=40){kind=avatar}
Add five trajectory graders and harden generator contracts (#64023)
* Implement five trajectory graders
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
* Implement graders ranked 18-22
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
* Use total ordering for tool-wise-score tool calls
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
* Harden trajectory grader contracts against malformed/missing evidence
Co-authored-by: gh-aw-bot <259018956+gh-aw-bot@users.noreply.github.com>
* Split malformed-action and missing-consequential-flag messages
Co-authored-by: gh-aw-bot <259018956+gh-aw-bot@users.noreply.github.com>
* Make all trajectory graders built-in and run them on every trace
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
* Report trajectory graders without IR as unavailable and scope size guard
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
* Extract shared Trajectory IR candidate lookup helper
Co-authored-by: gh-aw-bot <259018956+gh-aw-bot@users.noreply.github.com>
* Cover non-record traces in trajectory grader tests
Co-authored-by: gh-aw-bot <259018956+gh-aw-bot@users.noreply.github.com>
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: gh-aw-bot <259018956+gh-aw-bot@users.noreply.github.com>1 parent a0e81a2 commit d534c31
65 files changed
Lines changed: 2411 additions & 1142 deletions
File tree
- .github/workflows
- actions/setup/js
- docs/src/content/docs
- experimental
- specs
- pkg/workflow
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
0 commit comments