Skip to content

feat: remove native chat cost tracking in favor of AI Gateway cost data #27330

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ibetitsmike merged 9 commits into from
Aug 4, 2026
Merged

feat: remove native chat cost tracking in favor of AI Gateway cost data #27330

Changes from 1 commit
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
4d333ea
feat: remove native chat cost tracking in favor of AI Gateway cost data
ibetitsmike Jul 28, 2026
b342a41
fix(site/src/pages/AgentsPage): correct mobileBack prop doc
ibetitsmike Jul 29, 2026
ce810ad
fix(site/src/pages/AgentsPage): attach the label docblock to its func…
ibetitsmike Jul 29, 2026
662482d
docs: apply spend management review feedback
ibetitsmike Aug 3, 2026
b830ac6
fix: reconcile native cost removal with upstream changes
ibetitsmike Aug 4, 2026
1f2e0e2
docs: mark spend management premium and document CSV output
ibetitsmike Aug 4, 2026
2eb64d5
docs: document native cost migration
ibetitsmike Aug 4, 2026
065ef43
docs: document native cost export pagination
ibetitsmike Aug 4, 2026
fb6c996
docs: clarify native cost pagination stop
ibetitsmike Aug 4, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
docs: document native cost migration
  • Loading branch information
@ibetitsmike
ibetitsmike committed Aug 4, 2026
commit 2eb64d5dfa892ae01a12dd3c446f610abb77f5fa
6 changes: 5 additions & 1 deletion docs/ai-coder/agents/platform-controls/spend-management.md
View file
Open in desktop

@nickvigilante nickvigilante Aug 3, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As a total aside, I was confused when I tried to search for "usage insights" in the docs, and I had to go to manifest.json to figure out that the page's title is actually "Spend management" now. Should we rename and redirect this page? Is "Spend management" closer to what we want to convey for this page? If so, the URL should also be updated.

@ibetitsmike ibetitsmike Aug 3, 2026

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Accepted the rename in 533779f7cf8: the page is now spend-management.md, and the manifest plus all in-repo links use the new path. The public redirect from the old URL must be added to coder/coder.com's redirects.json, so I am leaving this thread open until that companion change lands.\n\n> Mux applied this feedback on Mike's behalf.

@ibetitsmike ibetitsmike Aug 3, 2026

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nick, could you add the companion redirect in coder/coder.com? The coder/coder rename and link updates are already pushed.

{"source":"/docs/ai-coder/agents/platform-controls/usage-insights","destination":"/docs/ai-coder/agents/platform-controls/spend-management","permanent":true}

Mux posted this request on Mike's behalf.

@nickvigilante nickvigilante Aug 3, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done — companion redirect is up in coder/coder.com#1001, and I've added you as reviewer there. It adds the permanent /docs/ai-coder/agents/platform-controls/usage-insights → /docs/ai-coder/agents/platform-controls/spend-management redirect.

I flagged on that PR that it should not merge until this one lands, so we don't redirect the still-live page to a path that doesn't exist yet. Leaving this thread open until both merge.

@nickvigilante nickvigilante Aug 3, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PR here for your review: https://github.com/coder/coder.com/pull/1001

Original file line number Diff line number Diff line change
Expand Up @@ -23,8 +23,12 @@ $1,000,000 per member per period.
> Budget controls in the Coder UI, the group budget endpoints (`/api/v2/groups/{group}/ai/budget`), and the AI spend status and reporting endpoints all require the AI Gateway entitlement.
> No experiment is needed.
>
> Native chat usage limits are removed from the application.
> Native chat usage limits and native cost tracking are removed from the application.
> Existing native limit values are not migrated to AI Gateway budgets and are no longer enforced.
> Configured per-model prices and historical native cost totals are also not migrated to AI Gateway.
> Before upgrading, record any per-model prices you need from **Admin settings** > **AI** > **Models**, and save responses from `/api/experimental/chats/cost/users` and `/api/experimental/chats/cost/{user}/summary` if you need historical native cost reports.
Comment thread
ibetitsmike marked this conversation as resolved.
Outdated
> After upgrading, the native **Spend** page, per-model pricing fields, and aggregate cost endpoints are unavailable.
> Historical `chat_messages.total_cost_micros` values remain in the database temporarily for rolling upgrade compatibility, but AI Gateway reports do not include or reconstruct them.
> Configure AI Gateway budgets separately.

The API reference documents how to [get](../../../reference/api/enterprise.md#get-group-ai-budget), [upsert](../../../reference/api/enterprise.md#upsert-group-ai-budget), and [delete](../../../reference/api/enterprise.md#delete-group-ai-budget) a group budget.
Expand Down