[token-consumption] Daily AIC Consumption Report - 2026-10-07 #66541

Executive Summary

• Total AIC: Not queryable — no recognized AIC attributes (gh-aw.aic, gh_aw.aic, agent_usage.aic, aic) were found on any Sentry span/event in the last 24h.
• Workflow count: Not derivable from AIC data; span/transaction metadata shows multiple gh-aw workflow runs (gh-aw.activation.setup, several gen_ai.chat spans across models: copilot/claude-sonnet-5, copilot/gpt-5.4, copilot/gpt-6-astra, claude-haiku-4.5, openai/gpt-5.6-sol, generic agent).
• Sentry AIC queryable? No — confirmed absent on all sampled spans (gen_ai.chat, http.server, default).
• Grafana AIC queryable? Unknown/unconfirmed — the Tempo TraceQL query tools (tempo_get-attribute-names, tempo_traceql-search, tempo_get-trace) described in the task instructions were not available as callable tools in this session; only list_datasources/get_datasource were available, which confirmed a Tempo datasource (grafanacloud-ghaw-traces, uid grafanacloud-traces) exists but AIC presence could not be directly verified.

Key Metrics

Top 10 Workflows by AIC Consumption

Not available — no events carried AIC or workflow-attribution fields in the sampled data. Observed gen_ai.chat span counts by model (not AIC, just event counts) for visibility only:

Grafana AIC Findings

Grafana AIC is not confirmed queryable in this run.

• list_datasources(type=tempo) succeeded and returned one Tempo datasource: grafanacloud-ghaw-traces (uid grafanacloud-traces), confirmed via get_datasource.
• The TraceQL/Tempo query tools required by the task (tempo_get-attribute-names, tempo_traceql-search, tempo_get-trace) were not present among the tools available to this agent session — only list_datasources and get_datasource were callable. This is a tooling/MCP-server-exposure gap in this run, not a confirmed data gap in Tempo itself.
• No trace-level evidence of AIC attributes could be gathered from Grafana as a result.
• Grafana base URL may be redacted in safe-outputs rendering; datasource UID grafanacloud-traces is provided above for reference.

Recommendations

1. Instrument AIC emission on spans: Confirm the OTLP span emitter (actions/setup/js/send_otlp_span.cjs) actually sets a numeric gh-aw.aic (or equivalent) attribute on gen_ai.chat/gen_ai.execute_tool spans. Current data suggests this attribute is either not emitted or not indexed/searchable in Sentry EAP.
2. Add workflow attribution attributes: Ensure spans carry github.workflow (or gh_aw.workflow) consistently so future reports can aggregate AIC by workflow instead of falling back to generic transaction names like default/gateway.request.
3. Restore/verify Tempo MCP tool availability: The Grafana extension in this environment only exposed list_datasources/get_datasource; tempo_traceql-search and related tools should be enabled so Grafana-side AIC cross-checks are possible in future runs.
4. Re-run with search_events enabled: If an embedded LLM provider becomes configured for the Sentry MCP server, re-run this report using search_events for richer natural-language AIC aggregation and to double check the list_events fallback findings.

References

• Sentry traces (24h, all spans): https://github.sentry.io/explore/traces/?query=&project=4511347087179777&field=id&field=span.op&field=span.description&field=span.duration&field=transaction&field=timestamp&field=project&field=trace&sort=-timestamp&statsPeriod=24h&table=span
• Sentry traces (span.op:ai*, 0 results): https://github.sentry.io/explore/traces/?query=span.op:ai*&project=4511347087179777&field=id&field=span.op&field=span.description&field=span.duration&field=transaction&field=timestamp&field=project&field=trace&sort=-timestamp&statsPeriod=24h&table=span
• Sentry errors (24h, 0 results): https://github.sentry.io/explore/discover/homepage/?dataset=errors&queryDataset=error-events&query=&project=4511347087179777&field=issue&field=title&field=project&field=timestamp&field=level&field=message&field=error.type&field=culprit&sort=-timestamp&statsPeriod=24h&yAxis=count%28%29
• Grafana Tempo datasource (gh-aw traces): uid grafanacloud-traces, name grafanacloud-ghaw-traces

Generated by 📊 Daily AIC Consumption Report (Sentry + Grafana OTel) · goose · sonnet50 · 28.9 AIC · ⌖ 8.24 AIC · ⊞ 11.2K · ◷

• expires on Oct 8, 2026, 3:59 AM UTC-08:00