arXiv:2606.15954 – Green SARC: Predictive Cost and Carbon Governance for Agentic AI Systems
Note: This post describes a (still) non-peer-reviewed preprint on arXiv. The results mentioned have not yet been independently verified by the scientific community.
What is it about?
AI agents that autonomously call tools, delegate sub-tasks to other agents, and execute multi-step plans incur costs that are difficult to estimate in advance: each additional tool call or sub-step can trigger further model calls. Gaston Besanson describes in an arXiv preprint that the usual control mechanisms for such costs – such as monitoring dashboards or retrospective policy checks – only kick in once the corresponding tokens have already been spent. If a budget is exceeded, that can only be established afterwards, not prevented.
The paper proposes a framework called Green SARC, which applies a previously described “governance-by-architecture” principle – control built directly into the system architecture rather than enforced retrospectively through rules – to two specific areas: FinOps (cost control) and GreenOps (carbon control) for agent systems.
What is it good for / what does it bring?
The practical benefit lies in reliably keeping AI agents within financial and ecological budgets, rather than merely logging overruns after the fact. If a company sets a monthly cost or carbon budget for an agent system, Green SARC is meant to ensure that individual actions simply aren’t executed if they are likely to blow that budget – instead of only finding out afterwards.
A central result of the study: under a binding budget, the proposed gate keeps the overrun rate close to zero on both synthetic and real request data (under the name BurstGPT), while a classic soft cost penalty – calibrated to hit the budget in expectation – exceeds the budget in the large majority of test runs. Depending on the configuration, the overall system also meaningfully reduces token consumption, cost, and carbon emissions; the author explicitly notes, however, that the size of these savings depends mainly on a separately set cap on context size, not on the gate mechanism itself.
How does it work (simplified)?
Green SARC intervenes at four points in an agent’s loop. First, a prediction gate before each action: a learned, calibrated model estimates how many tokens or how much carbon the next action is likely to cost, and only admits it if that estimate fits the remaining budget with high statistical confidence. Second, a monitor during execution that acts like a circuit breaker, cutting off infinite loops or runaway action chains. Third, an auditor after each action that compares predicted and actual cost and feeds that difference back as a training signal so the estimator improves over time. Fourth, an escalation router that redirects tasks to simpler fallback procedures once the budget is exhausted, instead of simply aborting them.
The central technical contribution concerns the prediction gate: instead of relying on fixed rules or an assumption of normally distributed costs, Green SARC uses a so-called split-conformal method – a statistical confidence procedure that makes no assumptions about how actual costs are distributed. According to the paper, this method provides a mathematical guarantee that the probability of a single approved action breaching the budget stays below a threshold fixed in advance. On real chat transcripts (from a dataset called ShareGPT), whose cost distribution is markedly skewed and not normally distributed, this method actually delivers on that guarantee, while a simpler method based on a normal-distribution assumption noticeably undershoots the intended coverage in the same tests.
On the question of how the cost of multi-step agent plans scales with the number of steps, the paper also derives a model predicting quadratic growth whenever each step reprocesses the entire prior history – termed the “State Snowball” in the paper. An evaluation of 3,000 real multi-step plans (from a dataset called SWE-rebench) confirms this pattern consistently, with the observed cost growth even exceeding the theoretical prediction. A chart of this relationship appears as Figure 1 in the HTML version of the paper; an overview of the calibration and budget-adherence results is shown in Figures 2, 6, and 11 there.
Classification & limitations
The author names several limitations himself. The gate’s statistical guarantee assumes the cost distribution doesn’t fundamentally shift over time; if it does (for example due to changing usage patterns), the paper states that a not-yet-fully-developed method for ongoing adaptation would be needed. The current implementation also assumes a single process – a distributed, production-ready variant is announced as future work but not yet built. The carbon estimate used is a simplified linear model that, in the author’s own assessment, tends to underestimate the true marginal cost of very long contexts. And capping context size to save cost can, in extreme cases, prevent agents from reliably completing their actual task – a trade-off the paper openly describes as steep between savings and task success.
Overall, this is an internally consistent concept study by a single author, backed by several real datasets – not a system that has been proven at scale in production. The accompanying software library is, according to the author, open source and ships with a script to reproduce every reported figure, which should make independent scrutiny easier.
