SEGREANT

How each figure is worked out, and what it can't tell you.

This page is the detail layer behind the site and the app. Formulas are named, measured claims link to the test that measures them, and anything the product doesn't yet offer says so.

Four kinds of number

List cost (estimate) is tokens priced at each provider's published list price, from a dated price list. Billed cost exists only once you import an invoice, a cost export, or (for OpenAI) pull the read-only Costs API, and Segreant compares the two by project and day. Allocated cost is spend divided by rules you write. Value (kept work) counts outcomes, not money.

The four are never merged or substituted. A calculation on your computer is never presented as your provider's bill, and a share of spend that reached kept work is never presented as a return or a productivity gain. The terms follow the FinOps FOCUS vocabulary (list cost, billed cost) so they can be read beside a finance team's own reports.

Older requests without a verified exact price keep an "unknown" marker. Segreant never fills one in from context.

Kept work

Each commit passes through eight checks in order: proposed by the AI, accepted (at least 60% of the suggestion kept), committed, tested, merged, shipped, survived (at least half its lines still in the code) and clean (no incidents). Work is judged 14 days after it is committed; until then it is too early to tell.

A check can be passed, failed, not tracked (Segreant can't see it, so it is never counted as passed) or conflicted (two sources disagree, for example a deploy reported success and a rollback reported failure). Conflicted never counts as passed, and the disagreement stays visible. Every report states how many checks were tracked.

Kept-work rate is the share of judged work that passed every tracked check, counted in units of work rather than dollars. First-pass acceptance is how much of the AI's proposed change you kept; only a tool in the request path can see it, and it measures collaboration, not outcome.

The $610 is spend that went into kept work. It is a cost, not a measure of what the work was worth.

Value score

Four measures, each scaled 0 to 1: did the work stick (realization), did you keep what the AI gave you (acceptance), did it save time (lift, measured from session timing, never self-reported, and always a range) and did it matter (impact: reached production, how much it touched, incident-free). They are combined as a weighted geometric mean:

score = 100 · exp( Σ wᵢ ln xᵢ / Σ wᵢ )

Unlike an average, a low measure pulls the whole score down, so one strong result can't hide a weak one. That makes the score harder to game along a single measure. It doesn't make gaming impossible, which is why the change alert exists.

A measure you don't track is shown as missing, never scored as a pass. With measures missing, the score is reported as a range, for example "somewhere between 0 and 64", and segreant roi names the measure whose absence widens it most. That line says which measurement would matter most; it is not advice to buy anything.

Value figures describe what was observed. They don't show that AI caused the result: that needs a randomized study, and Segreant's study tools currently inspect retained studies only.

A 95% range you can check at any time

An ordinary confidence interval is valid if you look once, at a sample size fixed in advance. Dashboards are watched continuously, and every extra look adds a chance of being wrong. Segreant's kept-work rate carries a confidence sequence: a range built so that its guarantee holds at every look, whenever you stop. The cost is width, about 1.5 to 2 times an ordinary interval, and Segreant shows that width rather than hiding it.

Measured: checking after every observation, an ordinary 90% interval was wrong at some point in 63.8% of simulated runs; the 90% confidence sequence in 6.0%, inside its 10% budget. segreant roi reports 95% ranges.

Method: RETURN-ON-INTELLIGENCE.md §10 · Test: test/anytime.test.ts (simulated-peeking coverage test)

Change alert

The alert watches whether your kept-work rate has stopped being steady. It compares a forecaster that only ever sees the past with the best single steady rate chosen in hindsight; when the forecaster wins by enough, the alert fires. Its false-alarm rate is bounded over all time, not per look.

It detects that the rate moved, not why. A new model, a new workflow and a gamed number all set it off; telling them apart takes evidence the rate doesn't carry. "No change alert fired" means that, and not that nothing changed.

Measured: false alarms 0.2% against a 5% budget across three steady rates; an abrupt collapse caught in 100 of 100 runs; a slow drift caught in 93 of 100.

Method: RETURN-ON-INTELLIGENCE.md §11 · Test: test/drift.test.ts

Receipts

A value receipt is a canonical record of one unit of work: its cost, each check's result and the outcome, signed with an ed25519 key. Verifying it answers two questions. Intact: has any byte changed since signing? Authentic: was it signed by the key you expected, which you pin yourself?

It answers nothing else. A faithfully signed wrong number verifies perfectly. Whether the checks inside were right rests on the tests, deploys and history that produced them, and the cost inside is list cost unless it says otherwise.

Not offered

Not offered A "shadow price" for the next AI dollar. Earlier versions of this site advertised a figure, μ = β·V*/B, said to show whether one more dollar of AI spend would return more than a dollar. Segreant doesn't offer it. The formula needs the dollar value of the work, and Segreant measures what work cost, not what it was worth; fed with kept spend, μ can essentially never reach 1. No screen or command shows it, and segreant budget --recommend --json reports it as null.

Not offered A promised saving. What you save depends on how much waste there was to find.

Not offered Proof that AI caused a result. See the note under the value score.

The full, current list of what is supported, intended and not offered is in CAPABILITY-EVIDENCE-CONTRACT.md, and what can leave your computer is in DATA-BOUNDARIES.md.