Skip to content

chore(models): price the November catalog additions - #211

Merged
pierreraby merged 1 commit into
mainfrom
chore/pricing-2026-11-11
Nov 11, 2026
Merged

pierreraby merged 1 commit into
mainfrom
chore/pricing-2026-11-11

Conversation

@pierreraby

Copy link
Copy Markdown
Collaborator

What changed

/provider/v1/models advertised 97 models on 2026-11-11 (was 96 on 2026-11-09). Three of them had no reviewed price, so pi displayed a zero estimate plus an unknown-price warning on every request using them, and the daily catalog workflow failed its pricing gate twice — runs 42838424841 (2026-11-10) and 43037482750 (2026-11-11) — which reopened the maintenance incident #207.

Reviewed against https://commandcode.ai/docs/resources/pricing-limits (page column order is context, input, output, cache read, cache write; a — column means 0):

Model Context Input Output Cache read Cache write Endpoints
claude-fable-5-2 1M 8.00 40.00 0.20 10.00 /messages
google/gemini-4-carbon 1M 2.00 10.00 0.10 — /chat/completions, /responses
meta/muse-ember 1M 0.10 0.50 0.004 — /chat/completions, /responses

None of the three rows carries an "Available on …" plan note. The page states single published rates, so no tiers and no TEMPORARY_PRICING entry are involved.

  • Add the three MODEL_COSTS entries and bump PRICING_LAST_VERIFIED to 2026-11-11.
  • Remove the zero prices for stealth/crouton-alpha and reflection/beam:free: both left the advertised catalog before this refresh, and MODEL_COSTS is asserted to cover the snapshot exactly.
  • Regenerate both fixtures with the documented skill scripts (refresh-model-ids.mjs, sync-pricing-fixture.ts) and refresh the test expectations: the free-model set now contains only stealth/glyph-cluster:free, the retired previews are asserted absent, and a new block pins the three November rates.

Verification

  • npm run check:commandcode-pricing → Status: PASS, no pricing drift, 97 models checked. Before this change the same command exited 1 with the three missing-local-price rows, matching the failing scheduled runs.
  • npm run check:commandcode-catalog → metadata current, command-code@1.88.5, 75/85/70/11 counts unchanged.
  • Red/green on npm run test:pricing: with the previous src/pricing.ts and the refreshed fixtures, 6 assertions fail (claude-fable-5-2 should have pricing, …); with this change, 14/14 pass.
  • npm run test:pricing-check 47/47, npm run test:models 19/19, npm run typecheck, npm run typecheck:entrypoint against real Pi 1.5.2 (PASS — index.ts and host-boundary contracts), npm run format:check, git diff --check.
  • Full npm test with PI_LOCAL_REQUIRED=1 OMP_COMPAT_REQUIRED=1 against real hosts (Pi 1.5.2, Oh My Pi 18.18.3, bun 1.4.4) passed, including all three protocol contracts on both hosts and the endpoint-routing scenarios.

Limits

  • No live account login or billable inference was performed; display prices are reviewed from the public page, and the Command Code Usage page remains authoritative per request.
  • Static capability metadata is unchanged at command-code@1.88.5, so the three new models stay text-only without reasoning or effort flags even though the page lists vision/reasoning for claude-fable-5-2. That is catalog work for a future upstream release, not part of this refresh.
  • The historical HTML pricing fixture is not regenerated, as in previous refreshes; no assertion reads it.

The Provider API advertised 97 models on 2026-11-11, up from 96 on
2026-11-09. Three additions had no reviewed price, so every request
reported a zero estimate and an unknown-price warning, and the daily
catalog workflow failed its pricing gate twice (runs 42838424841 and
43037482750), reopening the maintenance incident #207.

Add reviewed rates from the official pricing page for claude-fable-5-2
(8.00/40.00/0.20/10.00), google/gemini-4-carbon (2.00/10.00/0.10, no
cache-write charge) and meta/muse-ember (0.10/0.50/0.004, no cache-write
charge). Drop the zero prices for stealth/crouton-alpha and
reflection/beam:free, which the API no longer advertises, and refresh
both snapshots to 2026-11-11.

Static capability metadata stays at command-code@1.88.5, so the three
new models keep text-only input without reasoning or effort flags.
@github-actions

Copy link
Copy Markdown
Contributor

Dependency Review

✅ No vulnerabilities or license issues or OpenSSF Scorecard issues found.

Scanned Files

None

@github-actions

Copy link
Copy Markdown
Contributor

Memory benchmark

Compared base e8ebc6e with PR head 7cccad0 on the same GitHub-hosted darwin runner. Lower values are better.

Metric Base PR PR − Base Change
Stable RSS 107.8 MiB ± 0.8 MiB 107.5 MiB ± 0.8 MiB -0.0 MiB ± 1.0 MiB -0.0%
Physical footprint 62.1 MiB ± 0.4 MiB 62.2 MiB ± 0.3 MiB +0.3 MiB ± 0.5 MiB +0.5%
Physical peak 74.6 MiB ± 0.8 MiB 75.0 MiB ± 0.8 MiB +0.3 MiB ± 0.8 MiB +0.4%

Interpretation: No metric shows a clear Base-to-PR difference beyond its measured run-to-run variation.

Extension overhead above pi baseline

Metric Base overhead PR overhead Difference
Stable RSS +5.3 MiB ± 1.8 MiB +5.9 MiB ± 0.6 MiB -0.0 MiB ± 1.0 MiB
Physical footprint +3.2 MiB ± 1.0 MiB +3.1 MiB ± 0.2 MiB +0.3 MiB ± 0.5 MiB
Physical peak +3.5 MiB ± 1.8 MiB +4.7 MiB ± 1.0 MiB +0.3 MiB ± 0.8 MiB

Values are medians of 6 alternating, paired runs. The value after ± is the median absolute deviation (MAD). Each process was sampled 12 times after a 2500 ms warm-up.

Environment: pi 0.84.4, Bun 1.4.4, darwin arm64. RSS comes from ps; physical footprint and peak come from macOS footprint.

This is a comparative signal, not a pass/fail threshold. GitHub-hosted runner noise can affect absolute values.

@pierreraby
pierreraby merged commit 5542515 into main Nov 11, 2026
15 checks passed
@pierreraby
pierreraby deleted the chore/pricing-2026-11-11 branch November 11, 2026 21:25
pierreraby added a commit that referenced this pull request Nov 11, 2026
Ship the reviewed November pricing from #211 to npm users. The Provider
API advertised three unpriced models (claude-fable-5-2,
google/gemini-4-carbon, meta/muse-ember), so 0.8.1 reported a zero
estimate and an unknown-price warning for them and the daily catalog
workflow failed its pricing gate, reopening #207.

The changelog section records the new rates, the removed
stealth/crouton-alpha and reflection/beam:free entries, and the fact
that static capability metadata stays at command-code@1.88.5.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant