Workflow Intel

Triage queue

Workflows

token-efficiency

ttok 1.0

Simon Willison's Weblog (LLM / AI engineering) · Oct 9, 2026

WAITModel: ARCHIVE
ev1cred2dur1com0cmp2app2

Claim: ttok 1.0 ships with GPT-5/GPT-6 as default tokenizer; experiments show GPT-6 variants match GPT-5 family tokenization

Evidence: William Liu experiment across seven GPT models (5.5, 5.6 Sol/Terra/Luna, 6 Astra/Sol/Luna) showing identical token counts (44,794) on 31 fixtures; commit referenced but not linked; author notes OpenAI has not officially confirmed tokenizer parity

Rationale

ttok is a tokenizer utility that Timothy's monorepo may use for token budgeting, making it applicable to his stack. However, evidence is anecdotal (one experiment from a third party, no official OpenAI confirmation, no reproducible test suite linked). Durability is low because tokenizer defaults are volatile across model releases—the 1.0 bump is reactive, not structural. The release is maintenance-driven, not a capability uplift. No real hype. Source baseline held at 2 (plausible indie project).

WAITModel: TRACK
ev1cred2dur1com1cmp2app3

Claim: LegalOn reduced daily Codex costs by 65% while maintaining development speed through strategic model matching (Astra, Sol, Luna) and budget management.

Evidence: Stated 65% cost reduction; mention of model-matching strategy (Astra, Sol, Luna assigned to tasks); no before/after metrics, no ablation, no reproducible methodology disclosed.

Rationale

Direct relevance to Timothy's Codex-heavy workflow and token spend. Credibility downgraded from 3→2 because the claim is unverified—no reproducible numbers (pre/post comparison, methodology, workload specs) and no published case study cited. "Halves" is unquantified superlative framing (actual claim is 65%, a different figure). Strategy (model matching) is plausible but not detailed enough to assess durability or reproduce. High applicability (token-efficiency, CC+Codex stack) justifies TRACK pending concrete evidence or adoption within Timothy's workflow.

ev1cred2dur0com0cmp1app2

Claim: Claude Fable 5.1 is up to 45% cheaper for agentic work; GPT-6 Astra is state-of-the-art at computer use, browser navigation, and coding.

Evidence: Anthropic claims 45% cost reduction for Fable 5.1 on agentic tasks (unquantified benchmark or use case not specified); OpenAI cites benchmark scores and phased rollout to Daybreak clients, ChatGPT Plus/Pro/Business/Enterprise; anecdotal task examples (DMV booking, job search, apartment hunting faster than average person).

Rationale

Fable 5.1 cost claim (45%) is headline-attractive but lacks granularity—which agentic tasks, which workload baseline, which models compared?—and evidence is unverified; GPT-6 Astra benchmarks and anecdotes are unquantified (no reproducible signal, no ablation). Durability is zero: next-gen Claude or GPT release will erode both cost advantage and computer-use superiority. Applicability is moderate: Timothy's CC+Codex loop on TS/Supabase does touch agentic work and token spend, but no concrete detail on how Fable 5.1's cost structure or Astra's computer-use capability changes Timothy's workflow—these are platform-level moves, not stack-specific. Source is a newsletter aggregator (tier 2), not a primary vendor document. No commoditization signal. TRACK to revisit once real-world cost/latency numbers emerge from Timothy's tests or from published benchmarks."

Initial impressions of Claude Fable 5

Simon Willison's Weblog (LLM / AI engineering) · Jun 9, 2026

WAITModel: TRACK
ev2cred2dur1com0cmp2app3

Claim: Claude Fable 5 is a frontier model with substantially larger capacity than Claude Opus 4.8, demonstrated by superior performance on knowledge recall tasks, priced at 2x Opus and available across all Anthropic surfaces.

Evidence: Direct hands-on testing over ~5.5 hours; knowledge comparison showing Fable 5 listing 20+ open-source projects by Simon Willison versus Opus 4.8's more cautious response with ~6 named projects; pricing data ($10/M input, $50/M output vs. implied lower Opus rate); 1M token context window, 128k max output tokens, January 2026 knowledge cutoff; author observation of speed/cost trade-off consistent with larger model; availability across Claude.ai, Code CLI, Codex integrations cited.

Rationale

Credible hands-on testing with concrete examples (knowledge task comparison), pricing/spec details, and cross-surface deployment facts. However, model size itself is inferred from behavior ("tea-leaves"), not official capacity numbers. Anthropic's official claim is only that Fable 5 matches Mythos 5 capabilities with stricter guardrails — the "larger model" framing is the author's inference. No reproducible ablation or controlled benchmark. Source (Simon Willison) is credible (tier 2 baseline held), but the evidence here is anecdotal comparison + pricing, not quantified benchmark suite.