Workflow Intel

Triage queue

Workflows

token-efficiency

ADOPT-CHEAPModel: TRACK
ev1cred3dur2com1cmp1app2

Claim: Asana achieved 76x cost reduction and 5x speedup in browser agent tests by switching to GPT-6 Astra in Codex.

Evidence: Stated performance metrics (76x cheaper, 5x faster) from Asana in browser agent tests; no ablation, reproducibility details, or baseline model named.

Rationale

Asana is credible, and model cost/speed improvements matter to Timothy's token budget. However, the claim lacks baseline detail (what model, what task size, what metric threshold), reproducibility steps, or third-party verification. Browser agent costs are tangential to Claude Code + Codex agentic workflow; applicability is moderate. The "76x" and "5x" are unquantified superlatives without context. Track for broader model-efficiency signal, but do not invest until Asana publishes reproducible methodology or this pattern is validated in the CC/Codex stack.

ttok 1.0

Simon Willison's Weblog (LLM / AI engineering) · Oct 9, 2026

WAITModel: ARCHIVE
ev1cred2dur1com0cmp2app2

Claim: ttok 1.0 ships with GPT-5/GPT-6 as default tokenizer; experiments show GPT-6 variants match GPT-5 family tokenization

Evidence: William Liu experiment across seven GPT models (5.5, 5.6 Sol/Terra/Luna, 6 Astra/Sol/Luna) showing identical token counts (44,794) on 31 fixtures; commit referenced but not linked; author notes OpenAI has not officially confirmed tokenizer parity

Rationale

ttok is a tokenizer utility that Timothy's monorepo may use for token budgeting, making it applicable to his stack. However, evidence is anecdotal (one experiment from a third party, no official OpenAI confirmation, no reproducible test suite linked). Durability is low because tokenizer defaults are volatile across model releases—the 1.0 bump is reactive, not structural. The release is maintenance-driven, not a capability uplift. No real hype. Source baseline held at 2 (plausible indie project).

WAITModel: TRACK
ev1cred2dur1com1cmp2app3

Claim: LegalOn reduced daily Codex costs by 65% while maintaining development speed through strategic model matching (Astra, Sol, Luna) and budget management.

Evidence: Stated 65% cost reduction; mention of model-matching strategy (Astra, Sol, Luna assigned to tasks); no before/after metrics, no ablation, no reproducible methodology disclosed.

Rationale

Direct relevance to Timothy's Codex-heavy workflow and token spend. Credibility downgraded from 3→2 because the claim is unverified—no reproducible numbers (pre/post comparison, methodology, workload specs) and no published case study cited. "Halves" is unquantified superlative framing (actual claim is 65%, a different figure). Strategy (model matching) is plausible but not detailed enough to assess durability or reproduce. High applicability (token-efficiency, CC+Codex stack) justifies TRACK pending concrete evidence or adoption within Timothy's workflow.

Claude Haiku 5.5

Simon Willison's Weblog (LLM / AI engineering) · Oct 7, 2026

ADOPT-CHEAPModel: TRACK
ev3cred2dur2com1cmp1app2

Claim: Claude Haiku 5.5 is a new fast, low-cost model from Anthropic with improved pricing, reasoning capabilities, and token efficiency compared to Haiku 4.5; includes new API credit scheme for subscribers.

Evidence: Concrete pricing data ($0.10/$0.50 base, $0.50/$2.50 at 100k+ tokens); tokenizer efficiency measurement (1.25x token increase vs Haiku 4.5); reproducible test results (pelican SVG generation with cost and latency data across reasoning effort levels); API credit announcement with specific values ($100–$500/month for subscribers); cache price cut quantified (halving); tool compatibility noted (llm-anthropic plugin updates).

Rationale

Real model release with quantified pricing, benchmarks, and token-cost data. Durability: 2 because pricing and tokenizer tuning may shift with future releases, but the model itself survives. Applicability: 2 because Haiku 5.5 could reduce token spend in Timothy's Claude Code–driven workflow IF he switches from higher-tier models for fast, cheap inference, but the item does not demonstrate direct relevance to CC/Codex orchestration or the TS/Supabase/Vercel stack—it is primarily a pricing/capability comparison for a different tier. Composition_specificity: 1; this is a model release, not a stack-defining pattern or infrastructure capability. Commoditization_risk: 1; no third-party tooling or vendor is poised to productize Haiku 5.5 itself (it's already a product); the API credits are Anthropic's own scheme, not a signal of external tooling adoption. Evidence is strong and reproducible (cost tests, token counts, direct API results). No hype markers: all superlatives are grounded in measurements.

ADOPT-CHEAPModel: TRACK
ev1cred2dur2com0cmp1app2

Claim: Anthropic and OpenAI are racing to release smarter and cheaper models; specific releases include Claude Opus 5.5, Sonnet 5.5, GPT-6 Sol, Luna, and GPT-6.1 Sol.

Evidence: Newsletter item cites TechCrunch and The Verge articles about five named model releases (Claude Opus 5.5, Sonnet 5.5, GPT-6 Sol, Luna, GPT-6.1 Sol) claiming cheaper cost and faster performance. Article dates in the citations (Sept 22–29, 2026) fall within the plausible future release window relative to today's date (June 10, 2026).

Rationale

Newsletter curation of model releases with no numbers, ablations, or reproducible benchmarks. Claims of "cheaper" and "faster" are stated without token cost, latency, or accuracy deltas. Moderate applicability: Timothy's CC+Codex loop would benefit from cheaper inference, but the snippet provides no data to assess actual savings or suitability for his monorepo stack. Source credibility remains at baseline (newsletter curating third-party sources); the item itself is an aggregation without primary evidence. Durability medium because pricing and capability are subject to rapid model iteration. Hype markers: "race" (unquantified competitive framing) and "smarter" (no benchmark detail). Not investable yet; requires follow-up on actual cost/performance tradeoffs."

Introducing GPT-6.1 Sol

OpenAI — News · Sep 29, 2026

ADOPT-CHEAPModel: TRACK
ev1cred3dur2com0cmp2app2

Claim: GPT-6.1 Sol offers near-Astra-level intelligence for coding, computer use, and professional work at one-fifth of Astra's token prices.

Evidence: Product announcement text stating pricing tier and claimed capability parity.

Rationale

Credible source (OpenAI announcement baseline = 3), but core claim is unquantified assertion: "near-Astra" is marketing language without benchmarks, ablations, or reproducible testing. Price claim (1/5) is concrete but unverified. Applicability is moderate — if real and reproducible on Timothy's CC+Codex stack, token spend cuts directly matter; but no evidence yet that Sol outperforms or integrates better than current workflows. Durability moderate: a price tier survives model upgrades but "near-Astra parity" will erode as Astra improves. Hype markers: unquantified "near" claim and price-framing superlative. Track to validate empirically before committing.

S3 Is the Future, S3 Is the Past

Simon Willison's Weblog (LLM / AI engineering) · Sep 27, 2026

ADOPT-CHEAPModel: ARCHIVE
ev2cred2dur3com1cmp1app2

Claim: S3 storage pricing has not dropped in a decade; it has remained flat at $0.023/GB-month since December 2016.

Evidence: Historical pricing timeline: 2006 ($0.150/GB-month) → 2010 ($0.140) → 2012 ($0.125, then $0.095) → 2014 ($0.085, then $0.030) → 2016 ($0.023) → present ($0.023). No price change cited between Dec 2016 and present (June 2026).

Rationale

Factual observation (pricing data are verifiable; no price drop in 10 years is notable for cost planning) with moderate applicability to Timothy's Supabase+Vercel stack (storage cost is a minor factor in agentic TS workflows, not a bottleneck lever). Evidence is historical numbers, not forward-looking. Hype marker: the title is a rhetorical flourish ("Future/Past") but the core claim is data-driven. Not actionable for workflow optimization; archive as context.

Claude Opus 5.5, GPT-6 Sol, GPT-6 Luna, and a new price war

Simon Willison's Weblog (LLM / AI engineering) · Sep 22, 2026

TRACK
ev2cred2dur2com3cmp2app3

Claim: Claude Opus 5.5, GPT-6 Sol, and GPT-6 Luna represent a new pricing-driven commodity tier; GPT-6 Luna at $0.10/$0.50 is half the price of GPT-5.6 Luna and among the cheapest models ever released; Claude Opus 5.5 shows 20% input reduction and 60% cached-token reduction, addressing communication weaknesses; "max" reasoning level on Opus 5.5 over-thinks and fails on complex tasks.

Evidence: Concrete pricing table comparing GPT-6 Sol ($2/$10), GPT-6 Luna ($0.10/$0.50), Claude Opus 5.5 ($4/$20), GPT-5.6 equivalents, and earlier models; author's reproduction of the "pelican riding bicycle" SVG generation test across models with explicit output token failure (128k limit hit) and timing ($2.56, ~20 minutes per failure); author states using GPT-6 Sol and Claude Opus 5.5 as default models in Codex/Claude Code workflow.

Rationale

Directly applicable to Timothy's Claude Code + Codex workflow: author explicitly tests on the same stack (Codex, Claude Code) and now uses GPT-6 Sol and Opus 5.5 as defaults. GPT-6 Luna's $0.10/$0.50 pricing vs. GPT-5.6 Luna's $0.20/$1.20 cuts input costs by 50% and output by 58%—material for token-efficiency and agentic conversation patterns with high cache hit rates. The concrete failure case (Opus 5.5 "max" hitting 128k output limit on a simple task, costing $2.56) and the pricing table (verified across multiple vendors and version tiers) provide reproducible signal, not anecdote. Commoditization is already happening (release just happened, pricing war is live). Durability moderates because future model releases or prompt engineering tweaks may change the "max" over-thinking pathology, but the pricing tier itself is durable for at least one product cycle. Composition_specificity is moderate—pricing competitiveness matters to any agentic workflow, but no novel architectural pattern or infrastructure is required; Timothy switches models, not rewires. Source_credibility remains at baseline (2): this is a well-structured observational piece with real numbers and reproduction, but no independent verification and authored by a user sharing their experience, not a vendor release or peer-reviewed benchmark.

Transformers now runs llama.cpp quants

Hugging Face — Blog · Sep 22, 2026

ADOPT-CHEAPModel: TRACK
ev1cred2dur2com1cmp2app2

Claim: Transformers library now supports running llama.cpp quantized models

Evidence: llama.cpp quantization formats (GGUF, etc.) can now be loaded and run via the Transformers library's model loading pipeline, reducing the need for separate inference engines

Rationale

Bare assertion with no linked PR, release notes, or version number. Credibility downgraded from 3 to 2 due to lack of verifiable source reference. If real, moderately relevant to Timothy's monorepo (reduces external dependency for quant inference), but applicability is capped by uncertainty whether this integrates cleanly with CC+Codex orchestration. Durability moderate—feature may deepen but the underlying quant format stability is structural. Token-efficiency category, not orchestration, since it's about model loading, not workflow composition. TRACK pending confirmation of actual release/PR.

Jev introduces a new shape of LLM - System One, aka Decision Models

Simon Willison's Weblog (LLM / AI engineering) · Sep 21, 2026

ADOPT-CHEAPModel: TRACK
ev2cred2dur2com1cmp1app2

Claim: Jev (TypeSafe AI's "System One" / decision model) is a new LLM variant that outputs probabilistic decisions rather than text, priced at $0.042/M tokens input-only, enabling fast classification tasks like spam detection, ranking, and reranking at dramatically lower cost than traditional LLMs.

Evidence: Product launch details: Jev accepts text/semi-structured "state" inputs and returns floating-point confidence scores for yes/no ("Noul"), choice, and numeric score questions. Pricing: $0.042/M input tokens vs. GPT-5 Nano at $0.05/M, output free. Parallel question evaluation. Community adoption signal: multiple open-source recreations (Kev using Qwen), jevchat/jev-leftpad/jev-2048 implementations, and JevBench benchmark within one week of launch. Documentation and API design details confirmed via TypeSafe and CEO HN commentary.

Rationale

Jev is a real product with documented pricing and API shape, but applicability to Timothy's CC+Codex/TS monorepo stack is situational: it cuts token spend (3¢ for hundreds of experiments) but only for classification/ranking tasks, not generation-heavy workflows. Durability depends on whether TypeSafe survives and the decision-model paradigm matures (credible risk of absorption or rotation to larger models). Commoditization risk is low (1) because no major vendor has signaled a competitive move yet, and the narrow output format is not an obvious feature roadmap item. Composition_specificity is low (1) because using Jev would be a tactical swap for specific subtasks (e.g., document classification, reranking), not a rebuild of the monorepo's foundation. The source (Simon Willison's blog) is credible (tier 2), and the evidence includes real pricing, launch details, and community activity, but no controlled ablations or large-scale production numbers — so evidence_strength = 2. No source_credibility downgrade needed; Willison accurately reports what he found. Track this as a potential win for token efficiency in narrow domains, but flag the black-box bias risk and lack of explainability as structural concerns for Timothy's workflow (evals become mandatory).

v2.1.278

Claude Code — Releases · Sep 19, 2026

ADOPT-CHEAP
ev2cred3dur2com0cmp1app2

Claim: Claude Code v2.1.278 defaults auto mode to server-side classifier (no classifier billing overhead) for Claude API and Enterprise users on Bedrock, Vertex, Foundry and gateways.

Evidence: Release notes specify: (1) auto mode now defaults to server-side classifier, (2) no charge for classifier overhead, (3) applies to Claude API, Enterprise, Bedrock, Vertex, Foundry, gateways, (4) opt-out via CLAUDE_CODE_AUTO_MODE_SERVER=0, (5) /status row added to show classifier location. Documentation link provided.

Rationale

Routine maintenance release with a genuine token-efficiency win (eliminates classifier token overhead) for Timothy's Claude Code + Supabase/Vercel stack. Auto mode is core to CC workflow, and zero-cost classifier is durable (structural, not model-limitation workaround). Specificity is low because this is a default-behavior tweak on existing infrastructure, not a new compose-around capability. Applicability is moderate: token spend reduction is always relevant, but the effect is incremental and automatic (no action needed unless opting out). No commoditization signal warranted—this is already a productized feature. No hype.

ev1cred2dur0com0cmp1app2

Claim: Claude Fable 5.1 is up to 45% cheaper for agentic work; GPT-6 Astra is state-of-the-art at computer use, browser navigation, and coding.

Evidence: Anthropic claims 45% cost reduction for Fable 5.1 on agentic tasks (unquantified benchmark or use case not specified); OpenAI cites benchmark scores and phased rollout to Daybreak clients, ChatGPT Plus/Pro/Business/Enterprise; anecdotal task examples (DMV booking, job search, apartment hunting faster than average person).

Rationale

Fable 5.1 cost claim (45%) is headline-attractive but lacks granularity—which agentic tasks, which workload baseline, which models compared?—and evidence is unverified; GPT-6 Astra benchmarks and anecdotes are unquantified (no reproducible signal, no ablation). Durability is zero: next-gen Claude or GPT release will erode both cost advantage and computer-use superiority. Applicability is moderate: Timothy's CC+Codex loop on TS/Supabase does touch agentic work and token spend, but no concrete detail on how Fable 5.1's cost structure or Astra's computer-use capability changes Timothy's workflow—these are platform-level moves, not stack-specific. Source is a newsletter aggregator (tier 2), not a primary vendor document. No commoditization signal. TRACK to revisit once real-world cost/latency numbers emerge from Timothy's tests or from published benchmarks."

Fwd: Reduce your Claude API costs

Anthropic (newsletter) · Jun 10, 2026

INVESTModel: ADOPT-CHEAP
ev2cred3dur3com0cmp2app3

Claim: Prompt caching, batch processing, smart model selection, and real-time usage monitoring can dramatically reduce Claude API costs.

Evidence: Official Claude Team email listing four concrete cost-reduction strategies: (1) prompt caching for repeated context, (2) batch processing offering 50% discount on input/output tokens, (3) model selection guidance (Haiku 4.5, Sonnet 4.5, Opus 4.1), (4) Claude Console reporting for usage tracking.

Rationale

Official Anthropic guidance on existing, documented features. Prompt caching and batch processing are mature API features already available; smart model selection is evergreen best practice. The "dramatically" framing is mild hype but the underlying claims are concrete and reproducible. High applicability: Timothy's CC/Codex monorepo on Next.js/Supabase likely has repeated context and can benefit from batch APIs and model downgrading. Durability is high—these are structural practices, not workarounds. Evidence is reliable but not new quantified data (no before/after ablation specific to his stack). This is routine vendor guidance; score as low-investment maintenance adoption.

Initial impressions of Claude Fable 5

Simon Willison's Weblog (LLM / AI engineering) · Jun 9, 2026

WAITModel: TRACK
ev2cred2dur1com0cmp2app3

Claim: Claude Fable 5 is a frontier model with substantially larger capacity than Claude Opus 4.8, demonstrated by superior performance on knowledge recall tasks, priced at 2x Opus and available across all Anthropic surfaces.

Evidence: Direct hands-on testing over ~5.5 hours; knowledge comparison showing Fable 5 listing 20+ open-source projects by Simon Willison versus Opus 4.8's more cautious response with ~6 named projects; pricing data ($10/M input, $50/M output vs. implied lower Opus rate); 1M token context window, 128k max output tokens, January 2026 knowledge cutoff; author observation of speed/cost trade-off consistent with larger model; availability across Claude.ai, Code CLI, Codex integrations cited.

Rationale

Credible hands-on testing with concrete examples (knowledge task comparison), pricing/spec details, and cross-surface deployment facts. However, model size itself is inferred from behavior ("tea-leaves"), not official capacity numbers. Anthropic's official claim is only that Fable 5 matches Mythos 5 capabilities with stricter guardrails — the "larger model" framing is the author's inference. No reproducible ablation or controlled benchmark. Source (Simon Willison) is credible (tier 2 baseline held), but the evidence here is anecdotal comparison + pricing, not quantified benchmark suite.

Setting a custom price for a model in AgentsView

Simon Willison's Weblog (LLM / AI engineering) · Jun 9, 2026

ADOPT-CHEAPModel: TRACK
ev1cred2dur2com1cmp2app2

Claim: AgentsView by Wes McKinney allows custom model pricing configuration; Claude Fable 5 can be added via reverse-engineering the pricing schema.

Evidence: Author describes using Claude Fable 5 to reverse-engineer AgentsView's pricing database and successfully adding a custom price entry; provides screenshot of treemap visualization of token usage by project.

Rationale

AgentsView is a real tool for Timothy's token-usage visibility (directly applicable to monorepo cost tracking), and custom pricing is a legitimate operational pattern. Evidence is anecdotal (one successful example, no reproducible procedure documented), so evidence_strength stays at 1. Durability is moderate—custom pricing entries may be fragile across AgentsView updates, but the capability itself is stable. Commoditization risk is low; this is a workaround for missing data, not a feature ripe for productization. Composition_specificity is 2 because it fits Timothy's local agentic workflow (CC+Codex cost tracking), but the value is in the tool and the pricing methodology, not in stack composition. Applicability is 2—useful for cost visibility but does not change how code is built or shipped. No hype markers; straightforward technical post.

ADOPT-CHEAPModel: TRACK
ev2cred2dur3com1cmp1app2

Claim: Recent open-weight LLM releases (Gemma 4, DeepSeek V4, Laguna XS.2, ZAYA1-8B, Qwen3.6) are implementing multiple architectural techniques (KV sharing, mHC, compressed attention, layer-wise attention budgeting, per-layer embeddings) to reduce long-context inference costs, particularly KV-cache size, memory traffic, and attention computational cost.

Evidence: Technical analysis and architecture diagrams comparing KV sharing in Gemma 4, layer-wise attention budgeting in Laguna XS.2, compressed convolutional attention in ZAYA1-8B, and mHC plus compressed attention in DeepSeek V4. Author references a comprehensive LLM architecture gallery with detailed comparisons of April–May releases. Models and techniques are identified by name and release window.

Rationale

Technical analysis of real architectural patterns across recent open-weight models, documented via architecture diagrams and a public gallery. Durability is high: these are structural practices independent of model capability (KV-cache and attention optimization are fundamental to inference cost). Applicability is moderate (2): Timothy's Claude Code + Codex workflow would benefit from understanding long-context cost reduction if deploying custom or alternative models, but these are mostly architectural insights for model builders, not immediate changes to his specific TS/Supabase/Vercel monorepo workflow. Evidence is reproducible (architecture diagrams, named models, identified techniques) but not quantified (no measured token savings, latency reductions, or cost deltas for Timothy's use case). Commoditization risk is low (1)—these are already commoditized patterns now shipping in released models, not emerging roadmap signals. Composition specificity is low (1): the analysis is generic architecture comparison, not specific to Timothy's stack or workflow. TRACK rather than ADOPT-CHEAP because the durability and token-efficiency relevance merit monitoring, even if immediate applicability is modest.