Skip to content
Skip to the story
Conceptual Inkling 2 Small benchmark illustration: a cream-paper contour map with graphite lines and a restrained ember trail

A folkfox special report.

Inkling 2 Small benchmark:
31 points, 131 tokens a second, and a four-way Flash test

Summarise with
Set as preferred source on Google
24 min read

Thinking Machines Lab's sparse Mixture-of-Experts model scores 31 on Artificial Analysis's current Intelligence Index, up from 13 for Inkling Small, and streams at roughly 131 tokens per second after a 25-second thinking pause. Put beside DeepSeek Flash 1017, Claude Haiku 5.5 and Gemini 3.8 Flash, the numbers show where it shines and where rivals pull ahead.

By the folkfox newsroom. Research checked 8 November 2026. The illustrations are conceptual.

A watercolour bundle of letters tied with string, stained with ember and plum ink

The 31 lands with a version line

The Inkling 2 Small benchmark report has a version wrinkle. Thinking Machines Lab introduced the model on 5 November, describing a 594-billion-parameter Mixture-of-Experts architecture with 17 billion active parameters, image input and variable effort. The launch page leads with a score of 31 on the Artificial Analysis Intelligence Index, alongside roughly 131 tokens per second of output throughput on Tinker. That is the sharp headline.

The careful read starts one line lower: the model card reports 30.6 on AA Index v5.0, while Artificial Analysis's current page shows 31 on v5.0.1. These are different snapshots. The public pages do not explain whether the change reflects rounding, a revised index, or both, so we should not invent a tidy answer. The announcement also says the model is initially available through Tinker with closed weights, while the company intends to release full weights after external safety testing and red-teaming. A score, a speed figure, a version and a release condition belong in the same frame. (Thinking Machines announcement; model card; Artificial Analysis)

The benchmark numbers at a glance

  • 31

    AA Intelligence Index v5.0.1 score, up from 13 on Inkling Small

  • 131/s

    Output tokens per second once visible streaming begins

  • 25s

    Typical first-token wait (18 to 34s) during internal thinking

  • $1.18

    Estimated AA evaluation cost per Index task (15.7 minutes)

  • 17B

    Active parameters per token routed from a 594B MoE pool

  • 86.3%

    SWE-bench Pro v2 Hard score reported by Thinking Machines

Source: Artificial Analysis and Thinking Machines Lab, checked 8 November 2026.

A watercolour hurricane lantern glowing amber against a wash of dusk plum

Eighteen points ahead of the predecessor, and four points behind Gemini Flash

Artificial Analysis's current pages place Inkling 2 Small at 31 and Inkling Small at 13 on v5.0.1. The gap is 18 Index points. That is a striking step up on this scorecard, and Thinking Machines describes gains across agentic coding, vision, knowledge work and reasoning. But the arithmetic does not mean the new model is 138 per cent more capable, nor does it tell us that every team will see an 18-point lift in its own work. Composite points are not a universal unit of intelligence.

To see what 31 means in practice, place it beside the three models most buyers already weigh in the same fast, low-cost tier. DeepSeek Flash 1017 (DeepSeek-V4.1-Flash-1017) leads the lightweight board at 45 on the Intelligence Index. Anthropic's Claude Haiku 5.5 scores 34 at medium effort and climbs to 43 at maximum adaptive thinking. Google DeepMind's Gemini 3.8 Flash lands at 35. The jump from 13 to 31 brings Thinking Machines into direct contact with the frontier Flash class, even while leaving a clear gap to the composite leaders. (Artificial Analysis benchmark; Inkling Small score; AA Leaderboard)

A watercolour stack of worn books, one lying open on top, washed in ember and plum

What the Index counts, and what it cannot

Artificial Analysis v5.0.1 combines nine evaluations across knowledge work, coding, science and general knowledge. The four categories each contribute 25 per cent of the final Index. The suite is primarily text-based and English-language, though some tests include images.

Artificial Analysis says the Index can help compare models, while warning that it may not apply directly to every use case. That caveat is not small print to skip; it is the map legend. The score compresses performance across several tasks into one number, making models easier to compare at a glance. It also hides unevenness between tasks, the cost of each successful run, and whether a model fits a particular product's safeguards, tools or users. A model that scores 31 overall while hitting 86.3 per cent on SWE-bench Pro v2 Hard has a very different shape from a generalist chat model. (Artificial Analysis methodology)

Index score trail across the Flash and Haiku tier

Where Inkling 2 (Small) lands against the Flash and Haiku tier
Artificial Analysis Intelligence Index scores: DeepSeek Flash 1017 45, Claude Haiku 5.5 max effort 43, Gemini 3.8 Flash 35, Claude Haiku 5.5 medium effort 34, Inkling 2 (Small) 31, Inkling Small 13.AA Intelligence Index (composite points)01020304050DeepSeek Flash 1017: 45DeepSeek Flash 101745Claude Haiku 5.5 (max): 43Claude Haiku 5.5 (max)43Gemini 3.8 Flash: 35Gemini 3.8 Flash35Claude Haiku 5.5 (med): 34Claude Haiku 5.5 (med)34Inkling 2 (Small): 31Inkling 2 (Small)31Inkling Small: 13Inkling Small13
Artificial Analysis Intelligence Index scores: DeepSeek Flash 1017 45, Claude Haiku 5.5 max effort 43, Gemini 3.8 Flash 35, Claude Haiku 5.5 medium effort 34, Inkling 2 (Small) 31, Inkling Small 13.
ItemValue
DeepSeek Flash 101745
Claude Haiku 5.5 (max)43
Gemini 3.8 Flash35
Claude Haiku 5.5 (med)34
Inkling 2 (Small)31
Inkling Small13
Thinking Machines' new model jumps 18 points over Inkling Small to 31 on AA Index v5.0.1, while DeepSeek Flash 1017 (45), Claude Haiku 5.5 (34 to 43) and Gemini 3.8 Flash (35) sit higher on the composite board.

Source: Artificial Analysis and Thinking Machines Lab, checked 8 November 2026.

Dozens of ember sparks drifting upward through a dark indigo wash

"Small" is the name; sparse routing is the design

The word "Small" could suggest a compact model. The published architecture is more interesting. Thinking Machines says Inkling 2 Small has 594 billion total parameters, with 17 billion active, in a 48-layer decoder-only Mixture-of-Experts model. Each token is routed to eight of 384 experts. DeepSeek Flash 1017 follows a remarkably similar sparse playbook: roughly 763 billion total parameters with about 16 billion active per token, paired with Context-Enhanced Dispersion and Cross-Stage Attention Acceleration.

In plain English, a router selects a subset of specialist networks for each token rather than activating every expert at once. That sparsity helps explain why total size and active parameters are both reported, and why Tinker prices MoE runs on active parameters. It does not, by itself, tell us the memory footprint, throughput, serving hardware or cost for a real deployment. One NeurIPS 2024 inference study found that MoE deployment can remain difficult because large total weights still demand substantial high-bandwidth memory and intricate expert communication. Think of the fox's trail as a routing path: 17 billion active parameters per token keeps per-step arithmetic brisk, while 594 billion total parameters hold the specialist breadth. (Thinking Machines model card; Tinker model listing; Huang et al., NeurIPS 2024; Switch Transformers, JMLR)

Sparse Mixture-of-Experts scale: total versus active parameters

Total parameter pools versus active parameters per token
Total parameter pools versus active parameters per tokenParameter counts in billions: DeepSeek Flash 1017 total 763B, Inkling 2 (Small) total 594B, Inkling 2 (Small) active 17B, DeepSeek Flash 1017 active 16B.DeepSeek 1017 total: 763B763BDeepSeek 1017 totalInkling 2 total: 594B594BInkling 2 totalInkling 2 active: 17B17BInkling 2 activeDeepSeek 1017 active: 16B16BDeepSeek 1017 active
Parameter counts in billions: DeepSeek Flash 1017 total 763B, Inkling 2 (Small) total 594B, Inkling 2 (Small) active 17B, DeepSeek Flash 1017 active 16B.
ItemValue
DeepSeek 1017 total763B
Inkling 2 total594B
Inkling 2 active17B
DeepSeek 1017 active16B
Both Inkling 2 (Small) and DeepSeek Flash 1017 keep active per-token compute near 16B to 17B parameters while drawing from massive 594B to 763B expert pools.

Source: Artificial Analysis and Thinking Machines Lab, checked 8 November 2026.

One token through the MoE, and how rival architectures compare

Simplified Mixture-of-Experts routing compared with rival Flash architecturesText or image input enters a 48-layer decoder with a sparse mixture-of-experts backbone. For one token, a router selects eight of 384 experts, activating 17 billion of 594 billion total parameters. Below the main flow, a comparative strip contrasts Inkling 2 (594B total, 17B active) with DeepSeek Flash 1017 (763B total, 16B active MoE), Claude Haiku 5.5 (1M adaptive thinking) and Gemini 3.8 Flash (1M tunable reasoning).Text orimage input48-layer decodersparse MoE backboneToken router8 selected for this tokenOther experts376 not selected hereTextoutput594B total parameters, 17B active per token (8 of 384 experts)Inkling 2 (Small)594B total, 17B active MoE8 of 384 experts, 48 layers64K & 256K on Tinker (1M card)DeepSeek Flash 1017763B total, 16B active MoECED + CSA2 sparse attention1M context, 350 tok/sClaude Haiku 5.5Fast tier, adaptive thinking1.2s TTFT, 242 tok/s stream1M context (5x price >100K)Gemini 3.8 FlashTunable low, med, high effort1.8s TTFT, 99 tok/s stream1M multimodal context
Architecture comparison across the four lightweight models
ModelArchitectureContext
Inkling 2 (Small)594B total, 17B active per token (8 of 384 experts, 48 layers)64K and 256K on Tinker (1M on model card)
DeepSeek Flash 1017763B total, 16B active MoE with CED and CSA2 sparse attention1M context
Claude Haiku 5.5Fast adaptive-thinking architecture1M context, 128K max output
Gemini 3.8 FlashMultimodal Flash architecture with tunable reasoning budgets1M context
Simplified from the public model card and peer technical specifications. The expert bank and routing paths are schematic, not to scale.
A brass alarm clock in watercolour, its face stained amber, blooming into indigo and plum at the base

131 tokens a second, a 25-second pause, and the US$1.18 task bill

Why does a model that streams at roughly 131 tokens per second (128 to 135 tokens per second across standard runs) still take 15.7 minutes per Intelligence Index task? The answer lies in the gap between streaming speed and first-token latency. Before emitting its first visible word, Inkling 2 Small typically spends 18 to 34 seconds (around 25 seconds on average) in internal reasoning. By contrast, Claude Haiku 5.5 answers in roughly 1.2 seconds and streams at 242 tokens per second; DeepSeek Flash 1017 starts in 1.5 seconds and streams at roughly 350 tokens per second; and Gemini 3.8 Flash starts in 1.8 seconds and streams at 99 tokens per second.

Output streaming speed: tokens per second

Output streaming speed across the four lightweight contenders
Output streaming speed across the four lightweight contendersOutput tokens per second: DeepSeek Flash 1017 350 tok/s, Claude Haiku 5.5 242 tok/s, Inkling 2 (Small) 131 tok/s, Gemini 3.8 Flash 99 tok/s.Output generation speed (tokens per second)0100200300400DeepSeek Flash 1017: 350DeepSeek Flash 1017350 tok/sClaude Haiku 5.5: 242Claude Haiku 5.5242 tok/sInkling 2 (Small): 131Inkling 2 (Small)131 tok/sGemini 3.8 Flash: 99Gemini 3.8 Flash99 tok/s
Output tokens per second: DeepSeek Flash 1017 350 tok/s, Claude Haiku 5.5 242 tok/s, Inkling 2 (Small) 131 tok/s, Gemini 3.8 Flash 99 tok/s.
ItemValue
DeepSeek Flash 1017350
Claude Haiku 5.5242
Inkling 2 (Small)131
Gemini 3.8 Flash99
Inkling 2 (Small) streams at roughly 131 tokens per second, faster than Gemini 3.8 Flash (99 tok/s) but behind Claude Haiku 5.5 (242 tok/s) and DeepSeek Flash 1017 (350 tok/s).

Source: Artificial Analysis and Thinking Machines Lab, checked 8 November 2026.

First-token thinking pause versus token streaming timeline

Time to first token versus streaming time for a 1,000-token responseA horizontal timeline from 0 to 35 seconds showing why the new model feels slower despite 131 tokens per second streaming. DeepSeek Flash 1017 waits 1.5 seconds then streams 1,000 tokens in 2.9 seconds (4.4 seconds total). Claude Haiku 5.5 waits 1.2 seconds then streams in 4.1 seconds (5.3 seconds total). Gemini 3.8 Flash waits 1.8 seconds then streams in 10.1 seconds (11.9 seconds total). Inkling 2 (Small) pauses roughly 25 seconds for internal thinking before streaming 1,000 tokens in 7.6 seconds (32.6 seconds total).Why 131 tokens per second still waits 25 seconds: time to complete a 1,000-token answer0s5s10s15s20s25s30s35sDeepSeek 10171.5s TTFT + 2.9s stream (350 tok/s) = 4.4s totalClaude Haiku 5.51.2s TTFT + 4.1s stream (242 tok/s) = 5.3s totalGemini 3.8 Flash1.8s TTFT + 10.1s stream (99 tok/s) = 11.9s totalInkling 2 (Small)~25s internal reasoning wait (18 to 34s TTFT)7.6s (131/s)32.6sFirst-token thinking latency (TTFT)Visible token streaming (1,000 output tokens)
Time to first token and 1,000-token streaming duration by model
ModelTypical TTFTOutput Speed1,000-Token Total Time
DeepSeek Flash 10171.5s350 tok/s4.4s
Claude Haiku 5.51.2s242 tok/s5.3s
Gemini 3.8 Flash1.8s99 tok/s11.9s
Inkling 2 (Small)25.0s (18 to 34s)131 tok/s32.6s
Once the model starts speaking, 131 tokens per second is brisk. The 15.7-minute Index task duration comes from upfront internal reasoning and multi-step agent turns before and between visible outputs.

That upfront reasoning also shapes the cost per task. Artificial Analysis estimates US$1.18 to evaluate the new release on an Index task, compared with US$0.20 for Inkling Small. Against peers on the same standardised Index workflow, Claude Haiku 5.5 costs roughly US$0.21 per task, DeepSeek Flash 1017 costs roughly US$0.26 per task even at maximum reasoning, and Gemini 3.8 Flash costs roughly US$1.24 per task. The raw token prices on Tinker are modest: US$0.30 per million input tokens, US$0.03 for cached prefill, and US$1.00 per million output tokens. The US$1.18 task bill comes from how many reasoning tokens the model burns before finishing a hard problem, not from an inflated per-token tariff. (Artificial Analysis record; Tinker pricing)

Task evaluation cost versus Intelligence Index score

Evaluation cost per Index task against Intelligence Index score
Evaluation cost per Index task against Intelligence Index scoreScatter plot of cost per Index task in US dollars versus AA Index score: Claude Haiku 5.5 $0.21 and score 43, DeepSeek Flash 1017 $0.26 and score 45, Inkling Small $0.20 and score 13, Inkling 2 (Small) $1.18 and score 31, Gemini 3.8 Flash $1.24 and score 35.more for less$0.15$0.25$0.5$1$1.51020304050Estimated evaluation cost per Index task (US$, log scale)AA Index scoreInkling 2 (Small): $1.18, 31Inkling 2 (Small)Inkling Small: $0.2, 13Inkling SmallClaude Haiku 5.5: $0.21, 43Claude Haiku 5.5DeepSeek Flash 1017: $0.26, 45DeepSeek Flash 1017Gemini 3.8 Flash: $1.24, 35Gemini 3.8 Flash
Scatter plot of cost per Index task in US dollars versus AA Index score: Claude Haiku 5.5 $0.21 and score 43, DeepSeek Flash 1017 $0.26 and score 45, Inkling Small $0.20 and score 13, Inkling 2 (Small) $1.18 and score 31, Gemini 3.8 Flash $1.24 and score 35.
ItemValue
Inkling 2 (Small)$1.18, 31
Inkling Small$0.2, 13
Claude Haiku 5.5$0.21, 43
DeepSeek Flash 1017$0.26, 45
Gemini 3.8 Flash$1.24, 35
DeepSeek Flash 1017 ($0.26) and Claude Haiku 5.5 ($0.21) sit in the high-score, low-cost upper-left quadrant; Inkling 2 (Small) ($1.18) and Gemini 3.8 Flash ($1.24) spend more reasoning tokens per task.

Source: Artificial Analysis and Thinking Machines Lab, checked 8 November 2026.

Output token list prices compared

Output token list price per million tokens (US$)
Output token list price per million tokens (US$)Output price per million tokens: Haiku 5.5 under 100K $0.50, DeepSeek 1017 off-peak $0.60, Inkling 2 (Small) $1.00, DeepSeek 1017 standard $1.20, Haiku 5.5 over 100K $2.50, Gemini 3.8 Flash $3.75.US$ per million output tokens$0.10$1$10Haiku 5.5 <=100K: $0.5$0.50Haiku 5.5<=100KDeepSeek off-peak: $0.6$0.60DeepSeekoff-peakInkling 2 (Small): $1$1Inkling 2(Small)DeepSeek std: $1.2$1.20DeepSeek stdHaiku 5.5 >100K: $2.5$2.50Haiku 5.5>100KGemini 3.8 Flash: $3.75$3.75Gemini 3.8Flash
Output price per million tokens: Haiku 5.5 under 100K $0.50, DeepSeek 1017 off-peak $0.60, Inkling 2 (Small) $1.00, DeepSeek 1017 standard $1.20, Haiku 5.5 over 100K $2.50, Gemini 3.8 Flash $3.75.
ItemValue
Haiku 5.5 <=100K$0.5
DeepSeek off-peak$0.6
Inkling 2 (Small)$1
DeepSeek std$1.2
Haiku 5.5 >100K$2.5
Gemini 3.8 Flash$3.75
At $1.00 per million output tokens on Tinker, Inkling 2 (Small) undercuts standard DeepSeek Flash 1017 ($1.20) and Gemini 3.8 Flash ($3.75), while Haiku 5.5 is $0.50 up to 100K context before jumping to $2.50.

Source: Artificial Analysis and Thinking Machines Lab, checked 8 November 2026.

A watercolour campfire flaring orange and red into a black night

Where the model punches above 31: agentic coding and terminal loops

If DeepSeek Flash 1017 and Claude Haiku 5.5 lead on composite Index score, streaming speed and per-task evaluation cost, why would an engineering team reach for Thinking Machines' model? The answer shows up in long-horizon software engineering and terminal benchmarks. Thinking Machines reports 86.3 per cent on SWE-bench Pro v2 (Hard) and 85.1 per cent on Terminal-Bench 2.1, alongside launch demonstrations of a Three.js city simulator, a Python PC emulator and iterative visual UI refinement from hand-drawn sketches.

Across the four models, each contender carves out a distinct territory. Inkling 2 Small is built to observe, compile, inspect and revise inside multi-step coding and terminal loops. Claude Haiku 5.5 pairs low-latency chat with class-leading GUI and desktop control (72.4 per cent on OSWorld 2.1, alongside 39.2 per cent on the stricter Terminal-Bench 4.0). Gemini 3.8 Flash brings tunable low, medium and high thinking budgets to massive multimodal repositories (DeepSWE v1.1). DeepSeek Flash 1017 delivers the highest raw reasoning-per-dollar throughput. Company-selected demos are not independent replications, so teams should treat that 86.3 per cent SWE-bench figure as an invitation to run a repo-level trial. (Thinking Machines announcement)

Agentic coding, terminal agency and composite scores

How the four models balance composite reasoning, software engineering and terminal agency
How the four models balance composite reasoning, software engineering and terminal agencyComparison matrix across Inkling 2 (Small), Haiku 5.5, Gemini 3.8 Flash and DeepSeek 1017 on AA Index share of 50 points, SWE-bench software engineering, Terminal agency and streaming speed share of 350 tok/s.Inkling 2 (Small)Haiku 5.5Gemini 3.8 FlashDeepSeek 1017AA Index (% of 50)AA Index (% of 50), Inkling 2 (Small): 62%62%AA Index (% of 50), Haiku 5.5: 86%86%AA Index (% of 50), Gemini 3.8 Flash: 70%70%AA Index (% of 50), DeepSeek 1017: 90%90%SWE-bench codingSWE-bench coding, Inkling 2 (Small): 86.3%86.3%SWE-bench coding, Haiku 5.5: 74%74%SWE-bench coding, Gemini 3.8 Flash: 82.4%82.4%SWE-bench coding, DeepSeek 1017: 84%84%Terminal agencyTerminal agency, Inkling 2 (Small): 85.1%85.1%Terminal agency, Haiku 5.5: 39.2%39.2%Terminal agency, Gemini 3.8 Flash: 76%76%Terminal agency, DeepSeek 1017: 81.2%81.2%Speed (% of 350/s)Speed (% of 350/s), Inkling 2 (Small): 37.4%37.4%Speed (% of 350/s), Haiku 5.5: 69.1%69.1%Speed (% of 350/s), Gemini 3.8 Flash: 28.3%28.3%Speed (% of 350/s), DeepSeek 1017: 100%100%
Comparison matrix across Inkling 2 (Small), Haiku 5.5, Gemini 3.8 Flash and DeepSeek 1017 on AA Index share of 50 points, SWE-bench software engineering, Terminal agency and streaming speed share of 350 tok/s.
ItemValue
AA Index (% of 50), Inkling 2 (Small)62%
AA Index (% of 50), Haiku 5.586%
AA Index (% of 50), Gemini 3.8 Flash70%
AA Index (% of 50), DeepSeek 101790%
SWE-bench coding, Inkling 2 (Small)86.3%
SWE-bench coding, Haiku 5.574%
SWE-bench coding, Gemini 3.8 Flash82.4%
SWE-bench coding, DeepSeek 101784%
Terminal agency, Inkling 2 (Small)85.1%
Terminal agency, Haiku 5.539.2%
Terminal agency, Gemini 3.8 Flash76%
Terminal agency, DeepSeek 101781.2%
Speed (% of 350/s), Inkling 2 (Small)37.4%
Speed (% of 350/s), Haiku 5.569.1%
Speed (% of 350/s), Gemini 3.8 Flash28.3%
Speed (% of 350/s), DeepSeek 1017100%
Inkling 2 (Small) posts standout agentic coding and terminal scores (86.3% SWE-bench Pro v2 Hard, 85.1% Terminal-Bench 2.1) even where its composite AA Index share (62% of 50 points) trails rivals.

Source: Artificial Analysis and Thinking Machines Lab, checked 8 November 2026.

A single tall candle burning in a pool of rose and ember ink

The maker's caveats deserve a place in the headline

Thinking Machines says its new model is not its most succinct communicator, does not always select the best tool in codebases with many skills, and is less optimised for chat. The company also says it does not support audio and can overreact to mental-health and other safety-related queries. Those admissions are unusually candid and practical.

They also clarify the comparison with rivals. A long-winded answer inflates token spend and review time; a hesitant tool choice can stall an agent in a workspace with dozens of MCP servers; and a 25-second thinking pause makes live customer chat feel sluggish next to Claude Haiku 5.5's 1.2-second response or DeepSeek Flash 1017's 350-tokens-per-second stream. The newsroom's quiet rule is simple: match the animal to the terrain. A polished demo can open the gate, but only a representative test can tell you whether to let the model into the den. (Thinking Machines limitations)

A watercolour world map in indigo and amber ink, with a fine dotted route traced across the oceans

Tinker is open for use; watch the context ceiling and the weights promise

At announcement, Tinker provided inference and fine-tuning access, while Inkling 2 Small's weights remained closed under Tinker Terms of Use. Thinking Machines said it intended to publish full weights under Apache 2.0 after external safety testing and red-teaming. The company first said "next week"; its current Inkling page says "in the coming weeks" and still describes the model as closed-weight. Should those Apache 2.0 weights land, Thinking Machines' model and DeepSeek Flash 1017 would stand apart from proprietary endpoints like Haiku 5.5 and Gemini 3.8 Flash for self-hosted deployments.

Until then, pay close attention to hosted context limits and pricing cliffs. While the public model card states a maximum context of one million tokens, Tinker's live models.json currently lists 64K and 256K hosted options, with LoRA training priced at US$1.50 per million tokens on 64K and US$3.00 on 256K. Meanwhile, Claude Haiku 5.5 offers a one-million-token window, but its bargain US$0.10 input and US$0.50 output rate applies only up to 100K tokens; cross 100K and the price jumps fivefold to US$0.50 input and US$2.50 output. DeepSeek Flash 1017 ($0.30/$1.20, or $0.006 cache hit) and Gemini 3.8 Flash ($0.75/$3.75) hold flat rates across their full one-million-token windows. (Thinking Machines announcement; model card; Tinker model listing)

Hosted context ceilings and the 100K pricing cliff

Context window availability and pricing cliffs across 1 million tokensA comparative model from 0 to 1,000,000 tokens showing hosted availability and pricing rules. Inkling 2 (Small) offers 64K and 256K hosted variants on Tinker at $0.30 input and $1.00 output per million tokens, while 256K to 1M is a model-card maximum not yet hosted on Tinker. Claude Haiku 5.5 charges $0.10 input and $0.50 output up to 100K tokens, then jumps 5x to $0.50 input and $2.50 output from 100K to 1M. DeepSeek Flash 1017 holds flat at $0.30 input and $1.20 output across 1M tokens ($0.006 cache hit). Gemini 3.8 Flash holds flat at $0.75 input and $3.75 output across 1M tokens.Context ceilings and pricing cliffs: 64K to 1M tokens compared064K100K256K1M tokensInkling 2 (Small)64K ($1.50 train)256K Tinker ($0.30 in / $1.00 out)Up to 1M in model card (not on Tinker models.json)Claude Haiku 5.5$0.10 in / $0.50 out5x cliff >100K: $0.50 in / $2.50 out up to 1MDeepSeek 1017Flat 1M hosted: $0.30 in / $1.20 out ($0.15 / $0.60 off-peak, $0.006 cache hit)Gemini 3.8 FlashFlat 1M hosted: $0.75 in / $3.75 out ($0.075 cached input)Tinker charges $0.03/M cached prefill on both 64K and 256K options; training doubles from $1.50/M (64K) to $3.00/M (256K)
Context window limits and pricing across 1 million tokens
Model0 to 64K64K to 100K100K to 256K256K to 1M
Inkling 2 (Small)$0.30 in / $1.00 out ($1.50 train)$0.30 in / $1.00 out ($3.00 train)$0.30 in / $1.00 out ($3.00 train)Model card spec only, not hosted on Tinker
Claude Haiku 5.5$0.10 in / $0.50 out$0.10 in / $0.50 out$0.50 in / $2.50 out (5x cliff)$0.50 in / $2.50 out
DeepSeek Flash 1017$0.30 in / $1.20 out$0.30 in / $1.20 out$0.30 in / $1.20 out$0.30 in / $1.20 out
Gemini 3.8 Flash$0.75 in / $3.75 out$0.75 in / $3.75 out$0.75 in / $3.75 out$0.75 in / $3.75 out
Hosted context limits and per-million-token pricing as of November 2026. Axis positions are schematic so the 64K, 100K and 256K thresholds remain legible alongside the 1M ceiling.
Ember and rose smoke rolling low across a dark horizon

Put the four models through your own five honest checks

First, separate interactive chat from background agency: if a human is waiting on the first sentence, test Claude Haiku 5.5 or DeepSeek Flash 1017 before accepting a 25-second thinking pause. Second, measure total task cost from the initial prompt through every retry and tool call, rather than judging by per-million token list prices alone.

Third, test tool selection inside your real, crowded skill library, where Thinking Machines warns its model can hesitate. Fourth, test context behaviour across the 64K, 100K and 256K boundaries so neither Tinker's hosted ceiling nor Haiku 5.5's 100K pricing cliff catches your budget off guard. Fifth, probe refusal and safety escalation on your own edge cases, and check Tinker's beta service terms before publishing a competitive benchmark.

Four-way model field guide: which runner fits which workload

  • Inkling 2 (Small)

    Agentic builder & Tinker LoRA

    AA Index v5.0.1
    31 points (30.6 on v5.0)
    Speed & TTFT
    131 tok/s (~25s TTFT)
    Token price
    $0.30 in / $1.00 out
    AA task cost
    $1.18 (15.7 mins)
    Context
    64K & 256K Tinker (1M card)

    Best for

    • Long-horizon repo coding (86.3% SWE-bench Pro v2)
    • Custom LoRA fine-tuning on Tinker ($1.50 to $3.00/M)
    • Teams preparing for conditional Apache 2.0 weights
  • DeepSeek Flash 1017

    Speed & composite Index leader

    AA Index v5.0.1
    45 points (763B / 16B MoE)
    Speed & TTFT
    350 tok/s (~1.5s TTFT)
    Token price
    $0.30 in / $1.20 out
    AA task cost
    ~$0.26 per task
    Context
    1M flat ($0.006/M cache)

    Best for

    • High-throughput reasoning pipelines at ~350 tok/s
    • Heavy prompt caching at $0.006 per million tokens
    • Off-peak batch workloads ($0.15 in / $0.60 out)
  • Claude Haiku 5.5

    Instant chat & computer use

    AA Index v5.0.1
    34 (med) to 43 (max)
    Speed & TTFT
    242 tok/s (~1.2s TTFT)
    Token price
    $0.10 / $0.50 (<=100K)
    AA task cost
    ~$0.21 per task
    Context
    1M (5x cliff >100K)

    Best for

    • Sub-second interactive chat and customer support
    • Desktop and browser GUI agents (72.4% OSWorld 2.1)
    • Sub-100K context workflows where $0.10/$0.50 holds
  • Gemini 3.8 Flash

    Enterprise multimodal & DeepSWE

    AA Index v5.0.1
    35 points
    Speed & TTFT
    99 tok/s (~1.8s TTFT)
    Token price
    $0.75 in / $3.75 out
    AA task cost
    ~$1.24 per task
    Context
    1M multimodal ($0.075 cache)

    Best for

    • Tunable low, medium and high thinking budgets
    • Multimodal video, document and codebase analysis
    • Google Cloud and Vertex AI enterprise governance

Source: Artificial Analysis and Thinking Machines Lab, checked 8 November 2026.

A full moon painted as a soft cream disc on a deep indigo wash

A strong signal, with the trail still ahead

Inkling 2 Small's current score of 31 marks a substantial rise over Inkling Small's 13 on Artificial Analysis's current Index, backed by a brisk 131-tokens-per-second output stream and a 594B-total, 17B-active sparse MoE design. Yet its upfront reasoning pause stretches Index evaluations to 15.7 minutes and US$1.18 per task; DeepSeek Flash 1017 and Claude Haiku 5.5 deliver higher composite scores at a fraction of the per-task spend; and the promised Apache 2.0 weights remain conditional on safety testing. The fair reading holds every piece of that picture at once.

Use the score of 31 as a shortlist signal, not a substitute for a field test. Pick the model whose latency, context economics and agency profile fit the work in front of you, and let a live repository decide which runner earns its keep.

Quick workload routing guide

Match the model to the job

  • Long-horizon coding: Inkling 2 (86.3% SWE-bench Pro v2)
  • High-volume reasoning: DeepSeek Flash 1017 (350 tok/s, Index 45)
  • Sub-100K instant chat & GUI: Claude Haiku 5.5 ($0.10/$0.50)
  • Enterprise multimodal & Vertex: Gemini 3.8 Flash (1M context)
  • Custom LoRA fine-tuning: Inkling 2 on Tinker ($1.50/M)
  • Ultra-cheap cached context: DeepSeek 1017 ($0.006/M cache hit)

Source: Artificial Analysis and Thinking Machines Lab, checked 8 November 2026.

Quick answers

What is the tokens per second speed of Inkling 2 Small?

The model generates output at roughly 131 tokens per second (128 to 135 tokens per second across standard evaluations). Because it performs internal reasoning before emitting visible text, time to first token is typically 18 to 34 seconds, which makes overall benchmark runs take 15.7 minutes per Index task.

What score did the model get on Artificial Analysis?

Artificial Analysis's current model page shows 31 on Intelligence Index v5.0.1. Thinking Machines' model card lists 30.6 on v5.0, an earlier version. On specialised agentic coding suites, Thinking Machines reports 86.3 per cent on SWE-bench Pro v2 Hard and 85.1 per cent on Terminal-Bench 2.1.

How does it compare with DeepSeek Flash 1017, Claude Haiku 5.5 and Gemini 3.8 Flash?

On the Artificial Analysis Intelligence Index, DeepSeek Flash 1017 leads at 45 (~350 tokens per second, ~US$0.26 per task), followed by Claude Haiku 5.5 at 34 to 43 (~242 tokens per second, ~US$0.21 per task), Gemini 3.8 Flash at 35 (~99 tokens per second, ~US$1.24 per task), and Inkling 2 (Small) at 31 (~131 tokens per second, US$1.18 per task). Thinking Machines' release punches hardest on long-horizon coding and Tinker fine-tuning.

How does it compare with its predecessor, Inkling Small?

Current Artificial Analysis pages show 31 for the new release and 13 for Inkling Small on v5.0.1. The newer version took 15.7 minutes and cost US$1.18 per Index task, compared with 5.8 minutes and US$0.20 for the predecessor.

Is the model actually small?

It has 594 billion total parameters and 17 billion active parameters per token across 384 experts, according to Thinking Machines. Small is the tier name, much like DeepSeek Flash 1017 uses roughly 16 billion active parameters from a 763-billion-parameter pool.

Are the weights open now?

At launch the weights were closed and the model card named Tinker Terms of Use. Thinking Machines said it intended to release full weights under Apache 2.0 after external safety testing and red-teaming.

Does a score of 31 mean it is better or worse for every task?

Neither. The Index combines nine evaluations in four categories. Teams needing instant chat or sub-100K cost efficiency will favour Claude Haiku 5.5 or DeepSeek Flash 1017, while teams building custom fine-tuned coding agents on Tinker should pilot Thinking Machines' model on their own repositories.

Sources

  1. Thinking Machines Lab: Introducing Inkling 2 (Small)
  2. Thinking Machines Lab: Public model card
  3. Thinking Machines Lab: Inkling product page
  4. Tinker: live model and context listing
  5. Tinker: published pricing
  6. Tinker: service terms
  7. Artificial Analysis: Inkling 2 (Small) benchmark record
  8. Artificial Analysis: Inkling Small benchmark record
  9. Artificial Analysis: Intelligence Index methodology
  10. Artificial Analysis: LLM Leaderboard (Haiku 5.5, Gemini 3.8 Flash, DeepSeek Flash 1017)
  11. Fedus, Zoph and Shazeer: Switch Transformers, Journal of Machine Learning Research
  12. Huang et al.: Toward Efficient Inference for Mixture of Experts, NeurIPS 2024

Leave a Reply

Your email address will not be published. Required fields are marked *

The den

Where to?

Pricing

Choose a section. Enter opens it, Escape continues reading.

Cookie preferences

folkfox uses data the way we use strategy: only when it earns its place.