



A folkfox special report.
Inkling 2 Small benchmark:
31 points, 131 tokens a second, and a four-way Flash test
Thinking Machines Lab's sparse Mixture-of-Experts model scores 31 on Artificial Analysis's current Intelligence Index, up from 13 for Inkling Small, and streams at roughly 131 tokens per second after a 25-second thinking pause. Put beside DeepSeek Flash 1017, Claude Haiku 5.5 and Gemini 3.8 Flash, the numbers show where it shines and where rivals pull ahead.
By the folkfox newsroom. Research checked 8 November 2026. The illustrations are conceptual.




01
The 31 lands with a version line
The Inkling 2 Small benchmark report has a version wrinkle. Thinking Machines Lab introduced the model on 5 November, describing a 594-billion-parameter Mixture-of-Experts architecture with 17 billion active parameters, image input and variable effort. The launch page leads with a score of 31 on the Artificial Analysis Intelligence Index, alongside roughly 131 tokens per second of output throughput on Tinker. That is the sharp headline.
The careful read starts one line lower: the model card reports 30.6 on AA Index v5.0, while Artificial Analysis's current page shows 31 on v5.0.1. These are different snapshots. The public pages do not explain whether the change reflects rounding, a revised index, or both, so we should not invent a tidy answer. The announcement also says the model is initially available through Tinker with closed weights, while the company intends to release full weights after external safety testing and red-teaming. A score, a speed figure, a version and a release condition belong in the same frame. (Thinking Machines announcement; model card; Artificial Analysis)
The benchmark numbers at a glance
- 31
AA Intelligence Index v5.0.1 score, up from 13 on Inkling Small
- 131/s
Output tokens per second once visible streaming begins
- 25s
Typical first-token wait (18 to 34s) during internal thinking
- $1.18
Estimated AA evaluation cost per Index task (15.7 minutes)
- 17B
Active parameters per token routed from a 594B MoE pool
- 86.3%
SWE-bench Pro v2 Hard score reported by Thinking Machines
Source: Artificial Analysis and Thinking Machines Lab, checked 8 November 2026.




02
Eighteen points ahead of the predecessor, and four points behind Gemini Flash
Artificial Analysis's current pages place Inkling 2 Small at 31 and Inkling Small at 13 on v5.0.1. The gap is 18 Index points. That is a striking step up on this scorecard, and Thinking Machines describes gains across agentic coding, vision, knowledge work and reasoning. But the arithmetic does not mean the new model is 138 per cent more capable, nor does it tell us that every team will see an 18-point lift in its own work. Composite points are not a universal unit of intelligence.
To see what 31 means in practice, place it beside the three models most buyers already weigh in the same fast, low-cost tier. DeepSeek Flash 1017 (DeepSeek-V4.1-Flash-1017) leads the lightweight board at 45 on the Intelligence Index. Anthropic's Claude Haiku 5.5 scores 34 at medium effort and climbs to 43 at maximum adaptive thinking. Google DeepMind's Gemini 3.8 Flash lands at 35. The jump from 13 to 31 brings Thinking Machines into direct contact with the frontier Flash class, even while leaving a clear gap to the composite leaders. (Artificial Analysis benchmark; Inkling Small score; AA Leaderboard)




03
What the Index counts, and what it cannot
Artificial Analysis v5.0.1 combines nine evaluations across knowledge work, coding, science and general knowledge. The four categories each contribute 25 per cent of the final Index. The suite is primarily text-based and English-language, though some tests include images.
Artificial Analysis says the Index can help compare models, while warning that it may not apply directly to every use case. That caveat is not small print to skip; it is the map legend. The score compresses performance across several tasks into one number, making models easier to compare at a glance. It also hides unevenness between tasks, the cost of each successful run, and whether a model fits a particular product's safeguards, tools or users. A model that scores 31 overall while hitting 86.3 per cent on SWE-bench Pro v2 Hard has a very different shape from a generalist chat model. (Artificial Analysis methodology)
Index score trail across the Flash and Haiku tier
| Item | Value |
|---|---|
| DeepSeek Flash 1017 | 45 |
| Claude Haiku 5.5 (max) | 43 |
| Gemini 3.8 Flash | 35 |
| Claude Haiku 5.5 (med) | 34 |
| Inkling 2 (Small) | 31 |
| Inkling Small | 13 |
Source: Artificial Analysis and Thinking Machines Lab, checked 8 November 2026.




04
"Small" is the name; sparse routing is the design
The word "Small" could suggest a compact model. The published architecture is more interesting. Thinking Machines says Inkling 2 Small has 594 billion total parameters, with 17 billion active, in a 48-layer decoder-only Mixture-of-Experts model. Each token is routed to eight of 384 experts. DeepSeek Flash 1017 follows a remarkably similar sparse playbook: roughly 763 billion total parameters with about 16 billion active per token, paired with Context-Enhanced Dispersion and Cross-Stage Attention Acceleration.
In plain English, a router selects a subset of specialist networks for each token rather than activating every expert at once. That sparsity helps explain why total size and active parameters are both reported, and why Tinker prices MoE runs on active parameters. It does not, by itself, tell us the memory footprint, throughput, serving hardware or cost for a real deployment. One NeurIPS 2024 inference study found that MoE deployment can remain difficult because large total weights still demand substantial high-bandwidth memory and intricate expert communication. Think of the fox's trail as a routing path: 17 billion active parameters per token keeps per-step arithmetic brisk, while 594 billion total parameters hold the specialist breadth. (Thinking Machines model card; Tinker model listing; Huang et al., NeurIPS 2024; Switch Transformers, JMLR)
Sparse Mixture-of-Experts scale: total versus active parameters
| Item | Value |
|---|---|
| DeepSeek 1017 total | 763B |
| Inkling 2 total | 594B |
| Inkling 2 active | 17B |
| DeepSeek 1017 active | 16B |
Source: Artificial Analysis and Thinking Machines Lab, checked 8 November 2026.
One token through the MoE, and how rival architectures compare
| Model | Architecture | Context |
|---|---|---|
| Inkling 2 (Small) | 594B total, 17B active per token (8 of 384 experts, 48 layers) | 64K and 256K on Tinker (1M on model card) |
| DeepSeek Flash 1017 | 763B total, 16B active MoE with CED and CSA2 sparse attention | 1M context |
| Claude Haiku 5.5 | Fast adaptive-thinking architecture | 1M context, 128K max output |
| Gemini 3.8 Flash | Multimodal Flash architecture with tunable reasoning budgets | 1M context |




05
131 tokens a second, a 25-second pause, and the US$1.18 task bill
Why does a model that streams at roughly 131 tokens per second (128 to 135 tokens per second across standard runs) still take 15.7 minutes per Intelligence Index task? The answer lies in the gap between streaming speed and first-token latency. Before emitting its first visible word, Inkling 2 Small typically spends 18 to 34 seconds (around 25 seconds on average) in internal reasoning. By contrast, Claude Haiku 5.5 answers in roughly 1.2 seconds and streams at 242 tokens per second; DeepSeek Flash 1017 starts in 1.5 seconds and streams at roughly 350 tokens per second; and Gemini 3.8 Flash starts in 1.8 seconds and streams at 99 tokens per second.
Output streaming speed: tokens per second
| Item | Value |
|---|---|
| DeepSeek Flash 1017 | 350 |
| Claude Haiku 5.5 | 242 |
| Inkling 2 (Small) | 131 |
| Gemini 3.8 Flash | 99 |
Source: Artificial Analysis and Thinking Machines Lab, checked 8 November 2026.
First-token thinking pause versus token streaming timeline
| Model | Typical TTFT | Output Speed | 1,000-Token Total Time |
|---|---|---|---|
| DeepSeek Flash 1017 | 1.5s | 350 tok/s | 4.4s |
| Claude Haiku 5.5 | 1.2s | 242 tok/s | 5.3s |
| Gemini 3.8 Flash | 1.8s | 99 tok/s | 11.9s |
| Inkling 2 (Small) | 25.0s (18 to 34s) | 131 tok/s | 32.6s |
That upfront reasoning also shapes the cost per task. Artificial Analysis estimates US$1.18 to evaluate the new release on an Index task, compared with US$0.20 for Inkling Small. Against peers on the same standardised Index workflow, Claude Haiku 5.5 costs roughly US$0.21 per task, DeepSeek Flash 1017 costs roughly US$0.26 per task even at maximum reasoning, and Gemini 3.8 Flash costs roughly US$1.24 per task. The raw token prices on Tinker are modest: US$0.30 per million input tokens, US$0.03 for cached prefill, and US$1.00 per million output tokens. The US$1.18 task bill comes from how many reasoning tokens the model burns before finishing a hard problem, not from an inflated per-token tariff. (Artificial Analysis record; Tinker pricing)
Task evaluation cost versus Intelligence Index score
| Item | Value |
|---|---|
| Inkling 2 (Small) | $1.18, 31 |
| Inkling Small | $0.2, 13 |
| Claude Haiku 5.5 | $0.21, 43 |
| DeepSeek Flash 1017 | $0.26, 45 |
| Gemini 3.8 Flash | $1.24, 35 |
Source: Artificial Analysis and Thinking Machines Lab, checked 8 November 2026.
Output token list prices compared
| Item | Value |
|---|---|
| Haiku 5.5 <=100K | $0.5 |
| DeepSeek off-peak | $0.6 |
| Inkling 2 (Small) | $1 |
| DeepSeek std | $1.2 |
| Haiku 5.5 >100K | $2.5 |
| Gemini 3.8 Flash | $3.75 |
Source: Artificial Analysis and Thinking Machines Lab, checked 8 November 2026.




06
Where the model punches above 31: agentic coding and terminal loops
If DeepSeek Flash 1017 and Claude Haiku 5.5 lead on composite Index score, streaming speed and per-task evaluation cost, why would an engineering team reach for Thinking Machines' model? The answer shows up in long-horizon software engineering and terminal benchmarks. Thinking Machines reports 86.3 per cent on SWE-bench Pro v2 (Hard) and 85.1 per cent on Terminal-Bench 2.1, alongside launch demonstrations of a Three.js city simulator, a Python PC emulator and iterative visual UI refinement from hand-drawn sketches.
Across the four models, each contender carves out a distinct territory. Inkling 2 Small is built to observe, compile, inspect and revise inside multi-step coding and terminal loops. Claude Haiku 5.5 pairs low-latency chat with class-leading GUI and desktop control (72.4 per cent on OSWorld 2.1, alongside 39.2 per cent on the stricter Terminal-Bench 4.0). Gemini 3.8 Flash brings tunable low, medium and high thinking budgets to massive multimodal repositories (DeepSWE v1.1). DeepSeek Flash 1017 delivers the highest raw reasoning-per-dollar throughput. Company-selected demos are not independent replications, so teams should treat that 86.3 per cent SWE-bench figure as an invitation to run a repo-level trial. (Thinking Machines announcement)
Agentic coding, terminal agency and composite scores
| Item | Value |
|---|---|
| AA Index (% of 50), Inkling 2 (Small) | 62% |
| AA Index (% of 50), Haiku 5.5 | 86% |
| AA Index (% of 50), Gemini 3.8 Flash | 70% |
| AA Index (% of 50), DeepSeek 1017 | 90% |
| SWE-bench coding, Inkling 2 (Small) | 86.3% |
| SWE-bench coding, Haiku 5.5 | 74% |
| SWE-bench coding, Gemini 3.8 Flash | 82.4% |
| SWE-bench coding, DeepSeek 1017 | 84% |
| Terminal agency, Inkling 2 (Small) | 85.1% |
| Terminal agency, Haiku 5.5 | 39.2% |
| Terminal agency, Gemini 3.8 Flash | 76% |
| Terminal agency, DeepSeek 1017 | 81.2% |
| Speed (% of 350/s), Inkling 2 (Small) | 37.4% |
| Speed (% of 350/s), Haiku 5.5 | 69.1% |
| Speed (% of 350/s), Gemini 3.8 Flash | 28.3% |
| Speed (% of 350/s), DeepSeek 1017 | 100% |
Source: Artificial Analysis and Thinking Machines Lab, checked 8 November 2026.




07
The maker's caveats deserve a place in the headline
Thinking Machines says its new model is not its most succinct communicator, does not always select the best tool in codebases with many skills, and is less optimised for chat. The company also says it does not support audio and can overreact to mental-health and other safety-related queries. Those admissions are unusually candid and practical.
They also clarify the comparison with rivals. A long-winded answer inflates token spend and review time; a hesitant tool choice can stall an agent in a workspace with dozens of MCP servers; and a 25-second thinking pause makes live customer chat feel sluggish next to Claude Haiku 5.5's 1.2-second response or DeepSeek Flash 1017's 350-tokens-per-second stream. The newsroom's quiet rule is simple: match the animal to the terrain. A polished demo can open the gate, but only a representative test can tell you whether to let the model into the den. (Thinking Machines limitations)




08
Tinker is open for use; watch the context ceiling and the weights promise
At announcement, Tinker provided inference and fine-tuning access, while Inkling 2 Small's weights remained closed under Tinker Terms of Use. Thinking Machines said it intended to publish full weights under Apache 2.0 after external safety testing and red-teaming. The company first said "next week"; its current Inkling page says "in the coming weeks" and still describes the model as closed-weight. Should those Apache 2.0 weights land, Thinking Machines' model and DeepSeek Flash 1017 would stand apart from proprietary endpoints like Haiku 5.5 and Gemini 3.8 Flash for self-hosted deployments.
Until then, pay close attention to hosted context limits and pricing cliffs. While the public model card states a maximum context of one million tokens, Tinker's live models.json currently lists 64K and 256K hosted options, with LoRA training priced at US$1.50 per million tokens on 64K and US$3.00 on 256K. Meanwhile, Claude Haiku 5.5 offers a one-million-token window, but its bargain US$0.10 input and US$0.50 output rate applies only up to 100K tokens; cross 100K and the price jumps fivefold to US$0.50 input and US$2.50 output. DeepSeek Flash 1017 ($0.30/$1.20, or $0.006 cache hit) and Gemini 3.8 Flash ($0.75/$3.75) hold flat rates across their full one-million-token windows. (Thinking Machines announcement; model card; Tinker model listing)
Hosted context ceilings and the 100K pricing cliff
| Model | 0 to 64K | 64K to 100K | 100K to 256K | 256K to 1M |
|---|---|---|---|---|
| Inkling 2 (Small) | $0.30 in / $1.00 out ($1.50 train) | $0.30 in / $1.00 out ($3.00 train) | $0.30 in / $1.00 out ($3.00 train) | Model card spec only, not hosted on Tinker |
| Claude Haiku 5.5 | $0.10 in / $0.50 out | $0.10 in / $0.50 out | $0.50 in / $2.50 out (5x cliff) | $0.50 in / $2.50 out |
| DeepSeek Flash 1017 | $0.30 in / $1.20 out | $0.30 in / $1.20 out | $0.30 in / $1.20 out | $0.30 in / $1.20 out |
| Gemini 3.8 Flash | $0.75 in / $3.75 out | $0.75 in / $3.75 out | $0.75 in / $3.75 out | $0.75 in / $3.75 out |




09
Put the four models through your own five honest checks
First, separate interactive chat from background agency: if a human is waiting on the first sentence, test Claude Haiku 5.5 or DeepSeek Flash 1017 before accepting a 25-second thinking pause. Second, measure total task cost from the initial prompt through every retry and tool call, rather than judging by per-million token list prices alone.
Third, test tool selection inside your real, crowded skill library, where Thinking Machines warns its model can hesitate. Fourth, test context behaviour across the 64K, 100K and 256K boundaries so neither Tinker's hosted ceiling nor Haiku 5.5's 100K pricing cliff catches your budget off guard. Fifth, probe refusal and safety escalation on your own edge cases, and check Tinker's beta service terms before publishing a competitive benchmark.
Four-way model field guide: which runner fits which workload
Inkling 2 (Small)
Agentic builder & Tinker LoRA
- AA Index v5.0.1
- 31 points (30.6 on v5.0)
- Speed & TTFT
- 131 tok/s (~25s TTFT)
- Token price
- $0.30 in / $1.00 out
- AA task cost
- $1.18 (15.7 mins)
- Context
- 64K & 256K Tinker (1M card)
Best for
- Long-horizon repo coding (86.3% SWE-bench Pro v2)
- Custom LoRA fine-tuning on Tinker ($1.50 to $3.00/M)
- Teams preparing for conditional Apache 2.0 weights
DeepSeek Flash 1017
Speed & composite Index leader
- AA Index v5.0.1
- 45 points (763B / 16B MoE)
- Speed & TTFT
- 350 tok/s (~1.5s TTFT)
- Token price
- $0.30 in / $1.20 out
- AA task cost
- ~$0.26 per task
- Context
- 1M flat ($0.006/M cache)
Best for
- High-throughput reasoning pipelines at ~350 tok/s
- Heavy prompt caching at $0.006 per million tokens
- Off-peak batch workloads ($0.15 in / $0.60 out)
Claude Haiku 5.5
Instant chat & computer use
- AA Index v5.0.1
- 34 (med) to 43 (max)
- Speed & TTFT
- 242 tok/s (~1.2s TTFT)
- Token price
- $0.10 / $0.50 (<=100K)
- AA task cost
- ~$0.21 per task
- Context
- 1M (5x cliff >100K)
Best for
- Sub-second interactive chat and customer support
- Desktop and browser GUI agents (72.4% OSWorld 2.1)
- Sub-100K context workflows where $0.10/$0.50 holds
Gemini 3.8 Flash
Enterprise multimodal & DeepSWE
- AA Index v5.0.1
- 35 points
- Speed & TTFT
- 99 tok/s (~1.8s TTFT)
- Token price
- $0.75 in / $3.75 out
- AA task cost
- ~$1.24 per task
- Context
- 1M multimodal ($0.075 cache)
Best for
- Tunable low, medium and high thinking budgets
- Multimodal video, document and codebase analysis
- Google Cloud and Vertex AI enterprise governance
Source: Artificial Analysis and Thinking Machines Lab, checked 8 November 2026.




10
A strong signal, with the trail still ahead
Inkling 2 Small's current score of 31 marks a substantial rise over Inkling Small's 13 on Artificial Analysis's current Index, backed by a brisk 131-tokens-per-second output stream and a 594B-total, 17B-active sparse MoE design. Yet its upfront reasoning pause stretches Index evaluations to 15.7 minutes and US$1.18 per task; DeepSeek Flash 1017 and Claude Haiku 5.5 deliver higher composite scores at a fraction of the per-task spend; and the promised Apache 2.0 weights remain conditional on safety testing. The fair reading holds every piece of that picture at once.
Use the score of 31 as a shortlist signal, not a substitute for a field test. Pick the model whose latency, context economics and agency profile fit the work in front of you, and let a live repository decide which runner earns its keep.
Quick workload routing guide
Match the model to the job
- Long-horizon coding: Inkling 2 (86.3% SWE-bench Pro v2)
- High-volume reasoning: DeepSeek Flash 1017 (350 tok/s, Index 45)
- Sub-100K instant chat & GUI: Claude Haiku 5.5 ($0.10/$0.50)
- Enterprise multimodal & Vertex: Gemini 3.8 Flash (1M context)
- Custom LoRA fine-tuning: Inkling 2 on Tinker ($1.50/M)
- Ultra-cheap cached context: DeepSeek 1017 ($0.006/M cache hit)
Source: Artificial Analysis and Thinking Machines Lab, checked 8 November 2026.
Quick answers
What is the tokens per second speed of Inkling 2 Small?
The model generates output at roughly 131 tokens per second (128 to 135 tokens per second across standard evaluations). Because it performs internal reasoning before emitting visible text, time to first token is typically 18 to 34 seconds, which makes overall benchmark runs take 15.7 minutes per Index task.
What score did the model get on Artificial Analysis?
Artificial Analysis's current model page shows 31 on Intelligence Index v5.0.1. Thinking Machines' model card lists 30.6 on v5.0, an earlier version. On specialised agentic coding suites, Thinking Machines reports 86.3 per cent on SWE-bench Pro v2 Hard and 85.1 per cent on Terminal-Bench 2.1.
How does it compare with DeepSeek Flash 1017, Claude Haiku 5.5 and Gemini 3.8 Flash?
On the Artificial Analysis Intelligence Index, DeepSeek Flash 1017 leads at 45 (~350 tokens per second, ~US$0.26 per task), followed by Claude Haiku 5.5 at 34 to 43 (~242 tokens per second, ~US$0.21 per task), Gemini 3.8 Flash at 35 (~99 tokens per second, ~US$1.24 per task), and Inkling 2 (Small) at 31 (~131 tokens per second, US$1.18 per task). Thinking Machines' release punches hardest on long-horizon coding and Tinker fine-tuning.
How does it compare with its predecessor, Inkling Small?
Current Artificial Analysis pages show 31 for the new release and 13 for Inkling Small on v5.0.1. The newer version took 15.7 minutes and cost US$1.18 per Index task, compared with 5.8 minutes and US$0.20 for the predecessor.
Is the model actually small?
It has 594 billion total parameters and 17 billion active parameters per token across 384 experts, according to Thinking Machines. Small is the tier name, much like DeepSeek Flash 1017 uses roughly 16 billion active parameters from a 763-billion-parameter pool.
Are the weights open now?
At launch the weights were closed and the model card named Tinker Terms of Use. Thinking Machines said it intended to release full weights under Apache 2.0 after external safety testing and red-teaming.
Does a score of 31 mean it is better or worse for every task?
Neither. The Index combines nine evaluations in four categories. Teams needing instant chat or sub-100K cost efficiency will favour Claude Haiku 5.5 or DeepSeek Flash 1017, while teams building custom fine-tuned coding agents on Tinker should pilot Thinking Machines' model on their own repositories.
Keep reading
Read more on this topic
Gemini 4 Carbon benchmarks: the wins and the caveats
A model score is only as useful as the test conditions around it.
Read the pieceAI model specialKimi K3.1 and the second brief
What happens after the first draft, and where a human should step in.
Read the pieceEvidence checkMeta Muse AI memory: what the 90% test actually shows
A closer look at a headline result, what was measured and what remains open.
Read the pieceWork with folkfox
Make the model story useful to the people making the call
folkfox turns fast-moving AI claims into clear evidence, useful stories and sharper decisions for the people building what comes next.
Want folkfox in your Google results? Set folkfox as a preferred source.
Sources
- Thinking Machines Lab: Introducing Inkling 2 (Small)
- Thinking Machines Lab: Public model card
- Thinking Machines Lab: Inkling product page
- Tinker: live model and context listing
- Tinker: published pricing
- Tinker: service terms
- Artificial Analysis: Inkling 2 (Small) benchmark record
- Artificial Analysis: Inkling Small benchmark record
- Artificial Analysis: Intelligence Index methodology
- Artificial Analysis: LLM Leaderboard (Haiku 5.5, Gemini 3.8 Flash, DeepSeek Flash 1017)
- Fedus, Zoph and Shazeer: Switch Transformers, Journal of Machine Learning Research
- Huang et al.: Toward Efficient Inference for Mixture of Experts, NeurIPS 2024

