System Card
← leaderboard
TM
Thinking Machines Lab
model systemcard
Inkling
#21
of 27 · general
xhigh effort collapsed; Inkling Small is a separate model
Standing
dot = this model · shaded = the field's middle 60% · track = full field
General
19.2
#21
/27
Math
27.4
#21
/27
Coding
22.0
#21
/27
Health
19.4
#22
/26
Engineering
6.2
#16
/17
Cyber
23.1
#11
/14
Legal
8.4
#25
/26
Instruct
32.5
#17
/27
Agents
29.9
#19
/27
Professional
22.0
#22
/27
Multimodal
10.1
#17
/19
Hallucination
23.9
#17
/27
Speed
44.5
#13
/22
Value
28.9
#22
/27
Open
26.6
#9
/11
Measured
≈ imputed · amber dot = lab-self-reported among the sources
GPQA Diamond
87.1%
#21
HLE
31.9%
#23
MMLU-Pro
86.3%
#18
LiveBench
71.9%
#17
SWE-bench V
77.6%
#18
LiveCodeBench
85.5%
#14
SciCode
46.1%
#22
CritPt
5.4%
#19
Terminal-Bench
51.3%
#24
GDPval
37.0%
#17
Arena
1443
#19
AA Index
42.3
#19
Vals Index
49.3
#20
Epoch Capabilities Index
149.5
#18
Operations
$1
/
$4.05
$ per 1M tokens, in / out
$1.76
blended
77
tokens / sec
$0.23
$ per solved task
1443
arena elo · 7,501 votes
Neighbors
nearest capability fingerprints · deltas describe the neighbor
Tencent
HY3
→ weaker math · cheaper
DeepSeek V4 Pro
→ stronger professional · cheaper
MiniMax
MiniMax M3
→ cheaper
DeepSeek V4 Flash
→ weaker math · cheaper
Nemotron 3 Ultra
→ cheaper