Compare/Step 3.5 Flash vs Devstral Small (Jul '25)

Step 3.5 FlashvsDevstral Small (Jul '25)

Side-by-side comparison of pricing, 12 benchmarks, and generation speed.

StepFun

Step 3.5 Flash

Input
$0.1/M
Output
$0.3/M
Speed
193 tok/s
TTFT
0.91s
Mistral

Devstral Small (Jul '25)

Input
$0.1/M
Output
$0.3/M
Speed
192 tok/s
TTFT
0.41s

Winner by Category

Cheaper
Tie
Faster (tok/s)
Step 3.5 Flash
Lower Latency
Devstral Small (Jul '25)
Benchmarks (7-5)
Step 3.5 Flash

Pricing Comparison

MetricStep 3.5 FlashDevstral Small (Jul '25)
Input ($/M tokens)$0.1$0.1
Output ($/M tokens)$0.3$0.3
Cost for 1M input + 100K output tokens:
Step 3.5 Flash$0.13
Devstral Small (Jul '25)$0.13

Speed Comparison

Output Speed (tokens/s) — higher is better
Step 3.5 Flash
193 tok/s
Devstral Small (Jul '25)
192 tok/s
Time to First Token (seconds) — lower is better
Step 3.5 Flash
0.91s
Devstral Small (Jul '25)
0.41s

Benchmark Comparison

Data from Artificial Analysis API — 12 benchmarks

Intelligence Index
37.815.2
Coding Index
31.612.1
Math Index
29.3
GPQA Diamond
83.1%41.4%
MMLU-Pro
62.2%
LiveCodeBench
25.4%
AIME 2025
29.3%
MATH-500
63.5%
Humanity's Last Exam
19.1%3.7%
SciCode
40.4%24.3%
IFBench
64.6%34.6%
TerminalBench
27.3%6.1%
Step 3.5 Flash7 wins
5 winsDevstral Small (Jul '25)

Frequently Asked Questions

Which is cheaper, Step 3.5 Flash or Devstral Small (Jul '25)?

Both models have similar pricing. Check the detailed breakdown above for input vs output token costs.

Which model performs better on benchmarks?

Step 3.5 Flash wins 7 out of 12 benchmarks compared to 5 for Devstral Small (Jul '25). See the detailed benchmark chart above for per-category results.

Which is faster for real-time applications?

Step 3.5 Flash generates tokens faster at 193 tok/s vs 192 tok/s. However, Devstral Small (Jul '25) has lower time-to-first-token (0.41s vs 0.91s).

When should I use Step 3.5 Flash vs Devstral Small (Jul '25)?

Choose based on your priorities: both are similarly priced, Step 3.5 Flash for stronger benchmark performance, and Step 3.5 Flash for faster generation. For latency-sensitive apps, check the TTFT comparison above.