1. ❌ Failed to Load Models
    Could not fetch models from Ollama.

Enterprice LLM Performance Benchmark

Triple Validation Testing

Provider Settings

Configure API endpoints and keys for different model providers: OpenAI, Anthropic, Gemini, Groq, Ollama, Base44 and more

Models

0

Tests Run

14

Avg Accuracy

49.9%

Avg Drift

-13.8%

Regressing

Best Model

qwen2.5-coder

82% accuracy

Most Efficient

617.8

qwen2.5

Export:

Model Leaderboard

RankStatus
Model
Provider
GDPRSecurity
Accuracy
Correct/Total
Tokens
Cost
Speed
Perf Score
Drift
Energy
Cost/Q
Errors
Endpoint

qwen2.5-coder:1.5b

940 MB

ollama
Yes
Secure
82.4%206/250
93,288373/q
$0.9329
0.27s/query
306.5
-1.4%
326.0
$0.00373/q$0.9329 total
✓
https://christy-ramentaceous-verbatim.ngrok-free.dev

gemma3:1b

778 MB

ollama
Yes
Secure
76.8%192/250
93,099372/q
$0.9310
0.47s/query
164.7
-2.0%
211.7
$0.00372/q$0.9310 total
✓
https://christy-ramentaceous-verbatim.ngrok-free.dev

qwen2.5:3b

1841 MB

ollama
Yes
Secure
75.6%189/250
93,312373/q
$0.9331
0.95s/query
79.2
+4.4%
43.0
$0.00373/q$0.9331 total
✓
https://christy-ramentaceous-verbatim.ngrok-free.dev
4

llama3.2:1b

1260 MB

ollama
Yes
Secure
66.4%166/250
92,259369/q
$0.9226
0.29s/query
229.2
+3.8%
181.9
$0.00369/q$0.9226 total
✓
https://christy-ramentaceous-verbatim.ngrok-free.dev
5

qwen2.5:0.5b

379 MB

ollama
Yes
Secure
60.4%151/250
93,254373/q
$0.9325
0.26s/query
234.1-617.8
$0.00373/q$0.9325 total
✓
https://christy-ramentaceous-verbatim.ngrok-free.dev
6

qwen2.5-coder:0.5b

379 MB

ollama
Yes
Secure
59.2%148/250
93,307373/q
$0.9331
0.27s/query
223.3
+2.1%
589.1
$0.00373/q$0.9331 total
✓
https://christy-ramentaceous-verbatim.ngrok-free.dev
7

qwen3:0.6b

498 MB

ollama
Yes
Secure
54.4%136/250
88,434354/q
$0.8843
0.26s/query
210.6
+22.5%
423.0
$0.00354/q$0.8843 total
✓
https://christy-ramentaceous-verbatim.ngrok-free.dev
8

tinyllama:1.1b

608 MB

ollama
Yes
Secure
53.2%133/250
113,872455/q
$1.1387
0.20s/query
268.3
0.0%
441.4
$0.00455/q$1.1387 total
✓
https://christy-ramentaceous-verbatim.ngrok-free.dev
9

moondream:latest

1658 MB

ollama
Yes
Secure
52.8%132/250
106,369425/q
$1.0637
0.96s/query
54.8-33.0
$0.00425/q$1.0637 total
5
https://christy-ramentaceous-verbatim.ngrok-free.dev
10

orca-mini:latest

1888 MB

ollama
Yes
Secure
52.0%130/250
112,687451/q
$1.1269
0.96s/query
53.9
-3.0%
28.6
$0.00451/q$1.1269 total
✓
https://christy-ramentaceous-verbatim.ngrok-free.dev
11

qwen3:1.7b

1296 MB

ollama
Yes
Secure
43.6%109/250
88,460354/q
$0.8846
0.35s/query
124.4
-9.2%
96.0
$0.00354/q$0.8846 total
✓
https://christy-ramentaceous-verbatim.ngrok-free.dev
12

llama3.2:3b

1926 MB

ollama
Yes
Secure
22.4%56/250
46,906188/q
$0.4691
25.03s/query
0.9
+16.7%
0.5
$0.00188/q$0.4691 total
123
https://christy-ramentaceous-verbatim.ngrok-free.dev
  1. ❌ Failed to Load Models
    Could not fetch models from Ollama.
Notification ❌ Failed to Load ModelsCould not fetch models from Ollama.Notification ❌ Failed to Load ModelsCould not fetch models from Ollama.