Gemma 4 12B (LMStudio)
gemma-4-12b-lms
Model Size
7560 MB
Total Runs
34
Launch Date
2026-06-03
Model Capability
Level 2
Benchmark Performance
| Benchmark | Score | Best Score | Median latency | Avg cost | Run Date | Actions |
|---|---|---|---|---|---|---|
| 0302_python_gcd |
100
|
100 | 78672ms | 3934µ$ | 2026-06-03 19:40:58 | Details |
| 0301_python_hello_world |
100
|
100 | 20546ms | 1027µ$ | 2026-06-03 19:39:37 | Details |
| 0155_historical_event_year |
89
|
89 | 4637ms | 275µ$ | 2026-06-03 19:39:15 | Details |
| 0154_food_category_classification |
90
|
90 | 3670ms | 193µ$ | 2026-06-03 19:37:35 | Details |
| 0153_book_author_match |
67
|
67 | 4110ms | 229µ$ | 2026-06-03 19:36:16 | Details |
| 0152_syllogism_validity |
88
|
88 | 10932ms | 540µ$ | 2026-06-03 19:34:52 | Details |
| 0151_geography |
98
|
98 | 1439ms | 77µ$ | 2026-06-03 19:29:27 | Details |
| 0033_plural |
98
|
98 | 1074ms | 57µ$ | 2026-06-03 19:28:23 | Details |
| 0032_part_of_speech |
98
|
98 | 1450ms | 76µ$ | 2026-06-03 19:27:36 | Details |
| 0031_definitions |
98
|
98 | 19474ms | 984µ$ | 2026-06-03 19:26:33 | Details |
| 0109_translation_ja_lt |
55
|
55 | 1842ms | 101µ$ | 2026-06-03 19:09:05 | Details |
| 0108_translation_it_lt |
55
|
55 | 1882ms | 100µ$ | 2026-06-03 19:07:42 | Details |
| 0107_translation_fr_ko |
85
|
85 | 1687ms | 96µ$ | 2026-06-03 19:06:20 | Details |
| 0106_translation_en_ja |
72
|
72 | 1566ms | 84µ$ | 2026-06-03 19:05:01 | Details |
| 0105_translation_en_zh |
57
|
57 | 1612ms | 86µ$ | 2026-06-03 19:03:52 | Details |
|
0104_translation_fr_es
1 excluded Q |
87
|
87 | 1522ms | 77µ$ | 2026-06-03 19:00:12 | Details |
| 0103_translation_en_de |
88
|
88 | 1446ms | 80µ$ | 2026-06-03 18:59:09 | Details |
| 0102_translation_en_es |
90
|
90 | 1490ms | 76µ$ | 2026-06-03 18:58:03 | Details |
| 0101_translation_en_fr |
88
|
88 | 1446ms | 73µ$ | 2026-06-03 18:56:59 | Details |
| 0027_geometry |
38
|
38 | 2006ms | 120µ$ | 2026-06-03 18:55:59 | Details |
| 0026_time_arithmetic |
70
|
70 | 1986ms | 101µ$ | 2026-06-03 18:54:21 | Details |
|
0025_algebra
1 latency outlier |
12
|
12 | 2798ms | 172µ$ | 2026-06-03 18:52:58 | Details |
| 0024_percentage_math |
72
|
72 | 1621ms | 97µ$ | 2026-06-03 18:50:39 | Details |
| 0023_word_problems |
45
|
45 | 1734ms | 97µ$ | 2026-06-03 18:49:20 | Details |
| 0022_unit_conversion |
25
|
25 | 2211ms | 119µ$ | 2026-06-03 18:48:01 | Details |
| 0021_simple_arithmetic |
95
|
95 | 1511ms | 79µ$ | 2026-06-03 18:46:24 | Details |
| 0018_pinyin_letters |
35
|
35 | 1446ms | 97µ$ | 2026-06-03 18:45:20 | Details |
| 0017_synonyms |
67
|
67 | 1783ms | 96µ$ | 2026-06-03 18:44:39 | Details |
| 0016_antonym |
95
|
95 | 1634ms | 90µ$ | 2026-06-03 18:42:58 | Details |
| 0015_spell_check |
88
|
88 | 1782ms | 95µ$ | 2026-06-03 18:41:44 | Details |
| 0014_syllable_count |
28
|
28 | 1860ms | 107µ$ | 2026-06-03 18:40:26 | Details |
| 0013_vowel_count |
12
|
12 | 1664ms | 94µ$ | 2026-06-03 18:38:59 | Details |
| 0012_letter_count |
72
|
72 | 1403ms | 77µ$ | 2026-06-03 18:37:42 | Details |
| 0011_word_length |
52
|
52 | 1378ms | 73µ$ | 2026-06-03 18:36:39 | Details |