Gemma 3 12B (LMStudio)
gemma-3-12b-lms
Model Size
8100 MB
Total Runs
36
Launch Date
2025-03-12
Model Capability
Level 2
Benchmark Performance
| Benchmark | Score | Best Score | Median latency | Avg cost | Run Date | Actions |
|---|---|---|---|---|---|---|
| 0305_python_prime_factorization |
100
|
100 | 13446ms | 672µ$ | 2026-03-02 23:44:41 | Details |
| 0304_python_coin_change |
100
|
100 | 25978ms | 1299µ$ | 2026-03-02 23:44:14 | Details |
| 0303_python_letter_count |
100
|
100 | 9981ms | 499µ$ | 2026-03-02 23:44:03 | Details |
| 0302_python_gcd |
100
|
100 | 7905ms | 395µ$ | 2026-03-02 23:43:54 | Details |
| 0301_python_hello_world |
100
|
100 | 2824ms | 141µ$ | 2026-03-02 23:43:50 | Details |
| 0155_historical_event_year |
100
|
100 | 9206ms | 454µ$ | 2026-03-02 23:41:05 | Details |
| 0154_food_category_classification |
100
|
100 | 6117ms | 290µ$ | 2026-03-02 23:39:08 | Details |
| 0153_book_author_match |
100
|
100 | 9186ms | 465µ$ | 2026-03-02 23:36:19 | Details |
| 0152_syllogism_validity |
94
|
94 | 9676ms | 510µ$ | 2026-03-02 23:33:34 | Details |
| 0151_geography |
100
|
100 | 1686ms | 89µ$ | 2026-03-02 23:32:22 | Details |
| 0033_plural |
100
|
100 | 1404ms | 76µ$ | 2026-03-02 23:31:20 | Details |
| 0032_part_of_speech |
100
|
100 | 1830ms | 95µ$ | 2026-03-02 23:30:03 | Details |
| 0109_translation_ja_lt |
100
|
100 | 2042ms | 102µ$ | 2026-02-28 16:10:06 | Details |
| 0108_translation_it_lt |
88
|
88 | 2107ms | 105µ$ | 2026-02-28 16:08:37 | Details |
| 0107_translation_fr_ko |
80
|
80 | 2076ms | 102µ$ | 2026-02-28 16:07:11 | Details |
| 0106_translation_en_ja |
90
|
90 | 1921ms | 97µ$ | 2026-02-28 16:05:49 | Details |
| 0105_translation_en_zh |
98
|
98 | 1876ms | 95µ$ | 2026-02-28 16:04:27 | Details |
|
0104_translation_fr_es
1 excluded Q |
82
|
82 | 1858ms | 94µ$ | 2026-02-28 16:03:08 | Details |
| 0103_translation_en_de |
92
|
92 | 1888ms | 96µ$ | 2026-02-28 16:01:47 | Details |
| 0102_translation_en_es |
95
|
95 | 1901ms | 95µ$ | 2026-02-28 16:00:26 | Details |
| 0101_translation_en_fr |
88
|
88 | 1828ms | 98µ$ | 2026-02-28 15:59:02 | Details |
| 0027_geometry |
95
|
95 | 1464ms | 77µ$ | 2026-02-28 15:57:56 | Details |
| 0026_time_arithmetic |
70
|
70 | 1704ms | 89µ$ | 2026-02-28 15:56:41 | Details |
| 0025_algebra |
85
|
85 | 1374ms | 77µ$ | 2026-02-28 15:55:35 | Details |
| 0024_percentage_math |
100
|
100 | 1444ms | 72µ$ | 2026-02-28 15:54:33 | Details |
| 0023_word_problems |
100
|
100 | 1466ms | 75µ$ | 2026-02-28 15:53:28 | Details |
| 0022_unit_conversion |
95
|
95 | 1856ms | 97µ$ | 2026-02-28 15:52:06 | Details |
| 0021_simple_arithmetic |
100
|
100 | 1489ms | 78µ$ | 2026-02-28 15:50:59 | Details |
| 0018_pinyin_letters |
50
|
50 | 1626ms | 92µ$ | 2026-02-28 15:50:17 | Details |
| 0017_synonyms |
98
|
98 | 1764ms | 92µ$ | 2026-02-28 15:48:37 | Details |
| 0016_antonym |
100
|
100 | 1702ms | 86µ$ | 2026-02-28 15:47:23 | Details |
| 0015_spell_check |
100
|
100 | 2048ms | 106µ$ | 2026-02-28 15:45:53 | Details |
| 0014_syllable_count |
48
|
48 | 1623ms | 85µ$ | 2026-02-28 15:44:41 | Details |
| 0013_vowel_count |
42
|
42 | 1501ms | 80µ$ | 2026-02-28 15:43:33 | Details |
| 0012_letter_count |
52
|
52 | 1328ms | 70µ$ | 2026-02-28 15:42:32 | Details |
| 0011_word_length |
85
|
85 | 1278ms | 169µ$ | 2026-02-28 15:39:32 | Details |