Gemma 2 9B (LMStudio)
gemma-2-9b-lms
Model Size
5800 MB
Total Runs
37
Launch Date
2024-06-27
Model Capability
Level 2
Benchmark Performance
| Benchmark | Score | Best Score | Median latency | Avg cost | Run Date | Actions |
|---|---|---|---|---|---|---|
| 0305_python_prime_factorization |
100
|
100 | 8917ms | 446µ$ | 2026-03-02 23:10:42 | Details |
| 0304_python_coin_change |
0
|
0 | 12101ms | 605µ$ | 2026-03-02 23:10:29 | Details |
| 0303_python_letter_count |
100
|
100 | 7248ms | 362µ$ | 2026-03-02 23:10:20 | Details |
| 0302_python_gcd |
100
|
100 | 7020ms | 351µ$ | 2026-03-02 23:10:12 | Details |
| 0301_python_hello_world |
100
|
100 | 2291ms | 115µ$ | 2026-03-02 23:10:09 | Details |
| 0155_historical_event_year |
94
|
94 | 2992ms | 150µ$ | 2026-03-02 23:09:14 | Details |
| 0154_food_category_classification |
100
|
100 | 2297ms | 116µ$ | 2026-03-02 23:08:25 | Details |
| 0153_book_author_match |
100
|
100 | 2996ms | 145µ$ | 2026-03-02 23:07:32 | Details |
| 0152_syllogism_validity |
88
|
88 | 6058ms | 311µ$ | 2026-03-02 23:05:51 | Details |
| 0151_geography |
95
|
95 | 1100ms | 55µ$ | 2026-03-02 23:05:06 | Details |
| 0033_plural |
100
|
100 | 926ms | 48µ$ | 2026-03-02 23:04:26 | Details |
| 0032_part_of_speech |
98
|
98 | 1102ms | 55µ$ | 2026-03-02 23:03:41 | Details |
| 0031_definitions |
100
|
100 | 560ms | 29µ$ | 2026-03-02 23:02:08 | Details |
| 0109_translation_ja_lt |
92
|
92 | 1255ms | 63µ$ | 2026-02-28 15:30:19 | Details |
| 0108_translation_it_lt |
85
|
85 | 1253ms | 64µ$ | 2026-02-28 15:29:23 | Details |
| 0107_translation_fr_ko |
85
|
85 | 1246ms | 61µ$ | 2026-02-28 15:28:30 | Details |
| 0106_translation_en_ja |
70
|
70 | 1154ms | 57µ$ | 2026-02-28 15:27:40 | Details |
| 0105_translation_en_zh |
92
|
92 | 1095ms | 54µ$ | 2026-02-28 15:26:52 | Details |
|
0104_translation_fr_es
1 excluded Q |
85
|
85 | 1085ms | 54µ$ | 2026-02-28 15:26:04 | Details |
| 0103_translation_en_de |
90
|
90 | 1167ms | 57µ$ | 2026-02-28 15:25:14 | Details |
| 0102_translation_en_es |
98
|
98 | 1151ms | 57µ$ | 2026-02-28 15:24:24 | Details |
| 0101_translation_en_fr |
88
|
88 | 1157ms | 84µ$ | 2026-02-28 15:22:41 | Details |
| 0027_geometry |
95
|
95 | 767ms | 42µ$ | 2026-02-28 15:03:45 | Details |
| 0026_time_arithmetic |
70
|
70 | 1012ms | 51µ$ | 2026-02-28 15:03:00 | Details |
| 0025_algebra |
72
|
72 | 976ms | 50µ$ | 2026-02-28 15:02:15 | Details |
| 0024_percentage_math |
98
|
98 | 718ms | 37µ$ | 2026-02-28 15:01:41 | Details |
| 0023_word_problems |
100
|
100 | 900ms | 45µ$ | 2026-02-28 15:01:01 | Details |
| 0022_unit_conversion |
98
|
98 | 1108ms | 56µ$ | 2026-02-28 15:00:11 | Details |
| 0021_simple_arithmetic |
100
|
100 | 664ms | 34µ$ | 2026-02-28 14:59:40 | Details |
| 0018_pinyin_letters |
30
|
30 | 810ms | 45µ$ | 2026-02-28 14:59:17 | Details |
| 0017_synonyms |
96
|
96 | 1050ms | 53µ$ | 2026-02-28 14:58:18 | Details |
| 0016_antonym |
100
|
100 | 928ms | 47µ$ | 2026-02-28 14:57:36 | Details |
| 0015_spell_check |
100
|
100 | 1430ms | 70µ$ | 2026-02-28 14:56:35 | Details |
| 0014_syllable_count |
70
|
70 | 1051ms | 52µ$ | 2026-02-28 14:55:48 | Details |
| 0013_vowel_count |
38
|
38 | 970ms | 49µ$ | 2026-02-28 14:55:05 | Details |
| 0012_letter_count |
30
|
30 | 600ms | 31µ$ | 2026-02-28 14:54:35 | Details |
|
0011_word_length
1 latency outlier |
60
|
60 | 725ms | 120µ$ | 2026-02-28 14:52:24 | Details |