Gemma 2B (LMStudio)
gemma-2b-lms
Model Size
1500 MB
Total Runs
37
Launch Date
2024-02-21
Model Capability
Level 1
Benchmark Performance
| Benchmark | Score | Best Score | Median latency | Avg cost | Run Date | Actions |
|---|---|---|---|---|---|---|
| 0305_python_prime_factorization |
0
|
0 | 4337ms | 217µ$ | 2026-03-02 23:14:18 | Details |
| 0304_python_coin_change |
0
|
0 | 7292ms | 365µ$ | 2026-03-02 23:14:09 | Details |
| 0303_python_letter_count |
0
|
0 | 4930ms | 247µ$ | 2026-03-02 23:14:03 | Details |
| 0302_python_gcd |
0
|
0 | 4855ms | 243µ$ | 2026-03-02 23:13:55 | Details |
| 0301_python_hello_world |
100
|
100 | 677ms | 34µ$ | 2026-03-02 23:13:53 | Details |
| 0155_historical_event_year |
44
|
44 | 770ms | 41µ$ | 2026-03-02 23:13:37 | Details |
| 0154_food_category_classification |
20
|
20 | 753ms | 40µ$ | 2026-03-02 23:13:20 | Details |
| 0153_book_author_match |
11
|
11 | 717ms | 38µ$ | 2026-03-02 23:13:05 | Details |
| 0152_syllogism_validity |
0
|
0 | 934ms | 49µ$ | 2026-03-02 23:12:49 | Details |
| 0151_geography |
82
|
82 | 382ms | 20µ$ | 2026-03-02 23:12:32 | Details |
| 0033_plural |
88
|
88 | 322ms | 16µ$ | 2026-03-02 23:12:17 | Details |
| 0032_part_of_speech |
70
|
70 | 412ms | 21µ$ | 2026-03-02 23:11:59 | Details |
| 0031_definitions |
2
|
2 | 680ms | 33µ$ | 2026-03-02 23:10:52 | Details |
| 0109_translation_ja_lt |
22
|
22 | 410ms | 20µ$ | 2026-02-28 15:39:12 | Details |
| 0108_translation_it_lt |
15
|
15 | 406ms | 20µ$ | 2026-02-28 15:38:52 | Details |
| 0107_translation_fr_ko |
48
|
48 | 410ms | 20µ$ | 2026-02-28 15:38:31 | Details |
| 0106_translation_en_ja |
60
|
60 | 398ms | 19µ$ | 2026-02-28 15:38:11 | Details |
| 0105_translation_en_zh |
72
|
72 | 381ms | 19µ$ | 2026-02-28 15:37:52 | Details |
|
0104_translation_fr_es
1 excluded Q |
46
|
46 | 384ms | 19µ$ | 2026-02-28 15:37:32 | Details |
| 0103_translation_en_de |
48
|
48 | 384ms | 19µ$ | 2026-02-28 15:37:12 | Details |
| 0102_translation_en_es |
55
|
55 | 392ms | 19µ$ | 2026-02-28 15:36:53 | Details |
| 0101_translation_en_fr |
52
|
52 | 394ms | 19µ$ | 2026-02-28 15:36:33 | Details |
| 0027_geometry |
30
|
30 | 314ms | 17µ$ | 2026-02-28 15:36:16 | Details |
| 0026_time_arithmetic |
8
|
8 | 434ms | 22µ$ | 2026-02-28 15:35:54 | Details |
| 0025_algebra |
30
|
30 | 322ms | 17µ$ | 2026-02-28 15:35:36 | Details |
| 0024_percentage_math |
52
|
52 | 296ms | 15µ$ | 2026-02-28 15:35:20 | Details |
| 0023_word_problems |
68
|
68 | 338ms | 17µ$ | 2026-02-28 15:35:02 | Details |
| 0022_unit_conversion |
12
|
12 | 346ms | 17µ$ | 2026-02-28 15:34:44 | Details |
| 0021_simple_arithmetic |
98
|
98 | 310ms | 16µ$ | 2026-02-28 15:34:27 | Details |
| 0018_pinyin_letters |
60
|
60 | 349ms | 18µ$ | 2026-02-28 15:34:16 | Details |
| 0017_synonyms |
31
|
31 | 390ms | 20µ$ | 2026-02-28 15:33:50 | Details |
| 0016_antonym |
90
|
90 | 393ms | 20µ$ | 2026-02-28 15:33:30 | Details |
| 0015_spell_check |
55
|
55 | 507ms | 28µ$ | 2026-02-28 15:33:03 | Details |
| 0014_syllable_count |
22
|
22 | 360ms | 18µ$ | 2026-02-28 15:32:44 | Details |
| 0013_vowel_count |
28
|
28 | 364ms | 18µ$ | 2026-02-28 15:32:25 | Details |
| 0012_letter_count |
20
|
20 | 288ms | 14µ$ | 2026-02-28 15:32:09 | Details |
|
0011_word_length
1 latency outlier |
20
|
20 | 292ms | 63µ$ | 2026-02-28 15:31:14 | Details |