OLMo 3 7B (LMStudio)
olmo-3-7b-lms
Model Size
4300 MB
Total Runs
37
Launch Date
2024-11-27
Model Capability
Level 2
Benchmark Performance
| Benchmark | Score | Best Score | Median latency | Avg cost | Run Date | Actions |
|---|---|---|---|---|---|---|
| 0305_python_prime_factorization |
100
|
100 | 6080ms | 304µ$ | 2026-03-02 20:31:22 | Details |
| 0304_python_coin_change |
100
|
100 | 9870ms | 494µ$ | 2026-03-02 20:31:08 | Details |
| 0303_python_letter_count |
0
|
0 | 5780ms | 289µ$ | 2026-03-02 20:30:58 | Details |
| 0302_python_gcd |
100
|
100 | 4716ms | 236µ$ | 2026-03-02 20:30:50 | Details |
| 0301_python_hello_world |
100
|
100 | 1637ms | 82µ$ | 2026-03-02 20:30:44 | Details |
| 0155_historical_event_year |
67
|
67 | 3639ms | 188µ$ | 2026-03-02 20:29:32 | Details |
| 0154_food_category_classification |
75
|
75 | 3506ms | 184µ$ | 2026-03-02 20:28:14 | Details |
| 0153_book_author_match |
94
|
94 | 4290ms | 216µ$ | 2026-03-02 20:26:52 | Details |
| 0152_syllogism_validity |
62
|
62 | 7498ms | 373µ$ | 2026-03-02 20:24:48 | Details |
| 0151_geography |
95
|
95 | 561ms | 29µ$ | 2026-03-02 20:24:20 | Details |
| 0033_plural |
95
|
95 | 664ms | 33µ$ | 2026-03-02 20:23:49 | Details |
| 0032_part_of_speech |
95
|
95 | 716ms | 36µ$ | 2026-03-02 20:23:16 | Details |
| 0031_definitions |
100
|
100 | 372ms | 106µ$ | 2026-03-02 20:21:46 | Details |
| 0109_translation_ja_lt |
28
|
28 | 906ms | 46µ$ | 2026-02-28 17:44:25 | Details |
| 0108_translation_it_lt |
30
|
30 | 914ms | 47µ$ | 2026-02-28 17:43:42 | Details |
| 0107_translation_fr_ko |
52
|
52 | 894ms | 46µ$ | 2026-02-28 17:43:01 | Details |
| 0106_translation_en_ja |
75
|
75 | 932ms | 46µ$ | 2026-02-28 17:42:20 | Details |
| 0105_translation_en_zh |
88
|
88 | 914ms | 44µ$ | 2026-02-28 17:41:40 | Details |
|
0104_translation_fr_es
1 excluded Q |
69
|
69 | 755ms | 37µ$ | 2026-02-28 17:41:06 | Details |
| 0103_translation_en_de |
92
|
92 | 758ms | 38µ$ | 2026-02-28 17:40:31 | Details |
| 0102_translation_en_es |
75
|
75 | 695ms | 36µ$ | 2026-02-28 17:39:58 | Details |
| 0101_translation_en_fr |
82
|
82 | 739ms | 37µ$ | 2026-02-28 17:39:24 | Details |
| 0027_geometry |
95
|
95 | 467ms | 26µ$ | 2026-02-28 17:38:58 | Details |
| 0026_time_arithmetic |
65
|
65 | 518ms | 27µ$ | 2026-02-28 17:38:31 | Details |
| 0025_algebra |
62
|
62 | 594ms | 31µ$ | 2026-02-28 17:38:02 | Details |
| 0024_percentage_math |
98
|
98 | 458ms | 24µ$ | 2026-02-28 17:37:39 | Details |
| 0023_word_problems |
100
|
100 | 448ms | 24µ$ | 2026-02-28 17:37:15 | Details |
| 0022_unit_conversion |
98
|
98 | 645ms | 32µ$ | 2026-02-28 17:36:45 | Details |
| 0021_simple_arithmetic |
100
|
100 | 433ms | 23µ$ | 2026-02-28 17:36:22 | Details |
| 0018_pinyin_letters |
20
|
20 | 466ms | 27µ$ | 2026-02-28 17:36:07 | Details |
| 0017_synonyms |
77
|
77 | 812ms | 42µ$ | 2026-02-28 17:35:19 | Details |
| 0016_antonym |
100
|
100 | 631ms | 32µ$ | 2026-02-28 17:34:49 | Details |
| 0015_spell_check |
85
|
85 | 810ms | 43µ$ | 2026-02-28 17:34:10 | Details |
| 0014_syllable_count |
62
|
62 | 666ms | 33µ$ | 2026-02-28 17:33:38 | Details |
| 0013_vowel_count |
68
|
68 | 636ms | 32µ$ | 2026-02-28 17:33:08 | Details |
| 0012_letter_count |
45
|
45 | 442ms | 24µ$ | 2026-02-28 17:32:44 | Details |
|
0011_word_length
1 latency outlier |
82
|
82 | 521ms | 114µ$ | 2026-02-28 17:31:08 | Details |