Llama 3 8B (LMStudio)
llama-3-8b-lms
Model Size
4900 MB
Total Runs
37
Launch Date
2024-04-18
Model Capability
Level 2
Benchmark Performance
| Benchmark | Score | Best Score | Median latency | Avg cost | Run Date | Actions |
|---|---|---|---|---|---|---|
|
0305_python_prime_factorization
cost warning |
0
|
0 | 6940ms | 347µ$ | 2026-03-03 00:13:43 | Details |
|
0304_python_coin_change
cost warning |
0
|
0 | 7226ms | 361µ$ | 2026-03-03 00:13:34 | Details |
|
0303_python_letter_count
cost warning |
100
|
100 | 4749ms | 237µ$ | 2026-03-03 00:13:28 | Details |
|
0302_python_gcd
cost warning |
100
|
100 | 4998ms | 250µ$ | 2026-03-03 00:13:22 | Details |
|
0301_python_hello_world
cost warning |
100
|
100 | 1592ms | 80µ$ | 2026-03-03 00:13:20 | Details |
|
0155_historical_event_year
cost warning |
6
|
6 | 3402ms | 173µ$ | 2026-03-03 00:12:16 | Details |
|
0154_food_category_classification
cost warning |
95
|
95 | 2687ms | 134µ$ | 2026-03-03 00:11:22 | Details |
|
0153_book_author_match
cost warning |
89
|
89 | 3736ms | 193µ$ | 2026-03-03 00:10:11 | Details |
|
0152_syllogism_validity
cost warning |
62
|
62 | 4346ms | 230µ$ | 2026-03-03 00:08:56 | Details |
|
0151_geography
cost warning |
50
|
50 | 765ms | 38µ$ | 2026-03-03 00:05:53 | Details |
|
0033_plural
cost warning |
100
|
100 | 698ms | 35µ$ | 2026-03-03 00:05:24 | Details |
|
0032_part_of_speech
cost warning |
98
|
98 | 758ms | 38µ$ | 2026-03-03 00:04:52 | Details |
|
0031_definitions
cost warning |
98
|
98 | 396ms | 20µ$ | 2026-03-03 00:03:47 | Details |
|
0109_translation_ja_lt
cost warning |
75
|
75 | 952ms | 48µ$ | 2026-02-28 16:54:17 | Details |
|
0108_translation_it_lt
cost warning |
65
|
65 | 969ms | 48µ$ | 2026-02-28 16:53:34 | Details |
|
0107_translation_fr_ko
cost warning |
75
|
75 | 916ms | 46µ$ | 2026-02-28 16:52:53 | Details |
|
0106_translation_en_ja
cost warning |
68
|
68 | 903ms | 44µ$ | 2026-02-28 16:52:14 | Details |
|
0105_translation_en_zh
cost warning |
80
|
80 | 902ms | 44µ$ | 2026-02-28 16:51:33 | Details |
|
0104_translation_fr_es
cost warning · 1 excluded Q |
85
|
85 | 905ms | 44µ$ | 2026-02-28 16:50:54 | Details |
|
0103_translation_en_de
cost warning |
85
|
85 | 918ms | 46µ$ | 2026-02-28 16:50:12 | Details |
|
0102_translation_en_es
cost warning |
95
|
95 | 903ms | 44µ$ | 2026-02-28 16:49:33 | Details |
|
0101_translation_en_fr
cost warning |
90
|
90 | 882ms | 44µ$ | 2026-02-28 16:48:53 | Details |
|
0027_geometry
cost warning |
82
|
82 | 572ms | 30µ$ | 2026-02-28 16:48:25 | Details |
|
0026_time_arithmetic
cost warning |
65
|
65 | 580ms | 31µ$ | 2026-02-28 16:47:56 | Details |
|
0025_algebra
cost warning |
48
|
48 | 588ms | 35µ$ | 2026-02-28 16:47:24 | Details |
|
0024_percentage_math
cost warning |
90
|
90 | 572ms | 28µ$ | 2026-02-28 16:46:57 | Details |
|
0023_word_problems
cost warning |
100
|
100 | 570ms | 31µ$ | 2026-02-28 16:46:27 | Details |
|
0022_unit_conversion
cost warning |
80
|
80 | 634ms | 32µ$ | 2026-02-28 16:45:57 | Details |
|
0021_simple_arithmetic
cost warning |
100
|
100 | 563ms | 28µ$ | 2026-02-28 16:45:31 | Details |
|
0018_pinyin_letters
cost warning |
25
|
25 | 533ms | 30µ$ | 2026-02-28 16:45:15 | Details |
|
0017_synonyms
cost warning |
79
|
79 | 787ms | 44µ$ | 2026-02-28 16:44:25 | Details |
|
0016_antonym
cost warning |
100
|
100 | 672ms | 33µ$ | 2026-02-28 16:43:53 | Details |
|
0015_spell_check
cost warning |
98
|
98 | 948ms | 49µ$ | 2026-02-28 16:43:10 | Details |
|
0014_syllable_count
cost warning |
75
|
75 | 712ms | 36µ$ | 2026-02-28 16:42:37 | Details |
|
0013_vowel_count
cost warning |
38
|
38 | 695ms | 36µ$ | 2026-02-28 16:42:03 | Details |
|
0012_letter_count
cost warning |
15
|
15 | 568ms | 27µ$ | 2026-02-28 16:41:37 | Details |
|
0011_word_length
1 latency outlier · cost warning |
95
|
95 | 565ms | 132µ$ | 2026-02-28 16:39:43 | Details |