Llama 3.1 8B (LMStudio)
llama-3.1-8b-lms
Model Size
4900 MB
Total Runs
37
Launch Date
2024-07-23
Model Capability
Level 2
Benchmark Performance
| Benchmark | Score | Best Score | Median latency | Avg cost | Run Date | Actions |
|---|---|---|---|---|---|---|
|
0305_python_prime_factorization
cost warning |
100
|
100 | 6034ms | 302µ$ | 2026-03-02 20:44:33 | Details |
|
0304_python_coin_change
cost warning |
0
|
0 | 16252ms | 813µ$ | 2026-03-02 20:44:13 | Details |
|
0303_python_letter_count
cost warning |
100
|
100 | 13036ms | 652µ$ | 2026-03-02 20:43:55 | Details |
|
0302_python_gcd
cost warning |
100
|
100 | 5551ms | 278µ$ | 2026-03-02 20:43:46 | Details |
|
0301_python_hello_world
cost warning |
100
|
100 | 1451ms | 73µ$ | 2026-03-02 20:43:40 | Details |
|
0155_historical_event_year
cost warning |
17
|
17 | 4595ms | 232µ$ | 2026-03-02 20:42:12 | Details |
|
0154_food_category_classification
cost warning |
75
|
75 | 2668ms | 135µ$ | 2026-03-02 20:41:14 | Details |
|
0153_book_author_match
cost warning |
89
|
89 | 4020ms | 209µ$ | 2026-03-02 20:39:54 | Details |
|
0152_syllogism_validity
cost warning |
69
|
69 | 5841ms | 319µ$ | 2026-03-02 20:38:08 | Details |
|
0151_geography
cost warning |
70
|
70 | 868ms | 49µ$ | 2026-03-02 20:37:24 | Details |
|
0033_plural
cost warning |
98
|
98 | 715ms | 36µ$ | 2026-03-02 20:36:51 | Details |
|
0032_part_of_speech
cost warning |
95
|
95 | 816ms | 40µ$ | 2026-03-02 20:36:14 | Details |
|
0031_definitions
cost warning |
98
|
98 | 398ms | 21µ$ | 2026-03-02 20:35:52 | Details |
|
0109_translation_ja_lt
cost warning |
75
|
75 | 946ms | 48µ$ | 2026-02-28 17:09:45 | Details |
|
0108_translation_it_lt
cost warning |
68
|
68 | 976ms | 49µ$ | 2026-02-28 17:09:01 | Details |
|
0107_translation_fr_ko
cost warning |
72
|
72 | 828ms | 42µ$ | 2026-02-28 17:08:23 | Details |
|
0106_translation_en_ja
cost warning |
75
|
75 | 860ms | 44µ$ | 2026-02-28 17:07:42 | Details |
|
0105_translation_en_zh
cost warning |
48
|
48 | 901ms | 47µ$ | 2026-02-28 17:07:00 | Details |
|
0104_translation_fr_es
cost warning · 1 excluded Q |
82
|
82 | 814ms | 40µ$ | 2026-02-28 17:06:23 | Details |
|
0103_translation_en_de
cost warning |
92
|
92 | 844ms | 43µ$ | 2026-02-28 17:05:44 | Details |
|
0102_translation_en_es
cost warning |
98
|
98 | 823ms | 41µ$ | 2026-02-28 17:05:06 | Details |
|
0101_translation_en_fr
cost warning |
85
|
85 | 818ms | 42µ$ | 2026-02-28 17:04:28 | Details |
|
0027_geometry
cost warning |
60
|
60 | 622ms | 33µ$ | 2026-02-28 17:03:58 | Details |
|
0026_time_arithmetic
cost warning |
55
|
55 | 706ms | 36µ$ | 2026-02-28 17:03:25 | Details |
|
0025_algebra
cost warning |
55
|
55 | 740ms | 37µ$ | 2026-02-28 17:02:51 | Details |
|
0024_percentage_math
cost warning |
100
|
100 | 615ms | 31µ$ | 2026-02-28 17:02:21 | Details |
|
0023_word_problems
cost warning |
70
|
70 | 606ms | 30µ$ | 2026-02-28 17:01:52 | Details |
|
0022_unit_conversion
cost warning |
85
|
85 | 634ms | 32µ$ | 2026-02-28 17:01:22 | Details |
|
0021_simple_arithmetic
cost warning |
90
|
90 | 607ms | 30µ$ | 2026-02-28 17:00:54 | Details |
|
0018_pinyin_letters
cost warning |
15
|
15 | 526ms | 29µ$ | 2026-02-28 17:00:38 | Details |
|
0017_synonyms
cost warning |
81
|
81 | 804ms | 44µ$ | 2026-02-28 16:59:47 | Details |
|
0016_antonym
cost warning |
100
|
100 | 693ms | 35µ$ | 2026-02-28 16:59:15 | Details |
|
0015_spell_check
cost warning |
92
|
92 | 960ms | 49µ$ | 2026-02-28 16:58:31 | Details |
|
0014_syllable_count
cost warning |
88
|
88 | 729ms | 36µ$ | 2026-02-28 16:57:58 | Details |
|
0013_vowel_count
cost warning |
42
|
42 | 732ms | 38µ$ | 2026-02-28 16:57:23 | Details |
|
0012_letter_count
cost warning |
35
|
35 | 606ms | 28µ$ | 2026-02-28 16:56:55 | Details |
|
0011_word_length
1 latency outlier · cost warning |
75
|
75 | 623ms | 138µ$ | 2026-02-28 16:55:00 | Details |