Phi-4 (LMStudio)
phi-4-lms
Model Size
9100 MB
Total Runs
37
Launch Date
2024-12-12
Model Capability
Level 2
Benchmark Performance
| Benchmark | Score | Best Score | Median latency | Avg cost | Run Date | Actions |
|---|---|---|---|---|---|---|
| 0305_python_prime_factorization |
100
|
100 | 12348ms | 617µ$ | 2026-03-03 01:28:54 | Details |
| 0304_python_coin_change |
0
|
0 | 21341ms | 1067µ$ | 2026-03-03 01:28:31 | Details |
| 0303_python_letter_count |
0
|
0 | 8626ms | 431µ$ | 2026-03-03 01:28:22 | Details |
| 0302_python_gcd |
100
|
100 | 9782ms | 489µ$ | 2026-03-03 01:28:11 | Details |
| 0301_python_hello_world |
100
|
100 | 3153ms | 158µ$ | 2026-03-03 01:28:06 | Details |
| 0155_historical_event_year |
94
|
94 | 12528ms | 633µ$ | 2026-03-03 01:24:17 | Details |
| 0154_food_category_classification |
100
|
100 | 12760ms | 632µ$ | 2026-03-03 01:20:02 | Details |
| 0153_book_author_match |
94
|
94 | 14948ms | 761µ$ | 2026-03-03 01:15:26 | Details |
| 0152_syllogism_validity |
100
|
100 | 18458ms | 1041µ$ | 2026-03-03 01:09:50 | Details |
| 0151_geography |
88
|
88 | 1671ms | 88µ$ | 2026-03-03 01:08:38 | Details |
| 0109_translation_ja_lt |
90
|
90 | 1918ms | 96µ$ | 2026-03-03 01:07:20 | Details |
| 0108_translation_it_lt |
90
|
90 | 1964ms | 96µ$ | 2026-03-03 01:06:01 | Details |
| 0107_translation_fr_ko |
95
|
95 | 1952ms | 96µ$ | 2026-03-03 01:04:43 | Details |
| 0106_translation_en_ja |
92
|
92 | 1874ms | 92µ$ | 2026-03-03 01:03:28 | Details |
| 0105_translation_en_zh |
98
|
98 | 1894ms | 92µ$ | 2026-03-03 01:02:13 | Details |
|
0104_translation_fr_es
1 excluded Q |
92
|
92 | 1536ms | 76µ$ | 2026-03-03 01:01:10 | Details |
| 0103_translation_en_de |
88
|
88 | 1610ms | 82µ$ | 2026-03-03 01:00:03 | Details |
| 0102_translation_en_es |
92
|
92 | 1597ms | 79µ$ | 2026-03-03 00:58:58 | Details |
| 0101_translation_en_fr |
90
|
90 | 1588ms | 79µ$ | 2026-03-03 00:57:53 | Details |
| 0033_plural |
100
|
100 | 1205ms | 63µ$ | 2026-03-03 00:57:02 | Details |
| 0032_part_of_speech |
100
|
100 | 1422ms | 71µ$ | 2026-03-03 00:56:03 | Details |
| 0031_definitions |
100
|
100 | 850ms | 43µ$ | 2026-03-03 00:55:27 | Details |
| 0027_geometry |
100
|
100 | 1122ms | 55µ$ | 2026-03-03 00:54:42 | Details |
| 0026_time_arithmetic |
90
|
90 | 1339ms | 64µ$ | 2026-03-03 00:53:50 | Details |
| 0025_algebra |
90
|
90 | 918ms | 56µ$ | 2026-03-03 00:53:04 | Details |
| 0024_percentage_math |
100
|
100 | 916ms | 51µ$ | 2026-03-03 00:52:22 | Details |
| 0023_word_problems |
100
|
100 | 1086ms | 55µ$ | 2026-03-03 00:51:37 | Details |
| 0022_unit_conversion |
98
|
98 | 1219ms | 64µ$ | 2026-03-03 00:50:44 | Details |
| 0021_simple_arithmetic |
100
|
100 | 1112ms | 51µ$ | 2026-03-03 00:50:02 | Details |
| 0018_pinyin_letters |
35
|
35 | 1092ms | 62µ$ | 2026-03-03 00:49:36 | Details |
| 0017_synonyms |
94
|
94 | 1708ms | 91µ$ | 2026-03-03 00:48:00 | Details |
| 0016_antonym |
100
|
100 | 1248ms | 63µ$ | 2026-03-03 00:47:08 | Details |
| 0015_spell_check |
95
|
95 | 1856ms | 96µ$ | 2026-03-03 00:45:51 | Details |
| 0014_syllable_count |
95
|
95 | 1361ms | 71µ$ | 2026-03-03 00:44:52 | Details |
| 0013_vowel_count |
85
|
85 | 1246ms | 63µ$ | 2026-03-03 00:44:00 | Details |
| 0012_letter_count |
48
|
48 | 1120ms | 53µ$ | 2026-03-03 00:43:17 | Details |
| 0011_word_length |
100
|
100 | 938ms | 54µ$ | 2026-03-03 00:41:06 | Details |