Run Details #336

Model

Llama 3 8B (LMStudio)

Score

85

Stored run score 82 recalculated to 85 after question exclusions.

Correct (≥100)

33/39

Incorrect (<100)

6

Median Time

905.0ms

Tokens Used

10654

Cost

$0.0017

1 question is excluded from aggregate scoring for this run. Aggregate cards above are recalculated using the 39 active questions only.

Suspicious cost data. Stored run cost differs noticeably from the current pricing estimate. Stored total: $0.0017 · Current estimate: 0µ$ (verified)

Benchmark: 0104_translation_fr_es

Run Date: 2026-02-28 16:50:54

Questions (40)

Question: Translate this word: "mayonnaise"

Expected

mayonesa

Provided

mayonesa

Question: Translate this word: "melon"

Expected

melón

Provided

melón

Question: Translate this word: "cacahuète"

Expected

cacahuete

Provided

cacahuete

Question: Translate this word: "ail"

Expected

ajo

Provided

plato

Question: Translate this word: "liste"

Expected

lista

Provided

lista

Question: Translate this word: "carte"

Expected

mapa

Provided

billete

Question: Translate this word: "formulaire"

Expected

formulario

Provided

informe

Question: Translate this word: "page"

Expected

página

Provided

página

Question: Translate this word: "coin"

Expected

esquina

Provided

moneda

Question: Translate this word: "arc"

Expected

arco

Provided

arco

Question: Translate this word: "volée"

Expected

tramo

Provided

portón

Question: Translate this word: "sol"

Expected

suelo

Provided

suelo

Question: Translate this word: "laine"

Expected

lana

Provided

lana

Question: Translate this word: "huile"

Expected

aceite

Provided

aceite

Question: Translate this word: "encre"

Expected

tinta

Provided

tinta

Question: Translate this word: "caoutchouc"

Expected

caucho

Provided

caucho

Question: Translate this word: "rue"

Expected

calle

Provided

calle

Question: Translate this word: "route"

Expected

carretera

Provided

carretera

Question: Translate this word: "autoroute"

Expected

autopista

Provided

autopista

Question: Translate this word: "tunnel"

Expected

túnel

Provided

túnel

Question: Translate this word: "canon"

Expected

cañón

Provided

cañón

Excluded from aggregate scoring. Pistol or rifle?

Question: Translate this word: "fusil"

Expected

pistola

Provided

rifle

Question: Translate this word: "balle"

Expected

bala

Provided

bala

Question: Translate this word: "bâton"

Expected

bastón

Provided

bastón

Question: Translate this word: "avion"

Expected

avión

Provided

avión

Question: Translate this word: "vélo"

Expected

bicicleta

Provided

bicicleta

Question: Translate this word: "tramway"

Expected

tranvía

Provided

tranvía

Question: Translate this word: "taxi"

Expected

taxi

Provided

taxi

Question: Translate this word: "corne"

Expected

cuerno

Provided

cuerno

Question: Translate this word: "lèvre"

Expected

labio

Provided

labio

Question: Translate this word: "pouls"

Expected

pulso

Provided

pulso

Question: Translate this word: "tempe"

Expected

sien

Provided

espalda

Question: Translate this word: "écraser"

Expected

aplastar

Provided

aplastar

Question: Translate this word: "démolir"

Expected

demoler

Provided

demoler

Question: Translate this word: "brûler"

Expected

quemar

Provided

quemar

Question: Translate this word: "dissoudre"

Expected

disolver

Provided

disolver

Question: Translate this word: "noir"

Expected

negro

Provided

negro

Question: Translate this word: "orange"

Expected

naranja

Provided

naranja

Question: Translate this word: "brun"

Expected

marrón

Provided

marrón

Question: Translate this word: "violet"

Expected

morado

Provided

morado

Run Details #336

Model

Llama 3 8B (LMStudio)

Score

85

Correct (≥100)

33/39

Incorrect (<100)

6

Median Time

905.0ms

Tokens Used

10654

Cost

$0.0017

Questions (40)

0104_translation_fr_es:0 Correct Score: 100 • 1001ms • 277 tokens • 50µ$

0104_translation_fr_es:1 Correct Score: 100 • 940ms • 280 tokens • 47µ$

0104_translation_fr_es:2 Correct Score: 100 • 951ms • 276 tokens • 48µ$

0104_translation_fr_es:3 Incorrect Score: 0 • 894ms • 273 tokens • 45µ$

0104_translation_fr_es:4 Correct Score: 100 • 714ms • 266 tokens • 36µ$

0104_translation_fr_es:5 Incorrect Score: 0 • 773ms • 269 tokens • 39µ$

0104_translation_fr_es:6 Incorrect Score: 0 • 761ms • 269 tokens • 38µ$

0104_translation_fr_es:7 Correct Score: 100 • 672ms • 265 tokens • 34µ$

0104_translation_fr_es:8 Incorrect Score: 0 • 891ms • 274 tokens • 45µ$

0104_translation_fr_es:9 Correct Score: 100 • 761ms • 271 tokens • 38µ$

0104_translation_fr_es:10 Incorrect Score: 0 • 908ms • 274 tokens • 45µ$

0104_translation_fr_es:11 Correct Score: 100 • 793ms • 270 tokens • 40µ$

0104_translation_fr_es:12 Correct Score: 100 • 756ms • 270 tokens • 38µ$

0104_translation_fr_es:13 Correct Score: 100 • 896ms • 273 tokens • 45µ$

0104_translation_fr_es:14 Correct Score: 100 • 953ms • 276 tokens • 48µ$

0104_translation_fr_es:15 Correct Score: 100 • 948ms • 278 tokens • 47µ$

0104_translation_fr_es:16 Correct Score: 100 • 900ms • 272 tokens • 45µ$

0104_translation_fr_es:17 Correct Score: 100 • 814ms • 272 tokens • 41µ$

0104_translation_fr_es:18 Correct Score: 100 • 905ms • 273 tokens • 45µ$

0104_translation_fr_es:19 Correct Score: 100 • 963ms • 275 tokens • 48µ$

0104_translation_fr_es:20 Correct Score: 100 • 935ms • 274 tokens • 47µ$

0104_translation_fr_es:21 Incorrect Excluded Score: 0 • 906ms • 274 tokens • 45µ$

0104_translation_fr_es:22 Correct Score: 100 • 918ms • 273 tokens • 46µ$

0104_translation_fr_es:23 Correct Score: 100 • 908ms • 274 tokens • 45µ$

0104_translation_fr_es:24 Correct Score: 100 • 763ms • 269 tokens • 38µ$

0104_translation_fr_es:25 Correct Score: 100 • 949ms • 275 tokens • 47µ$

0104_translation_fr_es:26 Correct Score: 100 • 958ms • 277 tokens • 48µ$

0104_translation_fr_es:27 Correct Score: 100 • 773ms • 271 tokens • 39µ$

0104_translation_fr_es:28 Correct Score: 100 • 932ms • 274 tokens • 47µ$

0104_translation_fr_es:29 Correct Score: 100 • 909ms • 272 tokens • 45µ$

0104_translation_fr_es:30 Correct Score: 100 • 962ms • 276 tokens • 48µ$

0104_translation_fr_es:31 Incorrect Score: 0 • 970ms • 273 tokens • 49µ$

0104_translation_fr_es:32 Correct Score: 100 • 952ms • 277 tokens • 48µ$

0104_translation_fr_es:33 Correct Score: 100 • 912ms • 276 tokens • 46µ$

0104_translation_fr_es:34 Correct Score: 100 • 945ms • 276 tokens • 47µ$

0104_translation_fr_es:35 Correct Score: 100 • 901ms • 277 tokens • 45µ$

0104_translation_fr_es:36 Correct Score: 100 • 774ms • 269 tokens • 39µ$

0104_translation_fr_es:37 Correct Score: 100 • 822ms • 272 tokens • 41µ$

0104_translation_fr_es:38 Correct Score: 100 • 805ms • 272 tokens • 40µ$

0104_translation_fr_es:39 Correct Score: 100 • 903ms • 274 tokens • 45µ$