Run Details #360

Model

Llama 3.1 8B (LMStudio)

Score

82

Stored run score 80 recalculated to 82 after question exclusions.

Correct (≥100)

32/39

Incorrect (<100)

7

Median Time

814.0ms

Tokens Used

10546

Cost

$0.0016

1 question is excluded from aggregate scoring for this run. Aggregate cards above are recalculated using the 39 active questions only.

Suspicious cost data. Stored run cost differs noticeably from the current pricing estimate. Stored total: $0.0016 · Current estimate: 0µ$ (verified)

Benchmark: 0104_translation_fr_es

Run Date: 2026-02-28 17:06:23

Questions (40)

Question: Translate this word: "mayonnaise"

Expected

mayonesa

Provided

mayonesa

Question: Translate this word: "melon"

Expected

melón

Provided

melón

Question: Translate this word: "cacahuète"

Expected

cacahuete

Provided

cacahuete

Question: Translate this word: "ail"

Expected

ajo

Provided

ajo

Question: Translate this word: "liste"

Expected

lista

Provided

lista

Question: Translate this word: "carte"

Expected

mapa

Provided

billete

Question: Translate this word: "formulaire"

Expected

formulario

Provided

informe

Question: Translate this word: "page"

Expected

página

Provided

página

Question: Translate this word: "coin"

Expected

esquina

Provided

moneda

Question: Translate this word: "arc"

Expected

arco

Provided

arco

Question: Translate this word: "volée"

Expected

tramo

Provided

portón

Question: Translate this word: "sol"

Expected

suelo

Provided

suelo

Question: Translate this word: "laine"

Expected

lana

Provided

lana

Question: Translate this word: "huile"

Expected

aceite

Provided

aceite

Question: Translate this word: "encre"

Expected

tinta

Provided

tinta

Question: Translate this word: "caoutchouc"

Expected

caucho

Provided

caucho

Question: Translate this word: "rue"

Expected

calle

Provided

riel

Question: Translate this word: "route"

Expected

carretera

Provided

carretera

Question: Translate this word: "autoroute"

Expected

autopista

Provided

autopista

Question: Translate this word: "tunnel"

Expected

túnel

Provided

túnel

Question: Translate this word: "canon"

Expected

cañón

Provided

cañón

Excluded from aggregate scoring. Pistol or rifle?

Question: Translate this word: "fusil"

Expected

pistola

Provided

rifle

Question: Translate this word: "balle"

Expected

bala

Provided

bala

Question: Translate this word: "bâton"

Expected

bastón

Provided

bastón

Question: Translate this word: "avion"

Expected

avión

Provided

avión

Question: Translate this word: "vélo"

Expected

bicicleta

Provided

bici

Question: Translate this word: "tramway"

Expected

tranvía

Provided

tranvía

Question: Translate this word: "taxi"

Expected

taxi

Provided

taxis

Question: Translate this word: "corne"

Expected

cuerno

Provided

cuerno

Question: Translate this word: "lèvre"

Expected

labio

Provided

labio

Question: Translate this word: "pouls"

Expected

pulso

Provided

pulso

Question: Translate this word: "tempe"

Expected

sien

Provided

sien

Question: Translate this word: "écraser"

Expected

aplastar

Provided

aplastar

Question: Translate this word: "démolir"

Expected

demoler

Provided

demoler

Question: Translate this word: "brûler"

Expected

quemar

Provided

quemar

Question: Translate this word: "dissoudre"

Expected

disolver

Provided

disolver

Question: Translate this word: "noir"

Expected

negro

Provided

negro

Question: Translate this word: "orange"

Expected

naranja

Provided

naranja

Question: Translate this word: "brun"

Expected

marrón

Provided

marrón

Question: Translate this word: "violet"

Expected

morado

Provided

morado

Run Details #360

Model

Llama 3.1 8B (LMStudio)

Score

82

Correct (≥100)

32/39

Incorrect (<100)

7

Median Time

814.0ms

Tokens Used

10546

Cost

$0.0016

Questions (40)

0104_translation_fr_es:0 Correct Score: 100 • 878ms • 274 tokens • 44µ$

0104_translation_fr_es:1 Correct Score: 100 • 951ms • 277 tokens • 48µ$

0104_translation_fr_es:2 Correct Score: 100 • 699ms • 271 tokens • 35µ$

0104_translation_fr_es:3 Correct Score: 100 • 773ms • 270 tokens • 39µ$

0104_translation_fr_es:4 Correct Score: 100 • 711ms • 263 tokens • 36µ$

0104_translation_fr_es:5 Incorrect Score: 0 • 810ms • 267 tokens • 41µ$

0104_translation_fr_es:6 Incorrect Score: 0 • 817ms • 267 tokens • 41µ$

0104_translation_fr_es:7 Correct Score: 100 • 769ms • 264 tokens • 38µ$

0104_translation_fr_es:8 Incorrect Score: 0 • 814ms • 272 tokens • 41µ$

0104_translation_fr_es:9 Correct Score: 100 • 817ms • 269 tokens • 41µ$

0104_translation_fr_es:10 Incorrect Score: 0 • 827ms • 272 tokens • 41µ$

0104_translation_fr_es:11 Correct Score: 100 • 914ms • 269 tokens • 46µ$

0104_translation_fr_es:12 Correct Score: 100 • 811ms • 268 tokens • 41µ$

0104_translation_fr_es:13 Correct Score: 100 • 829ms • 271 tokens • 41µ$

0104_translation_fr_es:14 Correct Score: 100 • 807ms • 273 tokens • 40µ$

0104_translation_fr_es:15 Correct Score: 100 • 860ms • 273 tokens • 43µ$

0104_translation_fr_es:16 Incorrect Score: 0 • 713ms • 268 tokens • 36µ$

0104_translation_fr_es:17 Correct Score: 100 • 813ms • 269 tokens • 41µ$

0104_translation_fr_es:18 Correct Score: 100 • 766ms • 270 tokens • 38µ$

0104_translation_fr_es:19 Correct Score: 100 • 813ms • 272 tokens • 41µ$

0104_translation_fr_es:20 Correct Score: 100 • 878ms • 272 tokens • 44µ$

0104_translation_fr_es:21 Incorrect Excluded Score: 0 • 819ms • 272 tokens • 41µ$

0104_translation_fr_es:22 Correct Score: 100 • 827ms • 271 tokens • 41µ$

0104_translation_fr_es:23 Correct Score: 100 • 828ms • 272 tokens • 41µ$

0104_translation_fr_es:24 Correct Score: 100 • 814ms • 267 tokens • 41µ$

0104_translation_fr_es:25 Incorrect Score: 0 • 819ms • 272 tokens • 41µ$

0104_translation_fr_es:26 Correct Score: 100 • 867ms • 275 tokens • 43µ$

0104_translation_fr_es:27 Incorrect Score: 0 • 814ms • 269 tokens • 41µ$

0104_translation_fr_es:28 Correct Score: 100 • 822ms • 272 tokens • 41µ$

0104_translation_fr_es:29 Correct Score: 100 • 817ms • 270 tokens • 41µ$

0104_translation_fr_es:30 Correct Score: 100 • 817ms • 273 tokens • 41µ$

0104_translation_fr_es:31 Correct Score: 100 • 652ms • 267 tokens • 33µ$

0104_translation_fr_es:32 Correct Score: 100 • 802ms • 274 tokens • 40µ$

0104_translation_fr_es:33 Correct Score: 100 • 825ms • 274 tokens • 41µ$

0104_translation_fr_es:34 Correct Score: 100 • 711ms • 271 tokens • 36µ$

0104_translation_fr_es:35 Correct Score: 100 • 971ms • 275 tokens • 49µ$

0104_translation_fr_es:36 Correct Score: 100 • 661ms • 264 tokens • 33µ$

0104_translation_fr_es:37 Correct Score: 100 • 698ms • 267 tokens • 35µ$

0104_translation_fr_es:38 Correct Score: 100 • 864ms • 270 tokens • 43µ$

0104_translation_fr_es:39 Correct Score: 100 • 813ms • 272 tokens • 41µ$