Run Details #384

Model

Llama 3.2 1B (LMStudio)

Score

31

Stored run score 30 recalculated to 31 after question exclusions.

Correct (≥100)

12/39

Incorrect (<100)

27

Median Time

247.0ms

Tokens Used

10615

Cost

497µ$

1 question is excluded from aggregate scoring for this run. Aggregate cards above are recalculated using the 39 active questions only.

Suspicious cost data. Stored run cost differs noticeably from the current pricing estimate. Stored total: 497µ$ · Current estimate: 0µ$ (verified)

Benchmark: 0104_translation_fr_es

Run Date: 2026-02-28 17:14:57

Questions (40)

Question: Translate this word: "mayonnaise"

Expected

mayonesa

Provided

mayonesa

Question: Translate this word: "melon"

Expected

melón

Provided

manzana

Question: Translate this word: "cacahuète"

Expected

cacahuete

Provided

cacahuète

Question: Translate this word: "ail"

Expected

ajo

Provided

plátano

Question: Translate this word: "liste"

Expected

lista

Provided

Lista

Question: Translate this word: "carte"

Expected

mapa

Provided

carte

Question: Translate this word: "formulaire"

Expected

formulario

Provided

formular

Question: Translate this word: "page"

Expected

página

Provided

página

Question: Translate this word: "coin"

Expected

esquina

Provided

balcón

Question: Translate this word: "arc"

Expected

arco

Provided

escalera

Question: Translate this word: "volée"

Expected

tramo

Provided

passage

Question: Translate this word: "sol"

Expected

suelo

Provided

ventana

Question: Translate this word: "laine"

Expected

lana

Provided

piedra

Question: Translate this word: "huile"

Expected

aceite

Provided

aceite

Question: Translate this word: "encre"

Expected

tinta

Provided

alambre

Question: Translate this word: "caoutchouc"

Expected

caucho

Provided

cera

Question: Translate this word: "rue"

Expected

calle

Provided

puente

Question: Translate this word: "route"

Expected

carretera

Provided

carretera

Question: Translate this word: "autoroute"

Expected

autopista

Provided

autopista

Question: Translate this word: "tunnel"

Expected

túnel

Provided

escenario

Question: Translate this word: "canon"

Expected

cañón

Provided

casa

Excluded from aggregate scoring. Pistol or rifle?

Question: Translate this word: "fusil"

Expected

pistola

Provided

rifle

Question: Translate this word: "balle"

Expected

bala

Provided

bola

Question: Translate this word: "bâton"

Expected

bastón

Provided

bastón

Question: Translate this word: "avion"

Expected

avión

Provided

carreta

Question: Translate this word: "vélo"

Expected

bicicleta

Provided

bicicleta

Question: Translate this word: "tramway"

Expected

tranvía

Provided

tramway

Question: Translate this word: "taxi"

Expected

taxi

Provided

autobús

Question: Translate this word: "corne"

Expected

cuerno

Provided

ceja

Question: Translate this word: "lèvre"

Expected

labio

Provided

cara

Question: Translate this word: "pouls"

Expected

pulso

Provided

pulso

Question: Translate this word: "tempe"

Expected

sien

Provided

espalda

Question: Translate this word: "écraser"

Expected

aplastar

Provided

destrozar

Question: Translate this word: "démolir"

Expected

demoler

Provided

demolir

Question: Translate this word: "brûler"

Expected

quemar

Provided

quemar

Question: Translate this word: "dissoudre"

Expected

disolver

Provided

dissoudre

Question: Translate this word: "noir"

Expected

negro

Provided

negro

Question: Translate this word: "orange"

Expected

naranja

Provided

naranja

Question: Translate this word: "brun"

Expected

marrón

Provided

gris

Question: Translate this word: "violet"

Expected

morado

Provided

amarillo

Run Details #384

Model

Llama 3.2 1B (LMStudio)

Score

31

Correct (≥100)

12/39

Incorrect (<100)

27

Median Time

247.0ms

Tokens Used

10615

Cost

497µ$

Questions (40)

0104_translation_fr_es:0 Correct Score: 100 • 303ms • 275 tokens • 15µ$

0104_translation_fr_es:1 Incorrect Score: 0 • 282ms • 279 tokens • 14µ$

0104_translation_fr_es:2 Incorrect Score: 0 • 233ms • 275 tokens • 12µ$

0104_translation_fr_es:3 Incorrect Score: 0 • 261ms • 273 tokens • 13µ$

0104_translation_fr_es:4 Correct Score: 100 • 214ms • 264 tokens • 11µ$

0104_translation_fr_es:5 Incorrect Score: 0 • 233ms • 267 tokens • 12µ$

0104_translation_fr_es:6 Incorrect Score: 0 • 202ms • 267 tokens • 10µ$

0104_translation_fr_es:7 Correct Score: 100 • 248ms • 266 tokens • 12µ$

0104_translation_fr_es:8 Incorrect Score: 0 • 320ms • 276 tokens • 16µ$

0104_translation_fr_es:9 Incorrect Score: 0 • 228ms • 269 tokens • 11µ$

0104_translation_fr_es:10 Incorrect Score: 0 • 218ms • 272 tokens • 11µ$

0104_translation_fr_es:11 Incorrect Score: 0 • 258ms • 269 tokens • 13µ$

0104_translation_fr_es:12 Incorrect Score: 0 • 258ms • 270 tokens • 13µ$

0104_translation_fr_es:13 Correct Score: 100 • 244ms • 272 tokens • 12µ$

0104_translation_fr_es:14 Incorrect Score: 0 • 232ms • 273 tokens • 12µ$

0104_translation_fr_es:15 Incorrect Score: 0 • 278ms • 277 tokens • 14µ$

0104_translation_fr_es:16 Incorrect Score: 0 • 218ms • 270 tokens • 11µ$

0104_translation_fr_es:17 Correct Score: 100 • 229ms • 269 tokens • 11µ$

0104_translation_fr_es:18 Correct Score: 100 • 199ms • 269 tokens • 10µ$

0104_translation_fr_es:19 Incorrect Score: 0 • 264ms • 275 tokens • 13µ$

0104_translation_fr_es:20 Incorrect Score: 0 • 248ms • 272 tokens • 12µ$

0104_translation_fr_es:21 Incorrect Excluded Score: 0 • 218ms • 272 tokens • 11µ$

0104_translation_fr_es:22 Incorrect Score: 0 • 233ms • 272 tokens • 12µ$

0104_translation_fr_es:23 Correct Score: 100 • 217ms • 273 tokens • 11µ$

0104_translation_fr_es:24 Incorrect Score: 0 • 274ms • 269 tokens • 14µ$

0104_translation_fr_es:25 Correct Score: 100 • 270ms • 274 tokens • 14µ$

0104_translation_fr_es:26 Incorrect Score: 0 • 199ms • 273 tokens • 10µ$

0104_translation_fr_es:27 Incorrect Score: 0 • 233ms • 270 tokens • 12µ$

0104_translation_fr_es:28 Incorrect Score: 0 • 261ms • 273 tokens • 13µ$

0104_translation_fr_es:29 Incorrect Score: 0 • 331ms • 273 tokens • 17µ$

0104_translation_fr_es:30 Correct Score: 100 • 278ms • 275 tokens • 14µ$

0104_translation_fr_es:31 Incorrect Score: 0 • 242ms • 271 tokens • 12µ$

0104_translation_fr_es:32 Incorrect Score: 0 • 229ms • 275 tokens • 11µ$

0104_translation_fr_es:33 Incorrect Score: 0 • 216ms • 274 tokens • 11µ$

0104_translation_fr_es:34 Correct Score: 100 • 269ms • 275 tokens • 13µ$

0104_translation_fr_es:35 Incorrect Score: 0 • 263ms • 277 tokens • 13µ$

0104_translation_fr_es:36 Correct Score: 100 • 499ms • 281 tokens • 25µ$

0104_translation_fr_es:37 Correct Score: 100 • 248ms • 270 tokens • 12µ$

0104_translation_fr_es:38 Incorrect Score: 0 • 247ms • 269 tokens • 12µ$

0104_translation_fr_es:39 Incorrect Score: 0 • 236ms • 272 tokens • 12µ$