Run Details #432

Model

OLMo 3 7B (LMStudio)

Score

67

Correct (≥100)

27/40

Incorrect (<100)

13

Avg Time

739.1ms

Tokens Used

9918

Cost

$0.0015

Benchmark: 0104_translation_fr_es

Run Date: 2026-02-28 17:41:06

Questions (40)

Question: Translate this word: "mayonnaise"

Expected

mayonesa

Provided

mayonesa

Question: Translate this word: "melon"

Expected

melón

Provided

melón

Question: Translate this word: "cacahuète"

Expected

cacahuete

Provided

cacahuete

Question: Translate this word: "ail"

Expected

ajo

Provided

ajo

Question: Translate this word: "liste"

Expected

lista

Provided

lista

Question: Translate this word: "carte"

Expected

mapa

Provided

carta

Question: Translate this word: "formulaire"

Expected

formulario

Provided

formulario

Question: Translate this word: "page"

Expected

página

Provided

página

Question: Translate this word: "coin"

Expected

esquina

Provided

moneda

Question: Translate this word: "arc"

Expected

arco

Provided

arco

Question: Translate this word: "volée"

Expected

tramo

Provided

portón

Question: Translate this word: "sol"

Expected

suelo

Provided

pasillo

Question: Translate this word: "laine"

Expected

lana

Provided

lana

Question: Translate this word: "huile"

Expected

aceite

Provided

nace

Question: Translate this word: "encre"

Expected

tinta

Provided

tinta

Question: Translate this word: "caoutchouc"

Expected

caucho

Provided

caucho

Question: Translate this word: "rue"

Expected

calle

Provided

calle

Question: Translate this word: "route"

Expected

carretera

Provided

carretera

Question: Translate this word: "autoroute"

Expected

autopista

Provided

autopista

Question: Translate this word: "tunnel"

Expected

túnel

Provided

túnel

Question: Translate this word: "canon"

Expected

cañón

Provided

canon

Question: Translate this word: "fusil"

Expected

pistola

Provided

rifle

Question: Translate this word: "balle"

Expected

bala

Provided

bala

Question: Translate this word: "bâton"

Expected

bastón

Provided

bastón

Question: Translate this word: "avion"

Expected

avión

Provided

avión

Question: Translate this word: "vélo"

Expected

bicicleta

Provided

bicicleta

Question: Translate this word: "tramway"

Expected

tranvía

Provided

tranvía

Question: Translate this word: "taxi"

Expected

taxi

Provided

taxi

Question: Translate this word: "corne"

Expected

cuerno

Provided

cuerno

Question: Translate this word: "lèvre"

Expected

labio

Provided

cara

Question: Translate this word: "pouls"

Expected

pulso

Provided

pulso

Question: Translate this word: "tempe"

Expected

sien

Provided

mano

Question: Translate this word: "écraser"

Expected

aplastar

Provided

destrozár

Question: Translate this word: "démolir"

Expected

demoler

Provided

demolir

Question: Translate this word: "brûler"

Expected

quemar

Provided

destruir

Question: Translate this word: "dissoudre"

Expected

disolver

Provided

disolver

Question: Translate this word: "noir"

Expected

negro

Provided

negro

Question: Translate this word: "orange"

Expected

naranja

Provided

naranja

Question: Translate this word: "brun"

Expected

marrón

Provided

marrón

Question: Translate this word: "violet"

Expected

morado

Provided

violette

Run Details #432

Model

OLMo 3 7B (LMStudio)

Score

67

Correct (≥100)

27/40

Incorrect (<100)

13

Avg Time

739.1ms

Tokens Used

9918

Cost

$0.0015

Questions (40)

0104_translation_fr_es:0 Correct Score: 100 • 913ms • 253 tokens • 46µ$

0104_translation_fr_es:1 Correct Score: 100 • 883ms • 255 tokens • 44µ$

0104_translation_fr_es:2 Correct Score: 100 • 658ms • 250 tokens • 33µ$

0104_translation_fr_es:3 Correct Score: 100 • 564ms • 245 tokens • 28µ$

0104_translation_fr_es:4 Correct Score: 100 • 678ms • 241 tokens • 34µ$

0104_translation_fr_es:5 Incorrect Score: 0 • 751ms • 245 tokens • 38µ$

0104_translation_fr_es:6 Correct Score: 100 • 712ms • 244 tokens • 36µ$

0104_translation_fr_es:7 Correct Score: 100 • 756ms • 243 tokens • 38µ$

0104_translation_fr_es:8 Incorrect Score: 0 • 607ms • 247 tokens • 30µ$

0104_translation_fr_es:9 Correct Score: 100 • 751ms • 247 tokens • 38µ$

0104_translation_fr_es:10 Incorrect Score: 0 • 712ms • 249 tokens • 36µ$

0104_translation_fr_es:11 Incorrect Score: 0 • 561ms • 241 tokens • 28µ$

0104_translation_fr_es:12 Correct Score: 100 • 696ms • 245 tokens • 35µ$

0104_translation_fr_es:13 Incorrect Score: 0 • 628ms • 246 tokens • 31µ$

0104_translation_fr_es:14 Correct Score: 100 • 770ms • 251 tokens • 39µ$

0104_translation_fr_es:15 Correct Score: 100 • 803ms • 251 tokens • 40µ$

0104_translation_fr_es:16 Correct Score: 100 • 613ms • 245 tokens • 31µ$

0104_translation_fr_es:17 Correct Score: 100 • 804ms • 248 tokens • 40µ$

0104_translation_fr_es:18 Correct Score: 100 • 613ms • 246 tokens • 31µ$

0104_translation_fr_es:19 Correct Score: 100 • 802ms • 251 tokens • 40µ$

0104_translation_fr_es:20 Incorrect Score: 0 • 749ms • 249 tokens • 37µ$

0104_translation_fr_es:21 Incorrect Score: 0 • 753ms • 250 tokens • 38µ$

0104_translation_fr_es:22 Correct Score: 100 • 609ms • 246 tokens • 30µ$

0104_translation_fr_es:23 Correct Score: 100 • 609ms • 247 tokens • 30µ$

0104_translation_fr_es:24 Correct Score: 100 • 764ms • 244 tokens • 38µ$

0104_translation_fr_es:25 Correct Score: 100 • 791ms • 250 tokens • 40µ$

0104_translation_fr_es:26 Correct Score: 100 • 803ms • 252 tokens • 40µ$

0104_translation_fr_es:27 Correct Score: 100 • 755ms • 246 tokens • 38µ$

0104_translation_fr_es:28 Correct Score: 100 • 634ms • 247 tokens • 32µ$

0104_translation_fr_es:29 Incorrect Score: 0 • 831ms • 248 tokens • 42µ$

0104_translation_fr_es:30 Correct Score: 100 • 823ms • 251 tokens • 41µ$

0104_translation_fr_es:31 Incorrect Score: 0 • 788ms • 248 tokens • 39µ$

0104_translation_fr_es:32 Incorrect Score: 0 • 972ms • 256 tokens • 49µ$

0104_translation_fr_es:33 Incorrect Score: 0 • 761ms • 252 tokens • 38µ$

0104_translation_fr_es:34 Incorrect Score: 0 • 784ms • 251 tokens • 39µ$

0104_translation_fr_es:35 Correct Score: 100 • 858ms • 252 tokens • 43µ$

0104_translation_fr_es:36 Correct Score: 100 • 736ms • 244 tokens • 37µ$

0104_translation_fr_es:37 Correct Score: 100 • 765ms • 247 tokens • 38µ$

0104_translation_fr_es:38 Correct Score: 100 • 670ms • 245 tokens • 34µ$

0104_translation_fr_es:39 Incorrect Score: 0 • 836ms • 250 tokens • 42µ$