Run Details #312

Model

Llama 2 7B (LMStudio)

Score

13

Stored run score 12 recalculated to 13 after question exclusions.

Correct (≥100)

5/39

Incorrect (<100)

34

Median Time

999.0ms

Tokens Used

11618

Cost

$0.0019

1 question is excluded from aggregate scoring for this run. Aggregate cards above are recalculated using the 39 active questions only.

Suspicious cost data. Stored run cost differs noticeably from the current pricing estimate. Stored total: $0.0019 · Current estimate: 0µ$ (verified)

Benchmark: 0104_translation_fr_es

Run Date: 2026-02-28 16:32:30

Questions (40)

Question: Translate this word: "mayonnaise"

Expected

mayonesa

Provided

cacahuete

Question: Translate this word: "melon"

Expected

melón

Provided

melon

Question: Translate this word: "cacahuète"

Expected

cacahuete

Provided

cacahuete

Question: Translate this word: "ail"

Expected

ajo

Provided

plato

Question: Translate this word: "liste"

Expected

lista

Provided

carta

Question: Translate this word: "carte"

Expected

mapa

Provided

cuento

Question: Translate this word: "formulaire"

Expected

formulario

Provided

informe

Question: Translate this word: "page"

Expected

página

Provided

carta

Question: Translate this word: "coin"

Expected

esquina

Provided

chimenea

Question: Translate this word: "arc"

Expected

arco

Provided

escaleras

Question: Translate this word: "volée"

Expected

tramo

Provided

portón

Question: Translate this word: "sol"

Expected

suelo

Provided

sol

Question: Translate this word: "laine"

Expected

lana

Provided

aire

Question: Translate this word: "huile"

Expected

aceite

Provided

bronce

Question: Translate this word: "encre"

Expected

tinta

Provided

tinta

Question: Translate this word: "caoutchouc"

Expected

caucho

Provided

} {

Question: Translate this word: "rue"

Expected

calle

Provided

escenario

Question: Translate this word: "route"

Expected

carretera

Provided

escenario

Question: Translate this word: "autoroute"

Expected

autopista

Provided

especificación

Question: Translate this word: "tunnel"

Expected

túnel

Provided

esquina

Question: Translate this word: "canon"

Expected

cañón

Provided

canon

Excluded from aggregate scoring. Pistol or rifle?

Question: Translate this word: "fusil"

Expected

pistola

Provided

casco

Question: Translate this word: "balle"

Expected

bala

Provided

balle

Question: Translate this word: "bâton"

Expected

bastón

Provided

bastón

Question: Translate this word: "avion"

Expected

avión

Provided

avión

Question: Translate this word: "vélo"

Expected

bicicleta

Provided

escúter

Question: Translate this word: "tramway"

Expected

tranvía

Provided

tramway

Question: Translate this word: "taxi"

Expected

taxi

Provided

taxi

Question: Translate this word: "corne"

Expected

cuerno

Provided

regazo

Question: Translate this word: "lèvre"

Expected

labio

Provided

cara

Question: Translate this word: "pouls"

Expected

pulso

Provided

hombro

Question: Translate this word: "tempe"

Expected

sien

Provided

espalda

Question: Translate this word: "écraser"

Expected

aplastar

Provided

ecraser

Question: Translate this word: "démolir"

Expected

demoler

Provided

disolver

Question: Translate this word: "brûler"

Expected

quemar

Provided

destruir

Question: Translate this word: "dissoudre"

Expected

disolver

Provided

dissoudre

Question: Translate this word: "noir"

Expected

negro

Provided

noir

Question: Translate this word: "orange"

Expected

naranja

Provided

rojo

Question: Translate this word: "brun"

Expected

marrón

Provided

blanco

Question: Translate this word: "violet"

Expected

morado

Provided

Run Details #312

Model

Llama 2 7B (LMStudio)

Score

13

Correct (≥100)

5/39

Incorrect (<100)

34

Median Time

999.0ms

Tokens Used

11618

Cost

$0.0019

Questions (40)

0104_translation_fr_es:0 Incorrect Score: 0 • 1044ms • 307 tokens • 52µ$

0104_translation_fr_es:1 Incorrect Score: 0 • 1038ms • 313 tokens • 52µ$

0104_translation_fr_es:2 Correct Score: 100 • 1039ms • 312 tokens • 52µ$

0104_translation_fr_es:3 Incorrect Score: 0 • 995ms • 306 tokens • 50µ$

0104_translation_fr_es:4 Incorrect Score: 0 • 878ms • 300 tokens • 44µ$

0104_translation_fr_es:5 Incorrect Score: 0 • 955ms • 302 tokens • 48µ$

0104_translation_fr_es:6 Incorrect Score: 0 • 1118ms • 311 tokens • 56µ$

0104_translation_fr_es:7 Incorrect Score: 0 • 916ms • 301 tokens • 46µ$

0104_translation_fr_es:8 Incorrect Score: 0 • 1039ms • 309 tokens • 52µ$

0104_translation_fr_es:9 Incorrect Score: 0 • 959ms • 304 tokens • 48µ$

0104_translation_fr_es:10 Incorrect Score: 0 • 999ms • 307 tokens • 50µ$

0104_translation_fr_es:11 Incorrect Score: 0 • 1040ms • 303 tokens • 52µ$

0104_translation_fr_es:12 Incorrect Score: 0 • 996ms • 304 tokens • 50µ$

0104_translation_fr_es:13 Incorrect Score: 0 • 876ms • 303 tokens • 44µ$

0104_translation_fr_es:14 Correct Score: 100 • 785ms • 303 tokens • 39µ$

0104_translation_fr_es:15 Incorrect Score: 0 • 886ms • 306 tokens • 44µ$

0104_translation_fr_es:16 Incorrect Score: 0 • 1037ms • 307 tokens • 52µ$

0104_translation_fr_es:17 Incorrect Score: 0 • 786ms • 299 tokens • 39µ$

0104_translation_fr_es:18 Incorrect Score: 0 • 1095ms • 308 tokens • 55µ$

0104_translation_fr_es:19 Incorrect Score: 0 • 1087ms • 308 tokens • 54µ$

0104_translation_fr_es:20 Incorrect Score: 0 • 1010ms • 306 tokens • 51µ$

0104_translation_fr_es:21 Incorrect Excluded Score: 0 • 961ms • 307 tokens • 48µ$

0104_translation_fr_es:22 Incorrect Score: 0 • 1088ms • 308 tokens • 54µ$

0104_translation_fr_es:23 Correct Score: 100 • 925ms • 304 tokens • 46µ$

0104_translation_fr_es:24 Correct Score: 100 • 963ms • 302 tokens • 48µ$

0104_translation_fr_es:25 Incorrect Score: 0 • 875ms • 306 tokens • 44µ$

0104_translation_fr_es:26 Incorrect Score: 0 • 1135ms • 312 tokens • 57µ$

0104_translation_fr_es:27 Correct Score: 100 • 758ms • 299 tokens • 38µ$

0104_translation_fr_es:28 Incorrect Score: 0 • 1013ms • 307 tokens • 51µ$

0104_translation_fr_es:29 Incorrect Score: 0 • 1054ms • 306 tokens • 53µ$

0104_translation_fr_es:30 Incorrect Score: 0 • 843ms • 303 tokens • 42µ$

0104_translation_fr_es:31 Incorrect Score: 0 • 1052ms • 306 tokens • 53µ$

0104_translation_fr_es:32 Incorrect Score: 0 • 1009ms • 310 tokens • 50µ$

0104_translation_fr_es:33 Incorrect Score: 0 • 1132ms • 314 tokens • 57µ$

0104_translation_fr_es:34 Incorrect Score: 0 • 1098ms • 309 tokens • 55µ$

0104_translation_fr_es:35 Incorrect Score: 0 • 1052ms • 311 tokens • 53µ$

0104_translation_fr_es:36 Incorrect Score: 0 • 972ms • 303 tokens • 49µ$

0104_translation_fr_es:37 Incorrect Score: 0 • 847ms • 300 tokens • 42µ$

0104_translation_fr_es:38 Incorrect Score: 0 • 795ms • 299 tokens • 40µ$

0104_translation_fr_es:39 Incorrect Score: 0 • 0ms