Run Details #312

Model

Llama 2 7B (LMStudio)

Score

12

Correct (≥100)

5/40

Incorrect (<100)

35

Avg Time

953.8ms

Tokens Used

11925

Cost

$0.0019

Benchmark: 0104_translation_fr_es

Run Date: 2026-02-28 16:32:30

Questions (40)

Question: Translate this word: "mayonnaise"

Expected

mayonesa

Provided

cacahuete

Question: Translate this word: "melon"

Expected

melón

Provided

melon

Question: Translate this word: "cacahuète"

Expected

cacahuete

Provided

cacahuete

Question: Translate this word: "ail"

Expected

ajo

Provided

plato

Question: Translate this word: "liste"

Expected

lista

Provided

carta

Question: Translate this word: "carte"

Expected

mapa

Provided

cuento

Question: Translate this word: "formulaire"

Expected

formulario

Provided

informe

Question: Translate this word: "page"

Expected

página

Provided

carta

Question: Translate this word: "coin"

Expected

esquina

Provided

chimenea

Question: Translate this word: "arc"

Expected

arco

Provided

escaleras

Question: Translate this word: "volée"

Expected

tramo

Provided

portón

Question: Translate this word: "sol"

Expected

suelo

Provided

sol

Question: Translate this word: "laine"

Expected

lana

Provided

aire

Question: Translate this word: "huile"

Expected

aceite

Provided

bronce

Question: Translate this word: "encre"

Expected

tinta

Provided

tinta

Question: Translate this word: "caoutchouc"

Expected

caucho

Provided

} {

Question: Translate this word: "rue"

Expected

calle

Provided

escenario

Question: Translate this word: "route"

Expected

carretera

Provided

escenario

Question: Translate this word: "autoroute"

Expected

autopista

Provided

especificación

Question: Translate this word: "tunnel"

Expected

túnel

Provided

esquina

Question: Translate this word: "canon"

Expected

cañón

Provided

canon

Question: Translate this word: "fusil"

Expected

pistola

Provided

casco

Question: Translate this word: "balle"

Expected

bala

Provided

balle

Question: Translate this word: "bâton"

Expected

bastón

Provided

bastón

Question: Translate this word: "avion"

Expected

avión

Provided

avión

Question: Translate this word: "vélo"

Expected

bicicleta

Provided

escúter

Question: Translate this word: "tramway"

Expected

tranvía

Provided

tramway

Question: Translate this word: "taxi"

Expected

taxi

Provided

taxi

Question: Translate this word: "corne"

Expected

cuerno

Provided

regazo

Question: Translate this word: "lèvre"

Expected

labio

Provided

cara

Question: Translate this word: "pouls"

Expected

pulso

Provided

hombro

Question: Translate this word: "tempe"

Expected

sien

Provided

espalda

Question: Translate this word: "écraser"

Expected

aplastar

Provided

ecraser

Question: Translate this word: "démolir"

Expected

demoler

Provided

disolver

Question: Translate this word: "brûler"

Expected

quemar

Provided

destruir

Question: Translate this word: "dissoudre"

Expected

disolver

Provided

dissoudre

Question: Translate this word: "noir"

Expected

negro

Provided

noir

Question: Translate this word: "orange"

Expected

naranja

Provided

rojo

Question: Translate this word: "brun"

Expected

marrón

Provided

blanco

Question: Translate this word: "violet"

Expected

morado

Provided

Run Details #312

Model

Llama 2 7B (LMStudio)

Score

12

Correct (≥100)

5/40

Incorrect (<100)

35

Avg Time

953.8ms

Tokens Used

11925

Cost

$0.0019

Questions (40)

0104_translation_fr_es:0 Incorrect Score: 0 • 1044ms • 307 tokens • 52µ$

0104_translation_fr_es:1 Incorrect Score: 0 • 1038ms • 313 tokens • 52µ$

0104_translation_fr_es:2 Correct Score: 100 • 1039ms • 312 tokens • 52µ$

0104_translation_fr_es:3 Incorrect Score: 0 • 995ms • 306 tokens • 50µ$

0104_translation_fr_es:4 Incorrect Score: 0 • 878ms • 300 tokens • 44µ$

0104_translation_fr_es:5 Incorrect Score: 0 • 955ms • 302 tokens • 48µ$

0104_translation_fr_es:6 Incorrect Score: 0 • 1118ms • 311 tokens • 56µ$

0104_translation_fr_es:7 Incorrect Score: 0 • 916ms • 301 tokens • 46µ$

0104_translation_fr_es:8 Incorrect Score: 0 • 1039ms • 309 tokens • 52µ$

0104_translation_fr_es:9 Incorrect Score: 0 • 959ms • 304 tokens • 48µ$

0104_translation_fr_es:10 Incorrect Score: 0 • 999ms • 307 tokens • 50µ$

0104_translation_fr_es:11 Incorrect Score: 0 • 1040ms • 303 tokens • 52µ$

0104_translation_fr_es:12 Incorrect Score: 0 • 996ms • 304 tokens • 50µ$

0104_translation_fr_es:13 Incorrect Score: 0 • 876ms • 303 tokens • 44µ$

0104_translation_fr_es:14 Correct Score: 100 • 785ms • 303 tokens • 39µ$

0104_translation_fr_es:15 Incorrect Score: 0 • 886ms • 306 tokens • 44µ$

0104_translation_fr_es:16 Incorrect Score: 0 • 1037ms • 307 tokens • 52µ$

0104_translation_fr_es:17 Incorrect Score: 0 • 786ms • 299 tokens • 39µ$

0104_translation_fr_es:18 Incorrect Score: 0 • 1095ms • 308 tokens • 55µ$

0104_translation_fr_es:19 Incorrect Score: 0 • 1087ms • 308 tokens • 54µ$

0104_translation_fr_es:20 Incorrect Score: 0 • 1010ms • 306 tokens • 51µ$

0104_translation_fr_es:21 Incorrect Score: 0 • 961ms • 307 tokens • 48µ$

0104_translation_fr_es:22 Incorrect Score: 0 • 1088ms • 308 tokens • 54µ$

0104_translation_fr_es:23 Correct Score: 100 • 925ms • 304 tokens • 46µ$

0104_translation_fr_es:24 Correct Score: 100 • 963ms • 302 tokens • 48µ$

0104_translation_fr_es:25 Incorrect Score: 0 • 875ms • 306 tokens • 44µ$

0104_translation_fr_es:26 Incorrect Score: 0 • 1135ms • 312 tokens • 57µ$

0104_translation_fr_es:27 Correct Score: 100 • 758ms • 299 tokens • 38µ$

0104_translation_fr_es:28 Incorrect Score: 0 • 1013ms • 307 tokens • 51µ$

0104_translation_fr_es:29 Incorrect Score: 0 • 1054ms • 306 tokens • 53µ$

0104_translation_fr_es:30 Incorrect Score: 0 • 843ms • 303 tokens • 42µ$

0104_translation_fr_es:31 Incorrect Score: 0 • 1052ms • 306 tokens • 53µ$

0104_translation_fr_es:32 Incorrect Score: 0 • 1009ms • 310 tokens • 50µ$

0104_translation_fr_es:33 Incorrect Score: 0 • 1132ms • 314 tokens • 57µ$

0104_translation_fr_es:34 Incorrect Score: 0 • 1098ms • 309 tokens • 55µ$

0104_translation_fr_es:35 Incorrect Score: 0 • 1052ms • 311 tokens • 53µ$

0104_translation_fr_es:36 Incorrect Score: 0 • 972ms • 303 tokens • 49µ$

0104_translation_fr_es:37 Incorrect Score: 0 • 847ms • 300 tokens • 42µ$

0104_translation_fr_es:38 Incorrect Score: 0 • 795ms • 299 tokens • 40µ$

0104_translation_fr_es:39 Incorrect Score: 0 • 0ms