Run Details #456
Model
Phi-3.5 Mini (LMStudio)
Score
0
Correct (≥100)
0/40
Incorrect (<100)
40
Avg Time
841.7ms
Tokens Used
12007
Cost
$0.0017
Benchmark:
0104_translation_fr_es
Run Date: 2026-02-28 17:53:22
Questions (40)
Question: Translate this word: "mayonnaise"
Expected
mayonesa
Provided
Question: Translate this word: "melon"
Expected
melón
Provided
melon
Question: Translate this word: "cacahuète"
Expected
cacahuete
Provided
Question: Translate this word: "ail"
Expected
ajo
Provided
(spaniish) lemma, (spanish_definition), and (part-of-speech)
Question: Translate this word: "liste"
Expected
lista
Provided
<lemma_in_target_language>
Question: Translate this word: "carte"
Expected
mapa
Provided
<lemma_inferred from English and Lithuanian definitions with correct part of speech for a card
Question: Translate this word: "formulaire"
Expected
formulario
Provided
<lemma_in_target_language>
Question: Translate this word: "page"
Expected
página
Provided
<lemma_baseform1>: <language2>
Question: Translate this word: "coin"
Expected
esquina
Provided
moneda (nominative singular) - coin; peseta (not lemma, lower form of the noun used in context)-money-nominative singular; moneda (infinitive) - to coin, mint coins
Question: Translate this word: "arc"
Expected
arco
Provided
escaleras
Question: Translate this word: "volée"
Expected
tramo
Provided
Question: Translate this word: "sol"
Expected
suelo
Provided
ventana
Question: Translate this word: "laine"
Expected
lana
Provided
<lemma_baseform>
Question: Translate this word: "huile"
Expected
aceite
Provided
<lemma_baseform>ån<pos><part-of-speech></pos><definition>
Question: Translate this word: "encre"
Expected
tinta
Provided
Question: Translate this word: "caoutchouc"
Expected
caucho
Provided
Question: Translate this word: "rue"
Expected
calle
Provided
rue de Paris
Question: Translate this word: "route"
Expected
carretera
Provided
autovia
Question: Translate this word: "autoroute"
Expected
autopista
Provided
<lemma_or_base>,<language>:
Question: Translate this word: "tunnel"
Expected
túnel
Provided
Question: Translate this word: "canon"
Expected
cañón
Provided
<lemma_spanish>
Question: Translate this word: "fusil"
Expected
pistola
Provided
[your translated lemma here]
Question: Translate this word: "balle"
Expected
bala
Provided
Question: Translate this word: "bâton"
Expected
bastón
Provided
bâton
Question: Translate this word: "avion"
Expected
avión
Provided
<lemma_baseform>,
Question: Translate this word: "vélo"
Expected
bicicleta
Provided
<lemma_in>s
Question: Translate this word: "tramway"
Expected
tranvía
Provided
Question: Translate this word: "taxi"
Expected
taxi
Provided
taxi_spanish
Question: Translate this word: "corne"
Expected
cuerno
Provided
ceña
Question: Translate this word: "lèvre"
Expected
labio
Provided
(Your translation here). Here, the lemma form is required for nouns to match singular nominative in Spanish. The term
Question: Translate this word: "pouls"
Expected
pulso
Provided
Question: Translate this word: "tempe"
Expected
sien
Provided
<lemma_base form>,
Question: Translate this word: "écraser"
Expected
aplastar
Provided
Question: Translate this word: "démolir"
Expected
demoler
Provided
demolar
Question: Translate this word: "brûler"
Expected
quemar
Provided
<lemma_baseform>
Question: Translate this word: "dissoudre"
Expected
disolver
Provided
...
Question: Translate this word: "noir"
Expected
negro
Provided
noir
Question: Translate this word: "orange"
Expected
naranja
Provided
<lemma>
Question: Translate this word: "brun"
Expected
marrón
Provided
(the correct translation in lemma form to Spanish for the word 'brun' meaning
Question: Translate this word: "violet"
Expected
morado
Provided
violeta