Run #893 - Multilingual Dictionary Editor

Question: Which of these words is a synonym of "hat" in English: scarf, cap, glove, coat, hood, boot

Expected

{
  "synonym": "cap"
}

Provided

cap

Question: Which of these words is a synonym of "bag" in English: case, basket, sack, shelf, trunk, box

Expected

{
  "synonym": "sack"
}

Provided

sack

Question: Which of these words is a synonym of "chair" in English: desk, table, couch, floor, shelf, seat

Expected

{
  "synonym": "seat"
}

Provided

seat

Question: Which of these words is a synonym of "happiness" in English: love, anger, peace, sadness, fear, joy

Expected

{
  "synonym": "joy"
}

Provided

joy

Question: Which of these words is a synonym of "refrigerator" in English: oven, stove, kettle, toaster, microwave, fridge

Expected

{
  "synonym": "fridge"
}

Provided

fridge

Question: Which of these words is a synonym of "dog" in English: equine, hound, ursine, bovine, feline, otter

Expected

{
  "synonym": "hound"
}

Provided

hound

Question: Which of these words is a synonym of "西红柿" in Chinese: 幸福, 袋子, 帽子, 狗, 椅子, 番茄

Expected

{
  "synonym": "番茄"
}

Provided

番茄

Question: Which of these words is a synonym of "袋子" in Chinese: 椅子, 包, 幸福, 帽子, 冰箱, 老虎

Expected

{
  "synonym": "包"
}

Provided

包

Question: Which of these words is a synonym of "椅子" in Chinese: 座椅, 冰箱, 袋子, 帽子, 幸福, 老虎

Expected

{
  "synonym": "座椅"
}

Provided

座椅

Question: Which of these words is a synonym of "幸福" in Chinese: 狗, 袋子, 椅子, 快乐, 冰箱, 帽子

Expected

{
  "synonym": "快乐"
}

Provided

快乐

Question: Which of these words is a synonym of "番茄" in Chinese: 袋子, 狗, 椅子, 老虎, 帽子, 西红柿

Expected

{
  "synonym": "西红柿"
}

Provided

西红柿

Question: Which of these words is a synonym of "冰箱" in Chinese: 狗, 冰柜, 帽子, 幸福, 番茄, 老虎

Expected

{
  "synonym": "冰柜"
}

Provided

冰柜

Question: Which of these words is a synonym of "老虎" in Chinese: 虎, 幸福, 椅子, 帽子, 袋子, 狗

Expected

{
  "synonym": "虎"
}

Provided

虎

Question: Which of these words is a synonym of "狗" in Chinese: 老虎, 帽子, 袋子, 冰箱, 幸福, 犬

Expected

{
  "synonym": "犬"
}

Provided

犬

Question: Which of these words is a synonym of "chapeau" in French: couvre-chef, sac, chien, chaise, bonheur, réfrigérateur

Expected

{
  "synonym": "couvre-chef"
}

Provided

couvre-chef

Question: Which of these words is a synonym of "sac" in French: chaise, chien, bonheur, réfrigérateur, sacoche, chapeau

Expected

{
  "synonym": "sacoche"
}

Provided

sacoche

Question: Which of these words is a synonym of "chaise" in French: chien, sac, bonheur, siège, tomate, chapeau

Expected

{
  "synonym": "siège"
}

Provided

siège

Question: Which of these words is a synonym of "bonheur" in French: chapeau, réfrigérateur, joie, sac, tigre, chaise

Expected

{
  "synonym": "joie"
}

Provided

joie

Question: Which of these words is a synonym of "réfrigérateur" in French: bonheur, chapeau, chien, frigo, tomate, tigre

Expected

{
  "synonym": "frigo"
}

Provided

frigo

Question: Which of these words is a synonym of "chien" in French: tigre, sac, bonheur, chapeau, réfrigérateur, canidé

Expected

{
  "synonym": "canidé"
}

Provided

canidé

Question: Which of these words is a synonym of "sombrero" in Spanish: felicidad, bolsa, refrigerador, gorro, tomate, silla

Expected

{
  "synonym": "gorro"
}

Provided

gorro

Question: Which of these words is a synonym of "bolsa" in Spanish: tomate, perro, felicidad, silla, sombrero, saco

Expected

{
  "synonym": "saco"
}

Provided

saco

Question: Which of these words is a synonym of "silla" in Spanish: sombrero, refrigerador, bolsa, asiento, perro, felicidad

Expected

{
  "synonym": "asiento"
}

Provided

asiento

Question: Which of these words is a synonym of "felicidad" in Spanish: silla, bolsa, tigre, tomate, sombrero, alegría

Expected

{
  "synonym": "alegría"
}

Provided

alegría

Question: Which of these words is a synonym of "tomate" in Spanish: felicidad, perro, silla, sombrero, refrigerador, jitomate

Expected

{
  "synonym": "jitomate"
}

Provided

jitomate

Question: Which of these words is a synonym of "refrigerador" in Spanish: tomate, felicidad, bolsa, perro, nevera, sombrero

Expected

{
  "synonym": "nevera"
}

Provided

nevera

Question: Which of these words is a synonym of "perro" in Spanish: tigre, bolsa, can, sombrero, silla, tomate

Expected

{
  "synonym": "can"
}

Provided

can

Question: Which of these words is a synonym of "skrybėlė" in Lithuanian: šuo, laimė, kėdė, kepurė, šaldytuvas, maišelis

Expected

{
  "synonym": "kepurė"
}

Provided

kėdė

Question: Which of these words is a synonym of "maišelis" in Lithuanian: kėdė, skrybėlė, pomidoras, šuo, laimė, krepšys

Expected

{
  "synonym": "krepšys"
}

Provided

krepšys

Question: Which of these words is a synonym of "kėdė" in Lithuanian: skrybėlė, sėdynė, tigras, laimė, maišelis, šaldytuvas

Expected

{
  "synonym": "sėdynė"
}

Provided

sėdynė

Question: Which of these words is a synonym of "laimė" in Lithuanian: šuo, kėdė, maišelis, skrybėlė, pomidoras, džiaugsmas

Expected

{
  "synonym": "džiaugsmas"
}

Provided

džiaugsmas

Question: Which of these words is a synonym of "šaldytuvas" in Lithuanian: laimė, skrybėlė, tigras, pomidoras, šuo, šaldiklis

Expected

{
  "synonym": "šaldiklis"
}

Provided

šaldiklis

Question: Which of these words is a synonym of "šuo" in Lithuanian: laimė, kėdė, skrybėlė, šuva, tigras, šaldytuvas

Expected

{
  "synonym": "šuva"
}

Provided

šuo

Question: Which of these words is a synonym of "капелюх" in Ukrainian: щастя, шапка, сумка, собака, стілець, холодильник

Expected

{
  "synonym": "шапка"
}

Provided

шапка

Question: Which of these words is a synonym of "сумка" in Ukrainian: щастя, стілець, торба, капелюх, собака, помідор

Expected

{
  "synonym": "торба"
}

Provided

торба

Question: Which of these words is a synonym of "стілець" in Ukrainian: сумка, капелюх, тигр, щастя, холодильник, сидіння

Expected

{
  "synonym": "сидіння"
}

Provided

сидіння

Question: Which of these words is a synonym of "щастя" in Ukrainian: собака, сумка, помідор, стілець, радість, капелюх

Expected

{
  "synonym": "радість"
}

Provided

радість

Question: Which of these words is a synonym of "помідор" in Ukrainian: стілець, капелюх, томат, холодильник, щастя, собака

Expected

{
  "synonym": "томат"
}

Provided

томат

Question: Which of these words is a synonym of "холодильник" in Ukrainian: сумка, тигр, помідор, холодильна шафа, щастя, капелюх

Expected

{
  "synonym": "холодильна шафа"
}

Provided

холодильна шафа

Question: Which of these words is a synonym of "собака" in Ukrainian: тигр, щастя, сумка, пес, холодильник, капелюх

Expected

{
  "synonym": "пес"
}

Provided

пес

Question: Which of these words is a synonym of "টুপি" in Bengali: চেয়ার, মাথার টুপি, ফ্রিজ, সুখ, কুকুর, ব্যাগ

Expected

{
  "synonym": "মাথার টুপি"
}

Provided

মাথার টুপি

Question: Which of these words is a synonym of "ব্যাগ" in Bengali: থলে, টুপি, সুখ, কুকুর, চেয়ার, টমেটো

Expected

{
  "synonym": "থলে"
}

Provided

থলে

Question: Which of these words is a synonym of "চেয়ার" in Bengali: ব্যাগ, আসন, বাঘ, ফ্রিজ, সুখ, টুপি

Expected

{
  "synonym": "আসন"
}

Provided

আসন

Question: Which of these words is a synonym of "সুখ" in Bengali: চেয়ার, ব্যাগ, টুপি, আনন্দ, টমেটো, বাঘ

Expected

{
  "synonym": "আনন্দ"
}

Provided

আনন্দ

Question: Which of these words is a synonym of "ফ্রিজ" in Bengali: টুপি, শীতলপেটি, বাঘ, টমেটো, সুখ, কুকুর

Expected

{
  "synonym": "শীতলপেটি"
}

Provided

শীতলপেটি

Question: Which of these words is a synonym of "কুকুর" in Bengali: শ্বান, বাঘ, ফ্রিজ, ব্যাগ, টুপি, সুখ

Expected

{
  "synonym": "শ্বান"
}

Provided

শ্বান

Question: Which of these words is a synonym of "ಟೋಪಿ" in Kannada: ಚೀಲ, ತಲೆಯ ಟೋಪಿ, ಫ್ರಿಜ್, ಕುರ್ಚಿ, ಸಂತೋಷ, ನಾಯಿ

Expected

{
  "synonym": "ತಲೆಯ ಟೋಪಿ"
}

Provided

ತಲೆಯ ಟೋಪಿ

Question: Which of these words is a synonym of "ಚೀಲ" in Kannada: ನಾಯಿ, ಚೀಲಿಕೆ, ಸಂತೋಷ, ಟೋಪಿ, ಕುರ್ಚಿ, ಟೊಮ್ಯಾಟೊ

Expected

{
  "synonym": "ಚೀಲಿಕೆ"
}

Provided

Question: Which of these words is a synonym of "ಕುರ್ಚಿ" in Kannada: ಆಸನ, ಸಂತೋಷ, ಫ್ರಿಜ್, ಟೋಪಿ, ಚೀಲ, ಹುಲಿ

Expected

{
  "synonym": "ಆಸನ"
}

Provided

ಆಸನ

Question: Which of these words is a synonym of "ಸಂತೋಷ" in Kannada: ಚೀಲ, ಟೊಮ್ಯಾಟೊ, ಟೋಪಿ, ನಾಯಿ, ಕುರ್ಚಿ, ಆನಂದ

Expected

{
  "synonym": "ಆನಂದ"
}

Provided

ಆನಂದ

Question: Which of these words is a synonym of "ಫ್ರಿಜ್" in Kannada: ಶೀತಲಪೆಟ್ಟಿಗೆ, ನಾಯಿ, ಟೊಮ್ಯಾಟೊ, ಟೋಪಿ, ಹುಲಿ, ಸಂತೋಷ

Expected

{
  "synonym": "ಶೀತಲಪೆಟ್ಟಿಗೆ"
}

Provided

ಶೀತಲಪೆಟ್ಟಿಗೆ

Question: Which of these words is a synonym of "ನಾಯಿ" in Kannada: ಸಂತೋಷ, ಶ್ವಾನ, ಟೋಪಿ, ಚೀಲ, ಫ್ರಿಜ್, ಹುಲಿ

Expected

{
  "synonym": "ಶ್ವಾನ"
}

Provided

ಶ್ವಾನ

Run Details #893

Model

Qwen3.5 9B (LMStudio)

Score

94

Correct (≥100)

49/52

Incorrect (<100)

3

Median Time

1620.0ms

Tokens Used

5495

Cost

$0.0044

Questions (52)

Run Details #893

Model

Qwen3.5 9B (LMStudio)

Score

94

Correct (≥100)

49/52

Incorrect (<100)

3

Median Time

1620.0ms

Tokens Used

5495

Cost

$0.0044

Questions (52)

0017_synonyms:0 Correct Score: 100 • 1578ms • 93 tokens • 79µ$

0017_synonyms:1 Correct Score: 100 • 1508ms • 93 tokens • 75µ$

0017_synonyms:2 Correct Score: 100 • 1643ms • 95 tokens • 82µ$

0017_synonyms:3 Correct Score: 100 • 1282ms • 91 tokens • 64µ$

0017_synonyms:4 Correct Score: 100 • 1730ms • 98 tokens • 87µ$

0017_synonyms:5 Correct Score: 100 • 1490ms • 99 tokens • 75µ$

0017_synonyms:6 Correct Score: 100 • 1433ms • 98 tokens • 72µ$

0017_synonyms:7 Correct Score: 100 • 1419ms • 98 tokens • 71µ$

0017_synonyms:8 Correct Score: 100 • 1694ms • 101 tokens • 85µ$

0017_synonyms:9 Correct Score: 100 • 1682ms • 101 tokens • 84µ$

0017_synonyms:10 Correct Score: 100 • 1609ms • 100 tokens • 80µ$

0017_synonyms:11 Correct Score: 100 • 1758ms • 103 tokens • 88µ$

0017_synonyms:12 Correct Score: 100 • 1422ms • 98 tokens • 71µ$

0017_synonyms:13 Correct Score: 100 • 1143ms • 94 tokens • 57µ$

0017_synonyms:14 Correct Score: 100 • 1482ms • 99 tokens • 74µ$

0017_synonyms:15 Correct Score: 100 • 1518ms • 99 tokens • 76µ$

0017_synonyms:16 Correct Score: 100 • 1660ms • 98 tokens • 83µ$

0017_synonyms:17 Correct Score: 100 • 1581ms • 100 tokens • 79µ$

0017_synonyms:18 Correct Score: 100 • 1559ms • 98 tokens • 78µ$

0017_synonyms:19 Correct Score: 100 • 1358ms • 96 tokens • 68µ$

0017_synonyms:20 Correct Score: 100 • 1359ms • 94 tokens • 68µ$

0017_synonyms:21 Correct Score: 100 • 1511ms • 96 tokens • 76µ$

0017_synonyms:22 Correct Score: 100 • 1359ms • 94 tokens • 68µ$

0017_synonyms:23 Correct Score: 100 • 1410ms • 96 tokens • 71µ$

0017_synonyms:24 Correct Score: 100 • 1634ms • 100 tokens • 82µ$

0017_synonyms:25 Correct Score: 100 • 1346ms • 95 tokens • 67µ$

0017_synonyms:26 Correct Score: 100 • 1282ms • 93 tokens • 64µ$

0017_synonyms:27 Incorrect Score: 0 • 1631ms • 112 tokens • 82µ$

0017_synonyms:28 Correct Score: 100 • 1848ms • 115 tokens • 92µ$

0017_synonyms:29 Correct Score: 100 • 2027ms • 119 tokens • 101µ$

0017_synonyms:30 Correct Score: 100 • 1997ms • 118 tokens • 100µ$

0017_synonyms:31 Correct Score: 100 • 1834ms • 115 tokens • 92µ$

0017_synonyms:32 Incorrect Score: 0 • 1861ms • 114 tokens • 93µ$

0017_synonyms:33 Correct Score: 100 • 1565ms • 105 tokens • 78µ$

0017_synonyms:34 Correct Score: 100 • 1359ms • 104 tokens • 68µ$

0017_synonyms:35 Correct Score: 100 • 1903ms • 110 tokens • 95µ$

0017_synonyms:36 Correct Score: 100 • 1435ms • 104 tokens • 72µ$

0017_synonyms:37 Correct Score: 100 • 1360ms • 102 tokens • 68µ$

0017_synonyms:38 Correct Score: 100 • 1941ms • 116 tokens • 97µ$

0017_synonyms:39 Correct Score: 100 • 3106ms • 123 tokens • 155µ$

0017_synonyms:40 Correct Score: 100 • 1635ms • 110 tokens • 82µ$

0017_synonyms:41 Correct Score: 100 • 3067ms • 127 tokens • 153µ$

0017_synonyms:42 Correct Score: 100 • 1589ms • 104 tokens • 79µ$

0017_synonyms:43 Correct Score: 100 • 1744ms • 109 tokens • 87µ$

0017_synonyms:44 Correct Score: 100 • 1919ms • 115 tokens • 96µ$

0017_synonyms:45 Correct Score: 100 • 1641ms • 107 tokens • 82µ$

0017_synonyms:46 Correct Score: 100 • 2161ms • 127 tokens • 108µ$

0017_synonyms:47 Incorrect Score: 0 • 2970ms • 138 tokens • 149µ$

0017_synonyms:48 Correct Score: 100 • 1697ms • 118 tokens • 85µ$

0017_synonyms:49 Correct Score: 100 • 1808ms • 120 tokens • 90µ$

0017_synonyms:50 Correct Score: 100 • 1857ms • 128 tokens • 93µ$

0017_synonyms:51 Correct Score: 100 • 1572ms • 115 tokens • 79µ$