Run Details #568
Model
GPT-5 nano
Score
96
Correct (≥100)
50/52
Incorrect (<100)
2
Avg Time
865.5ms
Tokens Used
6896
Cost
873µ$
Benchmark:
0017_synonyms
Run Date: 2026-02-28 19:31:04
Questions (52)
Question: Which of these words is a synonym of "hat" in English: scarf, cap, glove, coat, hood, boot
Expected
{
"synonym": "cap"
}
Provided
cap
Question: Which of these words is a synonym of "bag" in English: case, basket, sack, shelf, trunk, box
Expected
{
"synonym": "sack"
}
Provided
sack
Question: Which of these words is a synonym of "chair" in English: desk, table, couch, floor, shelf, seat
Expected
{
"synonym": "seat"
}
Provided
seat
Question: Which of these words is a synonym of "happiness" in English: love, anger, peace, sadness, fear, joy
Expected
{
"synonym": "joy"
}
Provided
joy
Question: Which of these words is a synonym of "refrigerator" in English: oven, stove, kettle, toaster, microwave, fridge
Expected
{
"synonym": "fridge"
}
Provided
fridge
Question: Which of these words is a synonym of "dog" in English: equine, hound, ursine, bovine, feline, otter
Expected
{
"synonym": "hound"
}
Provided
hound
Question: Which of these words is a synonym of "西红柿" in Chinese: 幸福, 袋子, 帽子, 狗, 椅子, 番茄
Expected
{
"synonym": "\u756a\u8304"
}
Provided
番茄
Question: Which of these words is a synonym of "袋子" in Chinese: 椅子, 包, 幸福, 帽子, 冰箱, 老虎
Expected
{
"synonym": "\u5305"
}
Provided
包
Question: Which of these words is a synonym of "椅子" in Chinese: 座椅, 冰箱, 袋子, 帽子, 幸福, 老虎
Expected
{
"synonym": "\u5ea7\u6905"
}
Provided
座椅
Question: Which of these words is a synonym of "幸福" in Chinese: 狗, 袋子, 椅子, 快乐, 冰箱, 帽子
Expected
{
"synonym": "\u5feb\u4e50"
}
Provided
快乐
Question: Which of these words is a synonym of "番茄" in Chinese: 袋子, 狗, 椅子, 老虎, 帽子, 西红柿
Expected
{
"synonym": "\u897f\u7ea2\u67ff"
}
Provided
西红柿
Question: Which of these words is a synonym of "冰箱" in Chinese: 狗, 冰柜, 帽子, 幸福, 番茄, 老虎
Expected
{
"synonym": "\u51b0\u67dc"
}
Provided
冰柜
Question: Which of these words is a synonym of "老虎" in Chinese: 虎, 幸福, 椅子, 帽子, 袋子, 狗
Expected
{
"synonym": "\u864e"
}
Provided
虎
Question: Which of these words is a synonym of "狗" in Chinese: 老虎, 帽子, 袋子, 冰箱, 幸福, 犬
Expected
{
"synonym": "\u72ac"
}
Provided
犬
Question: Which of these words is a synonym of "chapeau" in French: couvre-chef, sac, chien, chaise, bonheur, réfrigérateur
Expected
{
"synonym": "couvre-chef"
}
Provided
couvre-chef
Question: Which of these words is a synonym of "sac" in French: chaise, chien, bonheur, réfrigérateur, sacoche, chapeau
Expected
{
"synonym": "sacoche"
}
Provided
sacoche
Question: Which of these words is a synonym of "chaise" in French: chien, sac, bonheur, siège, tomate, chapeau
Expected
{
"synonym": "si\u00e8ge"
}
Provided
siège
Question: Which of these words is a synonym of "bonheur" in French: chapeau, réfrigérateur, joie, sac, tigre, chaise
Expected
{
"synonym": "joie"
}
Provided
joie
Question: Which of these words is a synonym of "réfrigérateur" in French: bonheur, chapeau, chien, frigo, tomate, tigre
Expected
{
"synonym": "frigo"
}
Provided
frigo
Question: Which of these words is a synonym of "chien" in French: tigre, sac, bonheur, chapeau, réfrigérateur, canidé
Expected
{
"synonym": "canid\u00e9"
}
Provided
canidé
Question: Which of these words is a synonym of "sombrero" in Spanish: felicidad, bolsa, refrigerador, gorro, tomate, silla
Expected
{
"synonym": "gorro"
}
Provided
gorro
Question: Which of these words is a synonym of "bolsa" in Spanish: tomate, perro, felicidad, silla, sombrero, saco
Expected
{
"synonym": "saco"
}
Provided
saco
Question: Which of these words is a synonym of "silla" in Spanish: sombrero, refrigerador, bolsa, asiento, perro, felicidad
Expected
{
"synonym": "asiento"
}
Provided
asiento
Question: Which of these words is a synonym of "felicidad" in Spanish: silla, bolsa, tigre, tomate, sombrero, alegría
Expected
{
"synonym": "alegr\u00eda"
}
Provided
alegría
Question: Which of these words is a synonym of "tomate" in Spanish: felicidad, perro, silla, sombrero, refrigerador, jitomate
Expected
{
"synonym": "jitomate"
}
Provided
jitomate
Question: Which of these words is a synonym of "refrigerador" in Spanish: tomate, felicidad, bolsa, perro, nevera, sombrero
Expected
{
"synonym": "nevera"
}
Provided
nevera
Question: Which of these words is a synonym of "perro" in Spanish: tigre, bolsa, can, sombrero, silla, tomate
Expected
{
"synonym": "can"
}
Provided
can
Question: Which of these words is a synonym of "skrybėlė" in Lithuanian: šuo, laimė, kėdė, kepurė, šaldytuvas, maišelis
Expected
{
"synonym": "kepur\u0117"
}
Provided
kepurė
Question: Which of these words is a synonym of "maišelis" in Lithuanian: kėdė, skrybėlė, pomidoras, šuo, laimė, krepšys
Expected
{
"synonym": "krep\u0161ys"
}
Provided
krepšys
Question: Which of these words is a synonym of "kėdė" in Lithuanian: skrybėlė, sėdynė, tigras, laimė, maišelis, šaldytuvas
Expected
{
"synonym": "s\u0117dyn\u0117"
}
Provided
sėdynė
Question: Which of these words is a synonym of "laimė" in Lithuanian: šuo, kėdė, maišelis, skrybėlė, pomidoras, džiaugsmas
Expected
{
"synonym": "d\u017eiaugsmas"
}
Provided
džiaugsmas
Question: Which of these words is a synonym of "šaldytuvas" in Lithuanian: laimė, skrybėlė, tigras, pomidoras, šuo, šaldiklis
Expected
{
"synonym": "\u0161aldiklis"
}
Provided
šaldiklis
Question: Which of these words is a synonym of "šuo" in Lithuanian: laimė, kėdė, skrybėlė, šuva, tigras, šaldytuvas
Expected
{
"synonym": "\u0161uva"
}
Provided
šuva
Question: Which of these words is a synonym of "капелюх" in Ukrainian: щастя, шапка, сумка, собака, стілець, холодильник
Expected
{
"synonym": "\u0448\u0430\u043f\u043a\u0430"
}
Provided
шапка
Question: Which of these words is a synonym of "сумка" in Ukrainian: щастя, стілець, торба, капелюх, собака, помідор
Expected
{
"synonym": "\u0442\u043e\u0440\u0431\u0430"
}
Provided
торба
Question: Which of these words is a synonym of "стілець" in Ukrainian: сумка, капелюх, тигр, щастя, холодильник, сидіння
Expected
{
"synonym": "\u0441\u0438\u0434\u0456\u043d\u043d\u044f"
}
Provided
сидіння
Question: Which of these words is a synonym of "щастя" in Ukrainian: собака, сумка, помідор, стілець, радість, капелюх
Expected
{
"synonym": "\u0440\u0430\u0434\u0456\u0441\u0442\u044c"
}
Provided
радість
Question: Which of these words is a synonym of "помідор" in Ukrainian: стілець, капелюх, томат, холодильник, щастя, собака
Expected
{
"synonym": "\u0442\u043e\u043c\u0430\u0442"
}
Provided
томат
Question: Which of these words is a synonym of "холодильник" in Ukrainian: сумка, тигр, помідор, холодильна шафа, щастя, капелюх
Expected
{
"synonym": "\u0445\u043e\u043b\u043e\u0434\u0438\u043b\u044c\u043d\u0430 \u0448\u0430\u0444\u0430"
}
Provided
холодильна шафа
Question: Which of these words is a synonym of "собака" in Ukrainian: тигр, щастя, сумка, пес, холодильник, капелюх
Expected
{
"synonym": "\u043f\u0435\u0441"
}
Provided
пес
Question: Which of these words is a synonym of "টুপি" in Bengali: চেয়ার, মাথার টুপি, ফ্রিজ, সুখ, কুকুর, ব্যাগ
Expected
{
"synonym": "\u09ae\u09be\u09a5\u09be\u09b0 \u099f\u09c1\u09aa\u09bf"
}
Provided
মাথার টুপি
Question: Which of these words is a synonym of "ব্যাগ" in Bengali: থলে, টুপি, সুখ, কুকুর, চেয়ার, টমেটো
Expected
{
"synonym": "\u09a5\u09b2\u09c7"
}
Provided
থলে
Question: Which of these words is a synonym of "চেয়ার" in Bengali: ব্যাগ, আসন, বাঘ, ফ্রিজ, সুখ, টুপি
Expected
{
"synonym": "\u0986\u09b8\u09a8"
}
Provided
আশন
Question: Which of these words is a synonym of "সুখ" in Bengali: চেয়ার, ব্যাগ, টুপি, আনন্দ, টমেটো, বাঘ
Expected
{
"synonym": "\u0986\u09a8\u09a8\u09cd\u09a6"
}
Provided
আনন্দ
Question: Which of these words is a synonym of "ফ্রিজ" in Bengali: টুপি, শীতলপেটি, বাঘ, টমেটো, সুখ, কুকুর
Expected
{
"synonym": "\u09b6\u09c0\u09a4\u09b2\u09aa\u09c7\u099f\u09bf"
}
Provided
শীতলপেটি
Question: Which of these words is a synonym of "কুকুর" in Bengali: শ্বান, বাঘ, ফ্রিজ, ব্যাগ, টুপি, সুখ
Expected
{
"synonym": "\u09b6\u09cd\u09ac\u09be\u09a8"
}
Provided
সুখ
Question: Which of these words is a synonym of "ಟೋಪಿ" in Kannada: ಚೀಲ, ತಲೆಯ ಟೋಪಿ, ಫ್ರಿಜ್, ಕುರ್ಚಿ, ಸಂತೋಷ, ನಾಯಿ
Expected
{
"synonym": "\u0ca4\u0cb2\u0cc6\u0caf \u0c9f\u0ccb\u0caa\u0cbf"
}
Provided
ತಲೆಯ ಟೋಪಿ
Question: Which of these words is a synonym of "ಚೀಲ" in Kannada: ನಾಯಿ, ಚೀಲಿಕೆ, ಸಂತೋಷ, ಟೋಪಿ, ಕುರ್ಚಿ, ಟೊಮ್ಯಾಟೊ
Expected
{
"synonym": "\u0c9a\u0cc0\u0cb2\u0cbf\u0c95\u0cc6"
}
Provided
ಚೀಲಿಕೆ
Question: Which of these words is a synonym of "ಕುರ್ಚಿ" in Kannada: ಆಸನ, ಸಂತೋಷ, ಫ್ರಿಜ್, ಟೋಪಿ, ಚೀಲ, ಹುಲಿ
Expected
{
"synonym": "\u0c86\u0cb8\u0ca8"
}
Provided
ಆಸನ
Question: Which of these words is a synonym of "ಸಂತೋಷ" in Kannada: ಚೀಲ, ಟೊಮ್ಯಾಟೊ, ಟೋಪಿ, ನಾಯಿ, ಕುರ್ಚಿ, ಆನಂದ
Expected
{
"synonym": "\u0c86\u0ca8\u0c82\u0ca6"
}
Provided
ಆನಂದ
Question: Which of these words is a synonym of "ಫ್ರಿಜ್" in Kannada: ಶೀತಲಪೆಟ್ಟಿಗೆ, ನಾಯಿ, ಟೊಮ್ಯಾಟೊ, ಟೋಪಿ, ಹುಲಿ, ಸಂತೋಷ
Expected
{
"synonym": "\u0cb6\u0cc0\u0ca4\u0cb2\u0caa\u0cc6\u0c9f\u0ccd\u0c9f\u0cbf\u0c97\u0cc6"
}
Provided
ಶೀತಲಪೆಟ್ಟಿಗೆ
Question: Which of these words is a synonym of "ನಾಯಿ" in Kannada: ಸಂತೋಷ, ಶ್ವಾನ, ಟೋಪಿ, ಚೀಲ, ಫ್ರಿಜ್, ಹುಲಿ
Expected
{
"synonym": "\u0cb6\u0ccd\u0cb5\u0cbe\u0ca8"
}
Provided
ಶ್ವಾನ