Run Details #513
Model
Qwen3 VL 8B (LMStudio)
Score
27
Correct (≥100)
11/40
Incorrect (<100)
29
Avg Time
3046.4ms
Tokens Used
3526
Cost
$0.0061
Benchmark:
0014_syllable_count
Run Date: 2026-02-28 18:26:06
Questions (40)
Question: How many syllables are in the English word 'cat'?
Expected
1
Provided
{
"syllable_count": 1
}
Question: How many syllables are in the English word 'tree'?
Expected
1
Provided
{
"syllable_count": 1
}
Question: How many syllables are in the English word 'apple'?
Expected
2
Provided
{
"syllable_count": 2
}
Question: How many syllables are in the English word 'umbrella'?
Expected
3
Provided
{
"syllable_count": 2
}
Question: How many syllables are in the English word 'beautiful'?
Expected
3
Provided
{
"syllable_count": 3
}
Question: How many syllables are in the English word 'education'?
Expected
4
Provided
{
"syllable_count": 3
}
Question: How many syllables are in the English word 'strength'?
Expected
1
Provided
{
"syllable_count": 1
}
Question: How many syllables are in the English word 'programming'?
Expected
3
Provided
{
"syllable_count": 2
}
Question: How many syllables are in the English word 'communication'?
Expected
5
Provided
{
"syllable_count": 3
}
Question: How many syllables are in the English word 'strawberry'?
Expected
3
Provided
{
"syllable_count": 2
}
Question: How many syllables are in the French word 'ami'?
Expected
2
Provided
{
"syllable_count": 1
}
Question: How many syllables are in the French word 'école'?
Expected
2
Provided
{
"syllable_count": 2
}
Question: How many syllables are in the French word 'liberté'?
Expected
3
Provided
{
"syllable_count": 2
}
Question: How many syllables are in the French word 'maison'?
Expected
2
Provided
{
"syllable_count": 2
}
Question: How many syllables are in the French word 'château'?
Expected
2
Provided
{
"syllable_count": 2
}
Question: How many syllables are in the French word 'révolution'?
Expected
4
Provided
{
"syllable_count": 3
}
Question: How many syllables are in the French word 'époque'?
Expected
2
Provided
{
"syllable_count": 2
}
Question: How many syllables are in the French word 'intelligence'?
Expected
4
Provided
{
"syllable_count": 3
}
Question: How many syllables are in the French word 'conversation'?
Expected
4
Provided
{
"syllable_count": 3
}
Question: How many syllables are in the French word 'beauté'?
Expected
2
Provided
{
"syllable_count": 2
}
Question: How many syllables are in the Spanish word 'casa'?
Expected
2
Provided
{
"syllable_count": 1
}
Question: How many syllables are in the Spanish word 'amigo'?
Expected
3
Provided
{
"syllable_count": 2
}
Question: How many syllables are in the Spanish word 'señor'?
Expected
2
Provided
{
"syllable_count": 2
}
Question: How many syllables are in the Spanish word 'música'?
Expected
3
Provided
{
"syllable_count": 2
}
Question: How many syllables are in the Spanish word 'corazón'?
Expected
3
Provided
{
"syllable_count": 2
}
Question: How many syllables are in the Spanish word 'educación'?
Expected
4
Provided
{
"syllable_count": 3
}
Question: How many syllables are in the Spanish word 'universidad'?
Expected
5
Provided
{
"syllable_count": 4
}
Question: How many syllables are in the Spanish word 'comunicación'?
Expected
5
Provided
{
"syllable_count": 4
}
Question: How many syllables are in the Spanish word 'extraordinario'?
Expected
6
Provided
{
"syllable_count": 4
}
Question: How many syllables are in the Spanish word 'primavera'?
Expected
4
Provided
{
"syllable_count": 3
}
Question: How many syllables are in the Italian word 'cane'?
Expected
2
Provided
{
"syllable_count": 1
}
Question: How many syllables are in the Italian word 'amore'?
Expected
3
Provided
{
"syllable_count": 2
}
Question: How many syllables are in the Italian word 'libro'?
Expected
2
Provided
{
"syllable_count": 1
}
Question: How many syllables are in the Italian word 'bambino'?
Expected
3
Provided
{
"syllable_count": 2
}
Question: How many syllables are in the Italian word 'università'?
Expected
5
Provided
{
"syllable_count": 3
}
Question: How many syllables are in the Italian word 'bellissimo'?
Expected
4
Provided
{
"syllable_count": 3
}
Question: How many syllables are in the Italian word 'comunicazione'?
Expected
6
Provided
{
"syllable_count": 4
}
Question: How many syllables are in the Italian word 'meraviglioso'?
Expected
5
Provided
{
"syllable_count": 3
}
Question: How many syllables are in the Italian word 'straordinario'?
Expected
5
Provided
{
"syllable_count": 4
}
Question: How many syllables are in the Italian word 'pianoforte'?
Expected
4
Provided
{
"syllable_count": 3
}