Run Details #949

Model

GPT-5.4 mini

Score

98

Stored run score 97 recalculated to 98 after question exclusions.

Correct (≥100)

39/40

Incorrect (<100)

1

Median Time

818.5ms

Tokens Used

7043

Cost

$0.0018

Suspicious cost data. Stored run cost differs noticeably from the current pricing estimate (estimated token split). Stored total: $0.0018 · Current estimate: $0.0119 (estimated)

Benchmark: 0013_vowel_count

Run Date: 2026-03-17 18:49:25

Questions (40)

Question: How many vowels (a, e, i, o, u and their accented forms) are in the English word 'cat'?

Expected

Provided

{
  "vowel_count": 1
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the English word 'tree'?

Expected

Provided

{
  "vowel_count": 2
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the English word 'apple'?

Expected

Provided

{
  "vowel_count": 2
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the English word 'umbrella'?

Expected

Provided

{
  "vowel_count": 3
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the English word 'beautiful'?

Expected

Provided

{
  "vowel_count": 5
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the English word 'education'?

Expected

Provided

{
  "vowel_count": 5
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the English word 'strength'?

Expected

Provided

{
  "vowel_count": 1
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the English word 'programming'?

Expected

Provided

{
  "vowel_count": 2
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the English word 'communication'?

Expected

Provided

{
  "vowel_count": 6
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the English word 'strawberry'?

Expected

Provided

{
  "vowel_count": 2
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the French word 'ami'?

Expected

Provided

{
  "vowel_count": 2
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the French word 'école'?

Expected

Provided

{
  "vowel_count": 3
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the French word 'liberté'?

Expected

Provided

{
  "vowel_count": 3
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the French word 'maison'?

Expected

Provided

{
  "vowel_count": 3
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the French word 'château'?

Expected

Provided

{
  "vowel_count": 4
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the French word 'révolution'?

Expected

Provided

{
  "vowel_count": 5
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the French word 'époque'?

Expected

Provided

{
  "vowel_count": 4
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the French word 'intelligence'?

Expected

Provided

{
  "vowel_count": 5
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the French word 'conversation'?

Expected

Provided

{
  "vowel_count": 5
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the French word 'beauté'?

Expected

Provided

{
  "vowel_count": 4
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the Spanish word 'casa'?

Expected

Provided

{
  "vowel_count": 2
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the Spanish word 'amigo'?

Expected

Provided

{
  "vowel_count": 3
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the Spanish word 'señor'?

Expected

Provided

{
  "vowel_count": 2
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the Spanish word 'música'?

Expected

Provided

{
  "vowel_count": 3
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the Spanish word 'corazón'?

Expected

Provided

{
  "vowel_count": 3
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the Spanish word 'educación'?

Expected

Provided

{
  "vowel_count": 5
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the Spanish word 'universidad'?

Expected

Provided

{
  "vowel_count": 5
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the Spanish word 'comunicación'?

Expected

Provided

{
  "vowel_count": 6
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the Spanish word 'extraordinario'?

Expected

Provided

{
  "vowel_count": 7
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the Spanish word 'primavera'?

Expected

Provided

{
  "vowel_count": 4
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the Italian word 'cane'?

Expected

Provided

{
  "vowel_count": 2
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the Italian word 'amore'?

Expected

Provided

{
  "vowel_count": 3
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the Italian word 'libro'?

Expected

Provided

{
  "vowel_count": 2
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the Italian word 'bambino'?

Expected

Provided

{
  "vowel_count": 3
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the Italian word 'università'?

Expected

Provided

{
  "vowel_count": 5
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the Italian word 'bellissimo'?

Expected

Provided

{
  "vowel_count": 4
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the Italian word 'comunicazione'?

Expected

Provided

{
  "vowel_count": 7
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the Italian word 'meraviglioso'?

Expected

Provided

{
  "vowel_count": 6
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the Italian word 'straordinario'?

Expected

Provided

{
  "vowel_count": 6
}

Question: How many vowels (a, e, i, o, u and their accented forms) are in the Italian word 'pianoforte'?

Expected

Provided

{
  "vowel_count": 5
}

Run Details #949

Model

GPT-5.4 mini

Score

98

Correct (≥100)

39/40

Incorrect (<100)

1

Median Time

818.5ms

Tokens Used

7043

Cost

$0.0018

Questions (40)

0013_vowel_count:0 Correct Score: 100 • 732ms • 175 tokens • 37µ$

0013_vowel_count:1 Correct Score: 100 • 695ms • 175 tokens • 35µ$

0013_vowel_count:2 Correct Score: 100 • 884ms • 175 tokens • 44µ$

0013_vowel_count:3 Correct Score: 100 • 2251ms • 176 tokens • 113µ$

0013_vowel_count:4 Correct Score: 100 • 819ms • 175 tokens • 41µ$

0013_vowel_count:5 Correct Score: 100 • 920ms • 175 tokens • 46µ$

0013_vowel_count:6 Correct Score: 100 • 715ms • 175 tokens • 36µ$

0013_vowel_count:7 Incorrect Score: 0 • 716ms • 176 tokens • 36µ$

0013_vowel_count:8 Correct Score: 100 • 921ms • 175 tokens • 46µ$

0013_vowel_count:9 Correct Score: 100 • 820ms • 177 tokens • 41µ$

0013_vowel_count:10 Correct Score: 100 • 919ms • 175 tokens • 46µ$

0013_vowel_count:11 Correct Score: 100 • 715ms • 176 tokens • 36µ$

0013_vowel_count:12 Correct Score: 100 • 1332ms • 177 tokens • 67µ$

0013_vowel_count:13 Correct Score: 100 • 818ms • 176 tokens • 41µ$

0013_vowel_count:14 Correct Score: 100 • 742ms • 176 tokens • 37µ$

0013_vowel_count:15 Correct Score: 100 • 806ms • 176 tokens • 40µ$

0013_vowel_count:16 Correct Score: 100 • 699ms • 176 tokens • 35µ$

0013_vowel_count:17 Correct Score: 100 • 1433ms • 176 tokens • 72µ$

0013_vowel_count:18 Correct Score: 100 • 710ms • 175 tokens • 36µ$

0013_vowel_count:19 Correct Score: 100 • 824ms • 176 tokens • 41µ$

0013_vowel_count:20 Correct Score: 100 • 1431ms • 176 tokens • 72µ$

0013_vowel_count:21 Correct Score: 100 • 698ms • 176 tokens • 35µ$

0013_vowel_count:22 Correct Score: 100 • 848ms • 177 tokens • 42µ$

0013_vowel_count:23 Correct Score: 100 • 1212ms • 176 tokens • 61µ$

0013_vowel_count:24 Correct Score: 100 • 821ms • 176 tokens • 41µ$

0013_vowel_count:25 Correct Score: 100 • 891ms • 176 tokens • 45µ$

0013_vowel_count:26 Correct Score: 100 • 663ms • 176 tokens • 33µ$

0013_vowel_count:27 Correct Score: 100 • 797ms • 177 tokens • 40µ$

0013_vowel_count:28 Correct Score: 100 • 695ms • 177 tokens • 35µ$

0013_vowel_count:29 Correct Score: 100 • 737ms • 176 tokens • 37µ$

0013_vowel_count:30 Correct Score: 100 • 667ms • 176 tokens • 33µ$

0013_vowel_count:31 Correct Score: 100 • 666ms • 176 tokens • 33µ$

0013_vowel_count:32 Correct Score: 100 • 710ms • 176 tokens • 36µ$

0013_vowel_count:33 Correct Score: 100 • 1023ms • 177 tokens • 51µ$

0013_vowel_count:34 Correct Score: 100 • 717ms • 176 tokens • 36µ$

0013_vowel_count:35 Correct Score: 100 • 819ms • 176 tokens • 41µ$

0013_vowel_count:36 Correct Score: 100 • 890ms • 177 tokens • 45µ$

0013_vowel_count:37 Correct Score: 100 • 845ms • 178 tokens • 42µ$

0013_vowel_count:38 Correct Score: 100 • 923ms • 177 tokens • 46µ$

0013_vowel_count:39 Correct Score: 100 • 816ms • 178 tokens • 41µ$