Run Details #446

Model

Phi-3.5 Mini (LMStudio)

Score

10

Correct (≥100)

4/40

Incorrect (<100)

36

Avg Time

354.2ms

Tokens Used

2471

Cost

709µ$

Benchmark: 0021_simple_arithmetic

Run Date: 2026-02-28 17:48:52

Questions (40)

Question: What is 16 ÷ 8?

Expected

2.0

Provided

{
  "result": -1
}

Question: What is 47 - 7?

Expected

40.0

Provided

{
  "result": 50
}

Question: What is 39 - 23?

Expected

16.0

Provided

{
  "result": 7
}

Question: What is 6 × 6?

Expected

36.0

Provided

{
  "result": -72
}

Question: What is 8 × 6?

Expected

48.0

Provided

{
  "result": -1
}

Question: What is 12 × 6?

Expected

72.0

Provided

{
  "result": 15
}

Question: What is 121 ÷ 11?

Expected

11.0

Provided

{
  "result": 11
}

Question: What is 168 ÷ 12?

Expected

14.0

Provided

{
  "result": -7
}

Question: What is 61 + 32?

Expected

93.0

Provided

{
  "result": -70
}

Question: What is 28 ÷ 2?

Expected

14.0

Provided

{
  "result": 0
}

Question: What is 12 ÷ 12?

Expected

1.0

Provided

{
  "result": 0.3
}

Question: What is 3 × 7?

Expected

21.0

Provided

{
  "result": 0.25
}

Question: What is 46 + 13?

Expected

59.0

Provided

{
  "result": 0
}

Question: What is 11 × 11?

Expected

121.0

Provided

{
  "result": -9
}

Question: What is 10 + 50?

Expected

60.0

Provided

{
  "result": 60
}

Question: What is 12 × 4?

Expected

48.0

Provided

{
  "result": -7
}

Question: What is 64 ÷ 4?

Expected

16.0

Provided

{
  "result": 17
}

Question: What is 2 × 8?

Expected

16.0

Provided

{
  "result": 12
}

Question: What is 6 × 2?

Expected

12.0

Provided

{
  "result": -6
}

Question: What is 4 × 4?

Expected

16.0

Provided

{
  "result": -3
}

Question: What is 10 × 6?

Expected

60.0

Provided

{
  "result": -10
}

Question: What is 41 - 38?

Expected

3.0

Provided

{
  "result": -7
}

Question: What is 12 ÷ 12?

Expected

1.0

Provided

{
  "result": -7
}

Question: What is 23 - 8?

Expected

15.0

Provided

{
  "result": 25
}

Question: What is 23 + 18?

Expected

41.0

Provided

{
  "result": 41
}

Question: What is 11 - 11?

Expected

0.0

Provided

{
  "result": 4
}

Question: What is 7 × 7?

Expected

49.0

Provided

{
  "result": 7.0
}

Question: What is 6 ÷ 2?

Expected

3.0

Provided

{
  "result": -9
}

Question: What is 90 + 9?

Expected

99.0

Provided

{
  "result": -87
}

Question: What is 4 × 10?

Expected

40.0

Provided

{
  "result": 7
}

Question: What is 49 + 6?

Expected

55.0

Provided

{
  "result": -2
}

Question: What is 9 ÷ 9?

Expected

1.0

Provided

{
  "result": -1
}

Question: What is 12 × 4?

Expected

48.0

Provided

{
  "result": 96
}

Question: What is 95 ÷ 5?

Expected

19.0

Provided

{
  "result": -1
}

Question: What is 3 × 4?

Expected

12.0

Provided

{
  "result": 9
}

Question: What is 73 + 76?

Expected

149.0

Provided

{
  "result": -89
}

Question: What is 95 ÷ 5?

Expected

19.0

Provided

{
  "result": -2
}

Question: What is 60 ÷ 4?

Expected

15.0

Provided

{
  "result": 27
}

Question: What is 63 - 48?

Expected

15.0

Provided

{
  "result": 15
}

Question: What is 32 ÷ 8?

Expected

4.0

Provided

{
  "result": -5
}

Run Details #446

Model

Phi-3.5 Mini (LMStudio)

Score

10

Correct (≥100)

4/40

Incorrect (<100)

36

Avg Time

354.2ms

Tokens Used

2471

Cost

709µ$

Questions (40)

0021_simple_arithmetic:0 Incorrect Score: 0 • 321ms • 61 tokens • 16µ$

0021_simple_arithmetic:1 Incorrect Score: 0 • 372ms • 62 tokens • 19µ$

0021_simple_arithmetic:2 Incorrect Score: 0 • 359ms • 62 tokens • 18µ$

0021_simple_arithmetic:3 Incorrect Score: 0 • 368ms • 61 tokens • 18µ$

0021_simple_arithmetic:4 Incorrect Score: 0 • 316ms • 59 tokens • 16µ$

0021_simple_arithmetic:5 Incorrect Score: 0 • 364ms • 62 tokens • 18µ$

0021_simple_arithmetic:6 Correct Score: 100 • 381ms • 65 tokens • 19µ$

0021_simple_arithmetic:7 Incorrect Score: 0 • 332ms • 63 tokens • 17µ$

0021_simple_arithmetic:8 Incorrect Score: 0 • 347ms • 62 tokens • 17µ$

0021_simple_arithmetic:9 Incorrect Score: 0 • 355ms • 62 tokens • 18µ$

0021_simple_arithmetic:10 Incorrect Score: 0 • 398ms • 65 tokens • 20µ$

0021_simple_arithmetic:11 Incorrect Score: 0 • 407ms • 63 tokens • 20µ$

0021_simple_arithmetic:12 Incorrect Score: 0 • 359ms • 62 tokens • 18µ$

0021_simple_arithmetic:13 Incorrect Score: 0 • 556ms • 61 tokens • 28µ$

0021_simple_arithmetic:14 Correct Score: 100 • 355ms • 62 tokens • 18µ$

0021_simple_arithmetic:15 Incorrect Score: 0 • 319ms • 61 tokens • 16µ$

0021_simple_arithmetic:16 Incorrect Score: 0 • 376ms • 63 tokens • 19µ$

0021_simple_arithmetic:17 Incorrect Score: 0 • 358ms • 61 tokens • 18µ$

0021_simple_arithmetic:18 Incorrect Score: 0 • 308ms • 59 tokens • 15µ$

0021_simple_arithmetic:19 Incorrect Score: 0 • 329ms • 60 tokens • 16µ$

0021_simple_arithmetic:20 Incorrect Score: 0 • 363ms • 62 tokens • 18µ$

0021_simple_arithmetic:21 Incorrect Score: 0 • 371ms • 63 tokens • 19µ$

0021_simple_arithmetic:22 Incorrect Score: 0 • 261ms • 62 tokens • 13µ$

0021_simple_arithmetic:23 Incorrect Score: 0 • 367ms • 62 tokens • 18µ$

0021_simple_arithmetic:24 Correct Score: 100 • 369ms • 63 tokens • 18µ$

0021_simple_arithmetic:25 Incorrect Score: 0 • 350ms • 62 tokens • 18µ$

0021_simple_arithmetic:26 Incorrect Score: 0 • 393ms • 62 tokens • 20µ$

0021_simple_arithmetic:27 Incorrect Score: 0 • 342ms • 61 tokens • 17µ$

0021_simple_arithmetic:28 Incorrect Score: 0 • 376ms • 62 tokens • 19µ$

0021_simple_arithmetic:29 Incorrect Score: 0 • 325ms • 61 tokens • 16µ$

0021_simple_arithmetic:30 Incorrect Score: 0 • 313ms • 60 tokens • 16µ$

0021_simple_arithmetic:31 Incorrect Score: 0 • 313ms • 60 tokens • 16µ$

0021_simple_arithmetic:32 Incorrect Score: 0 • 354ms • 62 tokens • 18µ$

0021_simple_arithmetic:33 Incorrect Score: 0 • 326ms • 61 tokens • 16µ$

0021_simple_arithmetic:34 Incorrect Score: 0 • 340ms • 60 tokens • 17µ$

0021_simple_arithmetic:35 Incorrect Score: 0 • 348ms • 62 tokens • 17µ$

0021_simple_arithmetic:36 Incorrect Score: 0 • 287ms • 62 tokens • 14µ$

0021_simple_arithmetic:37 Incorrect Score: 0 • 369ms • 63 tokens • 18µ$

0021_simple_arithmetic:38 Correct Score: 100 • 372ms • 63 tokens • 19µ$

0021_simple_arithmetic:39 Incorrect Score: 0 • 350ms • 62 tokens • 18µ$