Run Details #269

Model

Gemma 3 12B (LMStudio)

Score

100

Correct (≥100)

40/40

Incorrect (<100)

0

Avg Time

1564.2ms

Tokens Used

2534

Cost

$0.0031

Benchmark: 0021_simple_arithmetic

Run Date: 2026-02-28 15:50:59

Questions (40)

Question: What is 16 ÷ 8?

Expected

2.0

Provided

{
  "result": 2
}

Question: What is 47 - 7?

Expected

40.0

Provided

{
  "result": 40
}

Question: What is 39 - 23?

Expected

16.0

Provided

{
  "result": 16
}

Question: What is 6 × 6?

Expected

36.0

Provided

{
  "result": 36
}

Question: What is 8 × 6?

Expected

48.0

Provided

{
  "result": 48
}

Question: What is 12 × 6?

Expected

72.0

Provided

{
  "result": 72
}

Question: What is 121 ÷ 11?

Expected

11.0

Provided

{
  "result": 11
}

Question: What is 168 ÷ 12?

Expected

14.0

Provided

{
  "result": 14
}

Question: What is 61 + 32?

Expected

93.0

Provided

{
  "result": 93
}

Question: What is 28 ÷ 2?

Expected

14.0

Provided

{
  "result": 14
}

Question: What is 12 ÷ 12?

Expected

1.0

Provided

{
  "result": 1
}

Question: What is 3 × 7?

Expected

21.0

Provided

{
  "result": 21
}

Question: What is 46 + 13?

Expected

59.0

Provided

{
  "result": 59
}

Question: What is 11 × 11?

Expected

121.0

Provided

{
  "result": 121
}

Question: What is 10 + 50?

Expected

60.0

Provided

{
  "result": 60
}

Question: What is 12 × 4?

Expected

48.0

Provided

{
  "result": 48
}

Question: What is 64 ÷ 4?

Expected

16.0

Provided

{
  "result": 16
}

Question: What is 2 × 8?

Expected

16.0

Provided

{
  "result": 16
}

Question: What is 6 × 2?

Expected

12.0

Provided

{
  "result": 12
}

Question: What is 4 × 4?

Expected

16.0

Provided

{
  "result": 16
}

Question: What is 10 × 6?

Expected

60.0

Provided

{
  "result": 60
}

Question: What is 41 - 38?

Expected

3.0

Provided

{
  "result": 3
}

Question: What is 12 ÷ 12?

Expected

1.0

Provided

{
  "result": 1
}

Question: What is 23 - 8?

Expected

15.0

Provided

{
  "result": 15
}

Question: What is 23 + 18?

Expected

41.0

Provided

{
  "result": 41
}

Question: What is 11 - 11?

Expected

0.0

Provided

{
  "result": 0
}

Question: What is 7 × 7?

Expected

49.0

Provided

{
  "result": 49
}

Question: What is 6 ÷ 2?

Expected

3.0

Provided

{
  "result": 3
}

Question: What is 90 + 9?

Expected

99.0

Provided

{
  "result": 99
}

Question: What is 4 × 10?

Expected

40.0

Provided

{
  "result": 40
}

Question: What is 49 + 6?

Expected

55.0

Provided

{
  "result": 55
}

Question: What is 9 ÷ 9?

Expected

1.0

Provided

{
  "result": 1
}

Question: What is 12 × 4?

Expected

48.0

Provided

{
  "result": 48
}

Question: What is 95 ÷ 5?

Expected

19.0

Provided

{
  "result": 19
}

Question: What is 3 × 4?

Expected

12.0

Provided

{
  "result": 12
}

Question: What is 73 + 76?

Expected

149.0

Provided

{
  "result": 149
}

Question: What is 95 ÷ 5?

Expected

19.0

Provided

{
  "result": 19
}

Question: What is 60 ÷ 4?

Expected

15.0

Provided

{
  "result": 15
}

Question: What is 63 - 48?

Expected

15.0

Provided

{
  "result": 15
}

Question: What is 32 ÷ 8?

Expected

4.0

Provided

{
  "result": 4
}

Run Details #269

Model

Gemma 3 12B (LMStudio)

Score

100

Correct (≥100)

40/40

Incorrect (<100)

0

Avg Time

1564.2ms

Tokens Used

2534

Cost

$0.0031

Questions (40)

0021_simple_arithmetic:0 Correct Score: 100 • 1492ms • 63 tokens • 75µ$

0021_simple_arithmetic:1 Correct Score: 100 • 1489ms • 63 tokens • 74µ$

0021_simple_arithmetic:2 Correct Score: 100 • 1457ms • 64 tokens • 73µ$

0021_simple_arithmetic:3 Correct Score: 100 • 1453ms • 62 tokens • 73µ$

0021_simple_arithmetic:4 Correct Score: 100 • 1487ms • 63 tokens • 74µ$

0021_simple_arithmetic:5 Correct Score: 100 • 1413ms • 63 tokens • 71µ$

0021_simple_arithmetic:6 Correct Score: 100 • 1449ms • 65 tokens • 72µ$

0021_simple_arithmetic:7 Correct Score: 100 • 1496ms • 65 tokens • 75µ$

0021_simple_arithmetic:8 Correct Score: 100 • 1538ms • 65 tokens • 77µ$

0021_simple_arithmetic:9 Correct Score: 100 • 1489ms • 63 tokens • 74µ$

0021_simple_arithmetic:10 Correct Score: 100 • 1501ms • 64 tokens • 75µ$

0021_simple_arithmetic:11 Correct Score: 100 • 1529ms • 62 tokens • 76µ$

0021_simple_arithmetic:12 Correct Score: 100 • 1540ms • 65 tokens • 77µ$

0021_simple_arithmetic:13 Correct Score: 100 • 4173ms • 66 tokens • 209µ$

0021_simple_arithmetic:14 Correct Score: 100 • 1585ms • 65 tokens • 79µ$

0021_simple_arithmetic:15 Correct Score: 100 • 1499ms • 63 tokens • 75µ$

0021_simple_arithmetic:16 Correct Score: 100 • 1496ms • 63 tokens • 75µ$

0021_simple_arithmetic:17 Correct Score: 100 • 1527ms • 62 tokens • 76µ$

0021_simple_arithmetic:18 Correct Score: 100 • 1469ms • 62 tokens • 73µ$

0021_simple_arithmetic:19 Correct Score: 100 • 1485ms • 62 tokens • 74µ$

0021_simple_arithmetic:20 Correct Score: 100 • 1564ms • 64 tokens • 78µ$

0021_simple_arithmetic:21 Correct Score: 100 • 1422ms • 63 tokens • 71µ$

0021_simple_arithmetic:22 Correct Score: 100 • 1469ms • 64 tokens • 73µ$

0021_simple_arithmetic:23 Correct Score: 100 • 1470ms • 63 tokens • 74µ$

0021_simple_arithmetic:24 Correct Score: 100 • 1527ms • 64 tokens • 76µ$

0021_simple_arithmetic:25 Correct Score: 100 • 1428ms • 63 tokens • 71µ$

0021_simple_arithmetic:26 Correct Score: 100 • 1575ms • 63 tokens • 79µ$

0021_simple_arithmetic:27 Correct Score: 100 • 1451ms • 61 tokens • 73µ$

0021_simple_arithmetic:28 Correct Score: 100 • 1491ms • 63 tokens • 75µ$

0021_simple_arithmetic:29 Correct Score: 100 • 1484ms • 63 tokens • 74µ$

0021_simple_arithmetic:30 Correct Score: 100 • 1501ms • 63 tokens • 75µ$

0021_simple_arithmetic:31 Correct Score: 100 • 1484ms • 62 tokens • 74µ$

0021_simple_arithmetic:32 Correct Score: 100 • 1571ms • 64 tokens • 79µ$

0021_simple_arithmetic:33 Correct Score: 100 • 1489ms • 63 tokens • 74µ$

0021_simple_arithmetic:34 Correct Score: 100 • 1565ms • 63 tokens • 78µ$

0021_simple_arithmetic:35 Correct Score: 100 • 1646ms • 66 tokens • 82µ$

0021_simple_arithmetic:36 Correct Score: 100 • 1489ms • 63 tokens • 74µ$

0021_simple_arithmetic:37 Correct Score: 100 • 1485ms • 63 tokens • 74µ$

0021_simple_arithmetic:38 Correct Score: 100 • 1471ms • 64 tokens • 74µ$

0021_simple_arithmetic:39 Correct Score: 100 • 1417ms • 62 tokens • 71µ$