Run Details #350

Model

Llama 3.1 8B (LMStudio)

Score

90

Correct (≥100)

36/40

Incorrect (<100)

4

Avg Time

603.8ms

Tokens Used

3526

Cost

$0.0012

Benchmark: 0021_simple_arithmetic

Run Date: 2026-02-28 17:00:54

Questions (40)

Question: What is 16 ÷ 8?

Expected

2.0

Provided

{
  "result": 2
}

Question: What is 47 - 7?

Expected

40.0

Provided

{
  "result": 40
}

Question: What is 39 - 23?

Expected

16.0

Provided

{
  "result": -4
}

Question: What is 6 × 6?

Expected

36.0

Provided

{
  "result": 36
}

Question: What is 8 × 6?

Expected

48.0

Provided

{
  "result": 48
}

Question: What is 12 × 6?

Expected

72.0

Provided

{
  "result": 72
}

Question: What is 121 ÷ 11?

Expected

11.0

Provided

{
  "result": 11
}

Question: What is 168 ÷ 12?

Expected

14.0

Provided

{
  "result": 14
}

Question: What is 61 + 32?

Expected

93.0

Provided

{
  "result": 93
}

Question: What is 28 ÷ 2?

Expected

14.0

Provided

{
  "result": 14
}

Question: What is 12 ÷ 12?

Expected

1.0

Provided

{
  "result": 1
}

Question: What is 3 × 7?

Expected

21.0

Provided

{
  "result": 21
}

Question: What is 46 + 13?

Expected

59.0

Provided

{
  "result": 59
}

Question: What is 11 × 11?

Expected

121.0

Provided

{
  "result": 121
}

Question: What is 10 + 50?

Expected

60.0

Provided

{
  "result": 60
}

Question: What is 12 × 4?

Expected

48.0

Provided

{
  "result": 48
}

Question: What is 64 ÷ 4?

Expected

16.0

Provided

{
  "result": 16
}

Question: What is 2 × 8?

Expected

16.0

Provided

{
  "result": 16
}

Question: What is 6 × 2?

Expected

12.0

Provided

{
  "result": 12
}

Question: What is 4 × 4?

Expected

16.0

Provided

{
  "result": 16
}

Question: What is 10 × 6?

Expected

60.0

Provided

{
  "result": 60
}

Question: What is 41 - 38?

Expected

3.0

Provided

{
  "result": -3
}

Question: What is 12 ÷ 12?

Expected

1.0

Provided

{
  "result": 1
}

Question: What is 23 - 8?

Expected

15.0

Provided

{
  "result": -5
}

Question: What is 23 + 18?

Expected

41.0

Provided

{
  "result": 41
}

Question: What is 11 - 11?

Expected

0.0

Provided

{
  "result": 0
}

Question: What is 7 × 7?

Expected

49.0

Provided

{
  "result": 49
}

Question: What is 6 ÷ 2?

Expected

3.0

Provided

{
  "result": 3
}

Question: What is 90 + 9?

Expected

99.0

Provided

{
  "result": 99
}

Question: What is 4 × 10?

Expected

40.0

Provided

{
  "result": 40
}

Question: What is 49 + 6?

Expected

55.0

Provided

{
  "result": 55
}

Question: What is 9 ÷ 9?

Expected

1.0

Provided

{
  "result": 1
}

Question: What is 12 × 4?

Expected

48.0

Provided

{
  "result": 48
}

Question: What is 95 ÷ 5?

Expected

19.0

Provided

{
  "result": 19
}

Question: What is 3 × 4?

Expected

12.0

Provided

{
  "result": 6
}

Question: What is 73 + 76?

Expected

149.0

Provided

{
  "result": 149
}

Question: What is 95 ÷ 5?

Expected

19.0

Provided

{
  "result": 19
}

Question: What is 60 ÷ 4?

Expected

15.0

Provided

{
  "result": 15
}

Question: What is 63 - 48?

Expected

15.0

Provided

{
  "result": 15
}

Question: What is 32 ÷ 8?

Expected

4.0

Provided

{
  "result": 4
}

Run Details #350

Model

Llama 3.1 8B (LMStudio)

Score

90

Correct (≥100)

36/40

Incorrect (<100)

4

Avg Time

603.8ms

Tokens Used

3526

Cost

$0.0012

Questions (40)

0021_simple_arithmetic:0 Correct Score: 100 • 617ms • 89 tokens • 31µ$

0021_simple_arithmetic:1 Correct Score: 100 • 603ms • 88 tokens • 30µ$

0021_simple_arithmetic:2 Incorrect Score: 0 • 606ms • 88 tokens • 30µ$

0021_simple_arithmetic:3 Correct Score: 100 • 601ms • 88 tokens • 30µ$

0021_simple_arithmetic:4 Correct Score: 100 • 606ms • 88 tokens • 30µ$

0021_simple_arithmetic:5 Correct Score: 100 • 608ms • 88 tokens • 30µ$

0021_simple_arithmetic:6 Correct Score: 100 • 608ms • 89 tokens • 30µ$

0021_simple_arithmetic:7 Correct Score: 100 • 608ms • 89 tokens • 30µ$

0021_simple_arithmetic:8 Correct Score: 100 • 602ms • 88 tokens • 30µ$

0021_simple_arithmetic:9 Correct Score: 100 • 604ms • 89 tokens • 30µ$

0021_simple_arithmetic:10 Correct Score: 100 • 615ms • 89 tokens • 31µ$

0021_simple_arithmetic:11 Correct Score: 100 • 604ms • 88 tokens • 30µ$

0021_simple_arithmetic:12 Correct Score: 100 • 602ms • 88 tokens • 30µ$

0021_simple_arithmetic:13 Correct Score: 100 • 824ms • 88 tokens • 41µ$

0021_simple_arithmetic:14 Correct Score: 100 • 599ms • 88 tokens • 30µ$

0021_simple_arithmetic:15 Correct Score: 100 • 605ms • 88 tokens • 30µ$

0021_simple_arithmetic:16 Correct Score: 100 • 600ms • 89 tokens • 30µ$

0021_simple_arithmetic:17 Correct Score: 100 • 617ms • 88 tokens • 31µ$

0021_simple_arithmetic:18 Correct Score: 100 • 604ms • 88 tokens • 30µ$

0021_simple_arithmetic:19 Correct Score: 100 • 600ms • 88 tokens • 30µ$

0021_simple_arithmetic:20 Correct Score: 100 • 607ms • 88 tokens • 30µ$

0021_simple_arithmetic:21 Incorrect Score: 0 • 599ms • 88 tokens • 30µ$

0021_simple_arithmetic:22 Correct Score: 100 • 613ms • 89 tokens • 31µ$

0021_simple_arithmetic:23 Incorrect Score: 0 • 608ms • 88 tokens • 30µ$

0021_simple_arithmetic:24 Correct Score: 100 • 608ms • 88 tokens • 30µ$

0021_simple_arithmetic:25 Correct Score: 100 • 465ms • 85 tokens • 23µ$

0021_simple_arithmetic:26 Correct Score: 100 • 607ms • 88 tokens • 30µ$

0021_simple_arithmetic:27 Correct Score: 100 • 608ms • 89 tokens • 30µ$

0021_simple_arithmetic:28 Correct Score: 100 • 610ms • 88 tokens • 31µ$

0021_simple_arithmetic:29 Correct Score: 100 • 608ms • 88 tokens • 30µ$

0021_simple_arithmetic:30 Correct Score: 100 • 605ms • 88 tokens • 30µ$

0021_simple_arithmetic:31 Correct Score: 100 • 609ms • 89 tokens • 30µ$

0021_simple_arithmetic:32 Correct Score: 100 • 612ms • 88 tokens • 31µ$

0021_simple_arithmetic:33 Correct Score: 100 • 621ms • 89 tokens • 31µ$

0021_simple_arithmetic:34 Incorrect Score: 0 • 414ms • 84 tokens • 21µ$

0021_simple_arithmetic:35 Correct Score: 100 • 605ms • 88 tokens • 30µ$

0021_simple_arithmetic:36 Correct Score: 100 • 609ms • 89 tokens • 30µ$

0021_simple_arithmetic:37 Correct Score: 100 • 608ms • 89 tokens • 30µ$

0021_simple_arithmetic:38 Correct Score: 100 • 608ms • 88 tokens • 30µ$

0021_simple_arithmetic:39 Correct Score: 100 • 596ms • 89 tokens • 30µ$