Run #329 - Multilingual Dictionary Editor

Question: If 100 increases by 25%, what is the new value?

Expected

125.0

Provided

{
  "result": 125
}

Question: If 80 increases by 50%, what is the new value?

Expected

120.0

Provided

{
  "result": 120
}

Question: If 250 decreases by 10%, what is the new value?

Expected

225.0

Provided

{
  "result": 225
}

Question: If 200 increases by 50%, what is the new value?

Expected

300.0

Provided

{
  "result": 300
}

Question: If 100 increases by 20%, what is the new value?

Expected

120.0

Provided

{
  "result": 120
}

Question: If 120 decreases by 5%, what is the new value?

Expected

114.0

Provided

{
  "result": 114
}

Question: If 200 increases by 10%, what is the new value?

Expected

220.0

Provided

{
  "result": 220
}

Question: What is 80% of 40?

Expected

32.0

Provided

{
  "result": 32
}

Question: If 100 increases by 5%, what is the new value?

Expected

105.0

Provided

{
  "result": 105
}

Question: What is 15% of 200?

Expected

30.0

Provided

{
  "result": 40
}

Question: If 50 increases by 20%, what is the new value?

Expected

60.0

Provided

{
  "result": 60
}

Question: What is 4/5 of 75?

Expected

60.0

Provided

{
  "result": 60
}

Question: If 120 increases by 25%, what is the new value?

Expected

150.0

Provided

{
  "result": 150
}

Question: What is 1/8 of 136?

Expected

17.0

Provided

{
  "result": 17
}

Question: What is 2/5 of 15?

Expected

6.0

Provided

{
  "result": 6.0
}

Question: What is 3/8 of 72?

Expected

27.0

Provided

{
  "result": 27
}

Question: If 50 decreases by 20%, what is the new value?

Expected

40.0

Provided

{
  "result": 30
}

Question: What is 2/3 of 60?

Expected

40.0

Provided

{
  "result": 40
}

Question: If 50 increases by 25%, what is the new value?

Expected

62.5

Provided

{
  "result": 62.5
}

Question: What is 15% of 120?

Expected

18.0

Provided

{
  "result": 18
}

Question: If 120 increases by 10%, what is the new value?

Expected

132.0

Provided

{
  "result": 132
}

Question: If 80 decreases by 25%, what is the new value?

Expected

60.0

Provided

{
  "result": 60
}

Question: What is 2/5 of 65?

Expected

26.0

Provided

{
  "result": 26
}

Question: What is 1/4 of 24?

Expected

6.0

Provided

{
  "result": 6.0
}

Question: What is 1/3 of 12?

Expected

4.0

Provided

{
  "result": 4
}

Question: What is 3/4 of 68?

Expected

51.0

Provided

{
  "result": 51.0
}

Question: What is 1/3 of 33?

Expected

11.0

Provided

{
  "result": 11
}

Question: What is 10% of 150?

Expected

15.0

Provided

{
  "result": 15
}

Question: If 200 decreases by 25%, what is the new value?

Expected

150.0

Provided

{
  "result": 150
}

Question: What is 5% of 400?

Expected

20.0

Provided

{
  "result": 20
}

Question: If 150 increases by 25%, what is the new value?

Expected

187.5

Provided

{
  "result": 187.5
}

Question: If 200 decreases by 5%, what is the new value?

Expected

190.0

Provided

{
  "result": 195
}

Question: What is 2/3 of 9?

Expected

6.0

Provided

{
  "result": 6
}

Question: What is 2/3 of 39?

Expected

26.0

Provided

{
  "result": 26
}

Question: If 80 decreases by 25%, what is the new value?

Expected

60.0

Provided

{
  "result": 60
}

Question: If 150 decreases by 10%, what is the new value?

Expected

135.0

Provided

{
  "result": 135
}

Question: What is 5% of 60?

Expected

3.0

Provided

{
  "result": 30
}

Question: What is 2/3 of 42?

Expected

28.0

Provided

{
  "result": 28
}

Question: If 150 increases by 10%, what is the new value?

Expected

165.0

Provided

{
  "result": 165
}

Question: What is 1/2 of 40?

Expected

20.0

Provided

{
  "result": 20
}

Run Details #329

Model

Llama 3 8B (LMStudio)

Score

90

Correct (≥100)

36/40

Incorrect (<100)

4

Avg Time

551.6ms

Tokens Used

3012

Cost

$0.0011

Questions (40)

Run Details #329

Model

Llama 3 8B (LMStudio)

Score

90

Correct (≥100)

36/40

Incorrect (<100)

4

Avg Time

551.6ms

Tokens Used

3012

Cost

$0.0011

Questions (40)

0024_percentage_math:0 Correct Score: 100 • 561ms • 78 tokens • 28µ$

0024_percentage_math:1 Correct Score: 100 • 577ms • 78 tokens • 29µ$

0024_percentage_math:2 Correct Score: 100 • 485ms • 76 tokens • 24µ$

0024_percentage_math:3 Correct Score: 100 • 573ms • 78 tokens • 29µ$

0024_percentage_math:4 Correct Score: 100 • 572ms • 78 tokens • 29µ$

0024_percentage_math:5 Correct Score: 100 • 573ms • 78 tokens • 29µ$

0024_percentage_math:6 Correct Score: 100 • 483ms • 76 tokens • 24µ$

0024_percentage_math:7 Correct Score: 100 • 570ms • 73 tokens • 29µ$

0024_percentage_math:8 Correct Score: 100 • 470ms • 76 tokens • 24µ$

0024_percentage_math:9 Incorrect Score: 0 • 418ms • 70 tokens • 21µ$

0024_percentage_math:10 Correct Score: 100 • 463ms • 76 tokens • 23µ$

0024_percentage_math:11 Correct Score: 100 • 576ms • 74 tokens • 29µ$

0024_percentage_math:12 Correct Score: 100 • 569ms • 78 tokens • 28µ$

0024_percentage_math:13 Correct Score: 100 • 574ms • 74 tokens • 29µ$

0024_percentage_math:14 Correct Score: 100 • 646ms • 76 tokens • 32µ$

0024_percentage_math:15 Correct Score: 100 • 575ms • 74 tokens • 29µ$

0024_percentage_math:16 Incorrect Score: 0 • 427ms • 75 tokens • 21µ$

0024_percentage_math:17 Correct Score: 100 • 575ms • 74 tokens • 29µ$

0024_percentage_math:18 Correct Score: 100 • 673ms • 80 tokens • 34µ$

0024_percentage_math:19 Correct Score: 100 • 559ms • 73 tokens • 28µ$

0024_percentage_math:20 Correct Score: 100 • 571ms • 78 tokens • 29µ$

0024_percentage_math:21 Correct Score: 100 • 471ms • 76 tokens • 24µ$

0024_percentage_math:22 Correct Score: 100 • 570ms • 74 tokens • 29µ$

0024_percentage_math:23 Correct Score: 100 • 679ms • 76 tokens • 34µ$

0024_percentage_math:24 Correct Score: 100 • 577ms • 74 tokens • 29µ$

0024_percentage_math:25 Correct Score: 100 • 671ms • 76 tokens • 34µ$

0024_percentage_math:26 Correct Score: 100 • 422ms • 71 tokens • 21µ$

0024_percentage_math:27 Correct Score: 100 • 467ms • 71 tokens • 23µ$

0024_percentage_math:28 Correct Score: 100 • 590ms • 78 tokens • 30µ$

0024_percentage_math:29 Correct Score: 100 • 512ms • 72 tokens • 26µ$

0024_percentage_math:30 Correct Score: 100 • 673ms • 80 tokens • 34µ$

0024_percentage_math:31 Incorrect Score: 0 • 420ms • 75 tokens • 21µ$

0024_percentage_math:32 Correct Score: 100 • 575ms • 74 tokens • 29µ$

0024_percentage_math:33 Correct Score: 100 • 653ms • 74 tokens • 33µ$

0024_percentage_math:34 Correct Score: 100 • 569ms • 78 tokens • 28µ$

0024_percentage_math:35 Correct Score: 100 • 468ms • 76 tokens • 23µ$

0024_percentage_math:36 Incorrect Score: 0 • 632ms • 70 tokens • 32µ$

0024_percentage_math:37 Correct Score: 100 • 473ms • 72 tokens • 24µ$

0024_percentage_math:38 Correct Score: 100 • 573ms • 78 tokens • 29µ$

0024_percentage_math:39 Correct Score: 100 • 578ms • 74 tokens • 29µ$