Run #545 - Multilingual Dictionary Editor

Question: If 100 increases by 25%, what is the new value?

Expected

125.0

Provided

{
  "result": 125
}

Question: If 80 increases by 50%, what is the new value?

Expected

120.0

Provided

{
  "result": 120
}

Question: If 250 decreases by 10%, what is the new value?

Expected

225.0

Provided

{
  "result": 234
}

Question: If 200 increases by 50%, what is the new value?

Expected

300.0

Provided

{
  "result": 300
}

Question: If 100 increases by 20%, what is the new value?

Expected

120.0

Provided

{
  "result": 120
}

Question: If 120 decreases by 5%, what is the new value?

Expected

114.0

Provided

{
  "result": -6.0
}

Question: If 200 increases by 10%, what is the new value?

Expected

220.0

Provided

{
  "result": 210
}

Question: What is 80% of 40?

Expected

32.0

Provided

{
  "result": 32
}

Question: If 100 increases by 5%, what is the new value?

Expected

105.0

Provided

{
  "result": 105
}

Question: What is 15% of 200?

Expected

30.0

Provided

{
  "result": 30
}

Question: If 50 increases by 20%, what is the new value?

Expected

60.0

Provided

{
  "result": 70
}

Question: What is 4/5 of 75?

Expected

60.0

Provided

{
  "result": 56
}

Question: If 120 increases by 25%, what is the new value?

Expected

150.0

Provided

{
  "result": 144
}

Question: What is 1/8 of 136?

Expected

17.0

Provided

{
  "result": 17.0
}

Question: What is 2/5 of 15?

Expected

6.0

Provided

{
  "result": 6
}

Question: What is 3/8 of 72?

Expected

27.0

Provided

{
  "result": 27.000000000000004
}

Question: If 50 decreases by 20%, what is the new value?

Expected

40.0

Provided

{
  "result": 40
}

Question: What is 2/3 of 60?

Expected

40.0

Provided

{
  "result": 40
}

Question: If 50 increases by 25%, what is the new value?

Expected

62.5

Provided

{
  "result": 62.5
}

Question: What is 15% of 120?

Expected

18.0

Provided

{
  "result": 18.0
}

Question: If 120 increases by 10%, what is the new value?

Expected

132.0

Provided

{
  "result": 132
}

Question: If 80 decreases by 25%, what is the new value?

Expected

60.0

Provided

{
  "result": 64
}

Question: What is 2/5 of 65?

Expected

26.0

Provided

{
  "result": 28.0
}

Question: What is 1/4 of 24?

Expected

6.0

Provided

{
  "result": 6
}

Question: What is 1/3 of 12?

Expected

4.0

Provided

{
  "result": 4
}

Question: What is 3/4 of 68?

Expected

51.0

Provided

{
  "result": 27.5
}

Question: What is 1/3 of 33?

Expected

11.0

Provided

{
  "result": 11
}

Question: What is 10% of 150?

Expected

15.0

Provided

{
  "result": 15.0
}

Question: If 200 decreases by 25%, what is the new value?

Expected

150.0

Provided

{
  "result": 175
}

Question: What is 5% of 400?

Expected

20.0

Provided

{
  "result": 20.0
}

Question: If 150 increases by 25%, what is the new value?

Expected

187.5

Provided

{
  "result": 175
}

Question: If 200 decreases by 5%, what is the new value?

Expected

190.0

Provided

{
  "result": 190
}

Question: What is 2/3 of 9?

Expected

6.0

Provided

{
  "result": 6
}

Question: What is 2/3 of 39?

Expected

26.0

Provided

{
  "result": 28
}

Question: If 80 decreases by 25%, what is the new value?

Expected

60.0

Provided

{
  "result": -140
}

Question: If 150 decreases by 10%, what is the new value?

Expected

135.0

Provided

{
  "result": 135
}

Question: What is 5% of 60?

Expected

3.0

Provided

{
  "result": 3.0
}

Question: What is 2/3 of 42?

Expected

28.0

Provided

{
  "result": 28
}

Question: If 150 increases by 10%, what is the new value?

Expected

165.0

Provided

{
  "result": 165.0
}

Question: What is 1/2 of 40?

Expected

20.0

Provided

{
  "result": 20
}

Run Details #545

Model

SmolLM2 1.7B (LMStudio)

Score

67

Correct (≥100)

27/40

Incorrect (<100)

13

Avg Time

216.6ms

Tokens Used

3149

Cost

434µ$

Questions (40)

Run Details #545

Model

SmolLM2 1.7B (LMStudio)

Score

67

Correct (≥100)

27/40

Incorrect (<100)

13

Avg Time

216.6ms

Tokens Used

3149

Cost

434µ$

Questions (40)

0024_percentage_math:0 Correct Score: 100 • 173ms • 79 tokens • 9µ$

0024_percentage_math:1 Correct Score: 100 • 225ms • 81 tokens • 11µ$

0024_percentage_math:2 Incorrect Score: 0 • 171ms • 79 tokens • 9µ$

0024_percentage_math:3 Correct Score: 100 • 209ms • 82 tokens • 10µ$

0024_percentage_math:4 Correct Score: 100 • 208ms • 82 tokens • 10µ$

0024_percentage_math:5 Incorrect Score: 0 • 226ms • 81 tokens • 11µ$

0024_percentage_math:6 Incorrect Score: 0 • 203ms • 82 tokens • 10µ$

0024_percentage_math:7 Correct Score: 100 • 198ms • 75 tokens • 10µ$

0024_percentage_math:8 Correct Score: 100 • 209ms • 81 tokens • 10µ$

0024_percentage_math:9 Correct Score: 100 • 212ms • 76 tokens • 11µ$

0024_percentage_math:10 Incorrect Score: 0 • 195ms • 80 tokens • 10µ$

0024_percentage_math:11 Incorrect Score: 0 • 199ms • 75 tokens • 10µ$

0024_percentage_math:12 Incorrect Score: 0 • 206ms • 82 tokens • 10µ$

0024_percentage_math:13 Correct Score: 100 • 235ms • 78 tokens • 12µ$

0024_percentage_math:14 Correct Score: 100 • 145ms • 71 tokens • 7µ$

0024_percentage_math:15 Correct Score: 100 • 418ms • 91 tokens • 21µ$

0024_percentage_math:16 Correct Score: 100 • 202ms • 80 tokens • 10µ$

0024_percentage_math:17 Correct Score: 100 • 197ms • 75 tokens • 10µ$

0024_percentage_math:18 Correct Score: 100 • 235ms • 82 tokens • 12µ$

0024_percentage_math:19 Correct Score: 100 • 234ms • 78 tokens • 12µ$

0024_percentage_math:20 Correct Score: 100 • 213ms • 82 tokens • 11µ$

0024_percentage_math:21 Incorrect Score: 0 • 211ms • 80 tokens • 11µ$

0024_percentage_math:22 Incorrect Score: 0 • 230ms • 77 tokens • 12µ$

0024_percentage_math:23 Correct Score: 100 • 196ms • 74 tokens • 10µ$

0024_percentage_math:24 Correct Score: 100 • 183ms • 74 tokens • 9µ$

0024_percentage_math:25 Incorrect Score: 0 • 233ms • 77 tokens • 12µ$

0024_percentage_math:26 Correct Score: 100 • 197ms • 75 tokens • 10µ$

0024_percentage_math:27 Correct Score: 100 • 234ms • 78 tokens • 12µ$

0024_percentage_math:28 Incorrect Score: 0 • 214ms • 82 tokens • 11µ$

0024_percentage_math:29 Correct Score: 100 • 234ms • 77 tokens • 12µ$

0024_percentage_math:30 Incorrect Score: 0 • 218ms • 82 tokens • 11µ$

0024_percentage_math:31 Correct Score: 100 • 217ms • 81 tokens • 11µ$

0024_percentage_math:32 Correct Score: 100 • 198ms • 73 tokens • 10µ$

0024_percentage_math:33 Incorrect Score: 0 • 194ms • 75 tokens • 10µ$

0024_percentage_math:34 Incorrect Score: 0 • 221ms • 81 tokens • 11µ$

0024_percentage_math:35 Correct Score: 100 • 217ms • 82 tokens • 11µ$

0024_percentage_math:36 Correct Score: 100 • 298ms • 75 tokens • 15µ$

0024_percentage_math:37 Correct Score: 100 • 200ms • 75 tokens • 10µ$

0024_percentage_math:38 Correct Score: 100 • 250ms • 84 tokens • 13µ$

0024_percentage_math:39 Correct Score: 100 • 206ms • 75 tokens • 10µ$