Run #449 - Multilingual Dictionary Editor

Question: If 100 increases by 25%, what is the new value?

Expected

125.0

Provided

{
  "result": -9.16178
}

Question: If 80 increases by 50%, what is the new value?

Expected

120.0

Provided

{
  "result": -42
}

Question: If 250 decreases by 10%, what is the new value?

Expected

225.0

Provided

{
  "result": -50
}

Question: If 200 increases by 50%, what is the new value?

Expected

300.0

Provided

{
  "result": -1
}

Question: If 100 increases by 20%, what is the new value?

Expected

120.0

Provided

{
  "result": -4
}

Question: If 120 decreases by 5%, what is the new value?

Expected

114.0

Provided

{
  "result": -42
}

Question: If 200 increases by 10%, what is the new value?

Expected

220.0

Provided

{
  "result": -4
}

Question: What is 80% of 40?

Expected

32.0

Provided

{
  "result": 96
}

Question: If 100 increases by 5%, what is the new value?

Expected

105.0

Provided

{
  "result": -9
}

Question: What is 15% of 200?

Expected

30.0

Provided

{
  "result": -9.7
}

Question: If 50 increases by 20%, what is the new value?

Expected

60.0

Provided

{
  "result": -1
}

Question: What is 4/5 of 75?

Expected

60.0

Provided

{
  "result": -296
}

Question: If 120 increases by 25%, what is the new value?

Expected

150.0

Provided

{
  "result": -60
}

Question: What is 1/8 of 136?

Expected

17.0

Provided

{
  "result": 9.5
}

Question: What is 2/5 of 15?

Expected

6.0

Provided

{
  "result": -9
}

Question: What is 3/8 of 72?

Expected

27.0

Provided

{
  "result": 9
}

Question: If 50 decreases by 20%, what is the new value?

Expected

40.0

Provided

{
  "result": -6.5
}

Question: What is 2/3 of 60?

Expected

40.0

Provided

{
  "result": -5
}

Question: If 50 increases by 25%, what is the new value?

Expected

62.5

Provided

{
  "result": -9
}

Question: What is 15% of 120?

Expected

18.0

Provided

{
  "result": -75
}

Question: If 120 increases by 10%, what is the new value?

Expected

132.0

Provided

{
  "result": -67.23
}

Question: If 80 decreases by 25%, what is the new value?

Expected

60.0

Provided

{
  "result": -40
}

Question: What is 2/5 of 65?

Expected

26.0

Provided

{
  "result": 2.0
}

Question: What is 1/4 of 24?

Expected

6.0

Provided

{
  "result": 7
}

Question: What is 1/3 of 12?

Expected

4.0

Provided

{
  "result": -4
}

Question: What is 3/4 of 68?

Expected

51.0

Provided

{
  "result": 23.5
}

Question: What is 1/3 of 33?

Expected

11.0

Provided

{
  "result": 11
}

Question: What is 10% of 150?

Expected

15.0

Provided

{
  "result": 75
}

Question: If 200 decreases by 25%, what is the new value?

Expected

150.0

Provided

{
  "result": -90
}

Question: What is 5% of 400?

Expected

20.0

Provided

{
  "result": 90
}

Question: If 150 increases by 25%, what is the new value?

Expected

187.5

Provided

{
  "result": -4
}

Question: If 200 decreases by 5%, what is the new value?

Expected

190.0

Provided

{
  "result": -20.0
}

Question: What is 2/3 of 9?

Expected

6.0

Provided

{
  "result": 6
}

Question: What is 2/3 of 39?

Expected

26.0

Provided

{
  "result": -4
}

Question: If 80 decreases by 25%, what is the new value?

Expected

60.0

Provided

{
  "result": -16
}

Question: If 150 decreases by 10%, what is the new value?

Expected

135.0

Provided

{
  "result": -5
}

Question: What is 5% of 60?

Expected

3.0

Provided

{
  "result": 9
}

Question: What is 2/3 of 42?

Expected

28.0

Provided

{
  "result": 8.666666666666668
}

Question: If 150 increases by 10%, what is the new value?

Expected

165.0

Provided

{
  "result": -4
}

Question: What is 1/2 of 40?

Expected

20.0

Provided

{
  "result": 5
}

Run Details #449

Model

Phi-3.5 Mini (LMStudio)

Score

5

Correct (≥100)

2/40

Incorrect (<100)

38

Avg Time

396.2ms

Tokens Used

2847

Cost

793µ$

Questions (40)

Run Details #449

Model

Phi-3.5 Mini (LMStudio)

Score

5

Correct (≥100)

2/40

Incorrect (<100)

38

Avg Time

396.2ms

Tokens Used

2847

Cost

793µ$

Questions (40)

0024_percentage_math:0 Incorrect Score: 0 • 518ms • 79 tokens • 26µ$

0024_percentage_math:1 Incorrect Score: 0 • 395ms • 73 tokens • 20µ$

0024_percentage_math:2 Incorrect Score: 0 • 392ms • 75 tokens • 20µ$

0024_percentage_math:3 Incorrect Score: 0 • 370ms • 73 tokens • 19µ$

0024_percentage_math:4 Incorrect Score: 0 • 379ms • 73 tokens • 19µ$

0024_percentage_math:5 Incorrect Score: 0 • 394ms • 74 tokens • 20µ$

0024_percentage_math:6 Incorrect Score: 0 • 367ms • 73 tokens • 18µ$

0024_percentage_math:7 Incorrect Score: 0 • 402ms • 68 tokens • 20µ$

0024_percentage_math:8 Incorrect Score: 0 • 378ms • 72 tokens • 19µ$

0024_percentage_math:9 Incorrect Score: 0 • 393ms • 69 tokens • 20µ$

0024_percentage_math:10 Incorrect Score: 0 • 349ms • 71 tokens • 17µ$

0024_percentage_math:11 Incorrect Score: 0 • 428ms • 69 tokens • 21µ$

0024_percentage_math:12 Incorrect Score: 0 • 392ms • 74 tokens • 20µ$

0024_percentage_math:13 Incorrect Score: 0 • 425ms • 70 tokens • 21µ$

0024_percentage_math:14 Incorrect Score: 0 • 354ms • 66 tokens • 18µ$

0024_percentage_math:15 Incorrect Score: 0 • 354ms • 66 tokens • 18µ$

0024_percentage_math:16 Incorrect Score: 0 • 417ms • 75 tokens • 21µ$

0024_percentage_math:17 Incorrect Score: 0 • 324ms • 66 tokens • 16µ$

0024_percentage_math:18 Incorrect Score: 0 • 375ms • 72 tokens • 19µ$

0024_percentage_math:19 Incorrect Score: 0 • 361ms • 69 tokens • 18µ$

0024_percentage_math:20 Incorrect Score: 0 • 485ms • 78 tokens • 24µ$

0024_percentage_math:21 Incorrect Score: 0 • 369ms • 73 tokens • 18µ$

0024_percentage_math:22 Incorrect Score: 0 • 371ms • 69 tokens • 19µ$

0024_percentage_math:23 Incorrect Score: 0 • 351ms • 67 tokens • 18µ$

0024_percentage_math:24 Incorrect Score: 0 • 347ms • 67 tokens • 17µ$

0024_percentage_math:25 Incorrect Score: 0 • 428ms • 70 tokens • 21µ$

0024_percentage_math:26 Correct Score: 100 • 320ms • 67 tokens • 16µ$

0024_percentage_math:27 Incorrect Score: 0 • 401ms • 69 tokens • 20µ$

0024_percentage_math:28 Incorrect Score: 0 • 392ms • 75 tokens • 20µ$

0024_percentage_math:29 Incorrect Score: 0 • 403ms • 68 tokens • 20µ$

0024_percentage_math:30 Incorrect Score: 0 • 345ms • 72 tokens • 17µ$

0024_percentage_math:31 Incorrect Score: 0 • 476ms • 77 tokens • 24µ$

0024_percentage_math:32 Correct Score: 100 • 340ms • 66 tokens • 17µ$

0024_percentage_math:33 Incorrect Score: 0 • 299ms • 66 tokens • 15µ$

0024_percentage_math:34 Incorrect Score: 0 • 378ms • 73 tokens • 19µ$

0024_percentage_math:35 Incorrect Score: 0 • 371ms • 74 tokens • 19µ$

0024_percentage_math:36 Incorrect Score: 0 • 502ms • 66 tokens • 25µ$

0024_percentage_math:37 Incorrect Score: 0 • 782ms • 83 tokens • 39µ$

0024_percentage_math:38 Incorrect Score: 0 • 366ms • 73 tokens • 18µ$

0024_percentage_math:39 Incorrect Score: 0 • 357ms • 67 tokens • 18µ$