Run Details #1129
Model
GPT-5.6 Luna
Score
100
Correct (≥100)
18/18
Incorrect (<100)
0
Median Time
1165.5ms
Tokens Used
2751
Cost
$0.0057
Benchmark:
0153_book_author_match
Run Date: 2026-07-27 17:36:16
Questions (18)
Question: Who wrote 'The Great Gatsby'?
Expected
F. Scott Fitzgerald
Provided
{
"reasoning": "The Great Gatsby is a novel by F. Scott Fitzgerald, published in 1925.",
"answer": "F. Scott Fitzgerald"
}
Question: Who wrote 'To Kill a Mockingbird'?
Expected
Harper Lee
Provided
{
"reasoning": "Harper Lee wrote the novel To Kill a Mockingbird.",
"answer": "Harper Lee"
}
Question: Who wrote 'The Name of the Rose'?
Expected
Umberto Eco
Provided
{
"reasoning": "The Name of the Rose is the famous historical mystery novel by Italian author Umberto Eco.",
"answer": "Umberto Eco"
}
Question: Who wrote 'Crime and Punishment'?
Expected
Fyodor Dostoevsky
Provided
{
"reasoning": "Crime and Punishment is a psychological novel by Russian author Fyodor Dostoevsky.",
"answer": "Fyodor Dostoevsky"
}
Question: Who wrote 'One Hundred Years of Solitude'?
Expected
Gabriel García Márquez
Provided
{
"reasoning": "The novel is a landmark work of magical realism by Colombian author Gabriel García Márquez.",
"answer": "Gabriel García Márquez"
}
Question: Who wrote 'The Trial'?
Expected
Franz Kafka
Provided
{
"reasoning": "The Trial is a novel by Franz Kafka, published posthumously.",
"answer": "Franz Kafka"
}
Question: Who wrote 'The Stranger'?
Expected
Albert Camus
Provided
{
"reasoning": "The Stranger is the existentialist novel by Albert Camus.",
"answer": "Albert Camus"
}
Question: Who wrote '1984'?
Expected
George Orwell
Provided
{
"reasoning": "The dystopian novel '1984' was written by George Orwell.",
"answer": "George Orwell"
}
Question: Who wrote 'Invisible Man'?
Expected
Ralph Ellison
Provided
{
"reasoning": "The novel 'Invisible Man' was written by Ralph Ellison.",
"answer": "Ralph Ellison"
}
Question: Who wrote 'Frankenstein'?
Expected
Mary Shelley
Provided
{
"reasoning": "Frankenstein was written by Mary Shelley.",
"answer": "Mary Shelley"
}
Question: Who wrote 'Pride and Prejudice'?
Expected
Jane Austen
Provided
{
"reasoning": "Pride and Prejudice was written by Jane Austen.",
"answer": "Jane Austen"
}
Question: Who wrote 'Moby-Dick'?
Expected
Herman Melville
Provided
{
"reasoning": "Moby-Dick was written by Herman Melville.",
"answer": "Herman Melville"
}
Question: Who wrote 'The Brothers Karamazov'?
Expected
Fyodor Dostoevsky
Provided
{
"reasoning": "The novel is a philosophical and psychological work by the Russian author Fyodor Dostoevsky.",
"answer": "Fyodor Dostoevsky"
}
Question: Who wrote 'Ulysses'?
Expected
James Joyce
Provided
{
"reasoning": "Ulysses is the modernist novel written by James Joyce.",
"answer": "James Joyce"
}
Question: Who wrote 'Beloved'?
Expected
Toni Morrison
Provided
{
"reasoning": "‘Beloved’ was written by Toni Morrison.",
"answer": "Toni Morrison"
}
Question: Who wrote 'Brave New World'?
Expected
Aldous Huxley
Provided
{
"reasoning": "Brave New World was written by Aldous Huxley.",
"answer": "Aldous Huxley"
}
Question: Who wrote 'The Catcher in the Rye'?
Expected
J.D. Salinger
Provided
{
"reasoning": "The novel was written by J. D. Salinger. Among the options, the exact standard author name is listed as option 4.",
"answer": "J.D. Salinger"
}
Question: Who wrote 'The Hobbit'?
Expected
J.R.R. Tolkien
Provided
{
"reasoning": "The Hobbit is a fantasy novel written by J.R.R. Tolkien.",
"answer": "J.R.R. Tolkien"
}