Run Details #1166
Model
GPT-6 Luna
Score
100
Correct (≥100)
18/18
Incorrect (<100)
0
Median Time
1352.5ms
Tokens Used
2789
Cost
529µ$
Benchmark:
0153_book_author_match
Run Date: 2026-09-23 00:00:56
Questions (18)
Question: Who wrote 'The Great Gatsby'?
Expected
F. Scott Fitzgerald
Provided
{
"reasoning": "The Great Gatsby is a novel written by F. Scott Fitzgerald.",
"answer": "F. Scott Fitzgerald"
}
Question: Who wrote 'To Kill a Mockingbird'?
Expected
Harper Lee
Provided
{
"reasoning": "To Kill a Mockingbird is the novel by Harper Lee.",
"answer": "Harper Lee"
}
Question: Who wrote 'The Name of the Rose'?
Expected
Umberto Eco
Provided
{
"reasoning": "The Name of the Rose is a novel by Italian author Umberto Eco.",
"answer": "Umberto Eco"
}
Question: Who wrote 'Crime and Punishment'?
Expected
Fyodor Dostoevsky
Provided
{
"reasoning": "Crime and Punishment is a novel by Fyodor Dostoevsky.",
"answer": "Fyodor Dostoevsky"
}
Question: Who wrote 'One Hundred Years of Solitude'?
Expected
Gabriel García Márquez
Provided
{
"reasoning": "One Hundred Years of Solitude is the celebrated novel by Colombian author Gabriel García Márquez.",
"answer": "Gabriel García Márquez"
}
Question: Who wrote 'The Trial'?
Expected
Franz Kafka
Provided
{
"reasoning": "The Trial is a novel by Franz Kafka.",
"answer": "Franz Kafka"
}
Question: Who wrote 'The Stranger'?
Expected
Albert Camus
Provided
{
"reasoning": "The Stranger is a novel by Albert Camus, originally published in French as L’Étranger.",
"answer": "Albert Camus"
}
Question: Who wrote '1984'?
Expected
George Orwell
Provided
{
"reasoning": "1984 is the dystopian novel written by George Orwell.",
"answer": "George Orwell"
}
Question: Who wrote 'Invisible Man'?
Expected
Ralph Ellison
Provided
{
"reasoning": "The novel *Invisible Man* was written by Ralph Ellison. Ralph Ells is a misspelling, while James Baldwin and Richard Wright are different authors.",
"answer": "Ralph Ellison"
}
Question: Who wrote 'Frankenstein'?
Expected
Mary Shelley
Provided
{
"reasoning": "Frankenstein; or, The Modern Prometheus was written by Mary Shelley and first published anonymously in 1818.",
"answer": "Mary Shelley"
}
Question: Who wrote 'Pride and Prejudice'?
Expected
Jane Austen
Provided
{
"reasoning": "Pride and Prejudice is a classic novel by Jane Austen.",
"answer": "Jane Austen"
}
Question: Who wrote 'Moby-Dick'?
Expected
Herman Melville
Provided
{
"reasoning": "Moby-Dick was written by Herman Melville. Among the choices, option 4 gives his name correctly.",
"answer": "Herman Melville"
}
Question: Who wrote 'The Brothers Karamazov'?
Expected
Fyodor Dostoevsky
Provided
{
"reasoning": "The Brothers Karamazov is a novel by Fyodor Dostoevsky.",
"answer": "Fyodor Dostoevsky"
}
Question: Who wrote 'Ulysses'?
Expected
James Joyce
Provided
{
"reasoning": "Ulysses is the modernist novel written by James Joyce.",
"answer": "James Joyce"
}
Question: Who wrote 'Beloved'?
Expected
Toni Morrison
Provided
{
"reasoning": "Beloved is a novel by Toni Morrison.",
"answer": "Toni Morrison"
}
Question: Who wrote 'Brave New World'?
Expected
Aldous Huxley
Provided
{
"reasoning": "Brave New World is the dystopian novel written by Aldous Huxley.",
"answer": "Aldous Huxley"
}
Question: Who wrote 'The Catcher in the Rye'?
Expected
J.D. Salinger
Provided
{
"reasoning": "The Catcher in the Rye was written by J. D. Salinger. Option 4 gives the standard form of his name.",
"answer": "J.D. Salinger"
}
Question: Who wrote 'The Hobbit'?
Expected
J.R.R. Tolkien
Provided
{
"reasoning": "The Hobbit is a fantasy novel written by J.R.R. Tolkien.",
"answer": "J.R.R. Tolkien"
}