Quiz Generation
This benchmark is for AI products that work from supplied study material.
Benchmark overview
What is included and excluded
This benchmark evaluates how AI tools turn supplied study material into quizzes and practice tests, then grade, explain, and track what learners actually understood.
Buyers can use it to compare products for classroom and learner use. The benchmark shows whether the tool handles assessment content, answer evaluation, learner feedback, ongoing practice, and reporting in ways that stay faithful to the source material.
In scope
- Turning supplied study material into quizzes and practice tests.
- Delivering quizzes to individual learners or classes.
- Grading fixed-answer, free-form, and partly correct responses.
- Giving feedback that explains what is correct, missing, or wrong.
- Adapting later practice to strengths and weaknesses, including across sessions.
- Showing learner progress over time.
- Showing class reports about what the class struggled with.
Out of scope
- Product attributes, which are captured separately and never scored.
Participating tools
How each tool did on the 15 scenarios in this benchmark. Each cell is one scenario, in the same order for every tool and grouped by capability; Pass and Fail come from published Results.
| Tool | Scenario results · 15 scenarios in 7 capabilities | Passed | Failed | Explore |
|---|---|---|---|---|
| PDF to Quiz | 7of 13 graded | 6 | View tool → | |
| Quizgecko | 8of 13 graded | 5 | View tool → | |
| Edcafe AI | 3of 7 graded | 4 | View tool → | |
| Studyglen | 3of 6 graded | 3 | View tool → | |
| QuestionWell | 2of 5 graded | 3 | View tool → | |
| 5 more toolsin the roster | No published Results yet for DoctoQuiz · GPT-5.6 terra · Knowt · Quizizz · QuizRise.Each tool gets its own row here once its first Result is published. | |||
Capabilities & scenarios
15 scenarios grouped by 7 capabilities. Open a group to explore its scenarios in this benchmark.
Quiz Generation5 scenarios
Creates valid quizzes from supplied material that test the intended knowledge and include sufficient information for answers to be evaluated.
Capability in this benchmark → · Global definition →
- A cleanly scanned document3 tools with published Results
- The user turns study material into a quiz4 tools with published Results
- Important information appears in both text and a diagram3 tools with published Results
- The user asks the quiz to test a particular learning goal3 tools with published Results
- The user turns a recorded lecture into a quizNo published results
Quiz Delivery2 scenarios
Lets learners take and submit quizzes in the intended individual or class setting while recording each attempt correctly.
Capability in this benchmark → · Global definition →
- A learner takes a quiz on their own4 tools with published Results
- A teacher gives the quiz to a class2 tools with published Results
Grading3 scenarios
Determines how correctly a learner answered, including fixed-answer scoring, semantically equivalent wording, and partial understanding.
Capability in this benchmark → · Global definition →
- The learner answers some fixed-answer questions correctly and others incorrectly3 tools with published Results
- The learner answers correctly in their own words3 tools with published Results
- The learner's answer is partly correct3 tools with published Results
Answer Feedback2 scenarios
Explains what the learner understood correctly and what remains wrong, missing, or incomplete.
Capability in this benchmark → · Global definition →
- The learner's answer is partly correct3 tools with published Results
- The learner gives a clearly wrong answer5 tools with published Results
Personalized Practice2 scenarios
Changes later practice according to the learner's demonstrated strengths and weaknesses, including across sessions.
Capability in this benchmark → · Global definition →
- One topic is weaker than the others2 tools with published Results
- The learner returns to the material later1 tool with a published Result
Learner Progress1 scenario
Shows learners how their performance changes over time and which topics still need work.
Capability in this benchmark → · Global definition →
- The learner checks whether they are improving3 tools with published Results
Class Reports1 scenario
Shows teachers how learners performed and which questions or topics the class struggled with.
Capability in this benchmark → · Global definition →
- The teacher checks what the class struggled with2 tools with published Results
Results overview
Current published evidence in this benchmark.
Publication availability is separate from test coverage and unpublished research progress.
How the benchmark works
A public summary of the evaluation method. The same defined scope and evidence standard apply to every tool assessed under this version.
Scope includes quizzes and practice tests
The benchmark covers quizzes and practice tests from supplied study material, then delivering, grading, explaining, and tracking them.
Open rubrics and scoring
Rubrics, weights, scoring, and ranking methodology remain open and unpinned.
Product attributes are separate
Product attributes are captured separately and never scored.
Class reports show struggle, not trend
Class reports cover what the class struggled with; do not invent an over-time class-performance trend.
Resources and fixtures
The registered material and systems that create a consistent test environment for this benchmark.
Foundation Science study material
A fictional study-material file set used for quiz-generation and related assessment evaluations.