QuestionWell in Quiz Generation
Scenario-level performance from current published Results.
5 of 16 scenarios published
Where QuestionWell failed
3 of 5 graded scenarios. Open a Result to see the conversation and the evidence.
The learner gives a clearly wrong answer
QuestionWell failed to give full help for a clearly wrong learner answer. The feedback pointed at a series-circuit misunderstanding, but it did not explain why the answer was wrong, state the correct idea, or show a model answer; the end screen showed only an overall score.
View Result →The learner checks whether they are improving
QuestionWell fails this scenario: the learner view shows only whole-quiz scores, not topic-level progress. The same attempts appear broken out by learning outcome on the teacher side, so the missing detail exists but is not shown to learners.
View Result →The user turns study material into a quiz
QuestionWell produced multiple-choice quizzes from both chapters, with answer-quality problems in each. One quiz had a defensible unkeyed option and repeated a core idea. The Hindi quiz used Hindi throughout, but keyed equal branch currents despite the chapter’s 0.30 A and 0.18 A examples; another item’s statement did not fit its answer choices.
View Result →How QuestionWell performed
Open a capability to explore its scenarios. Each row reports the test set in its published Result.
Answer Feedback1 pass1 fail
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The learner gives a clearly wrong answer | 0 Pass1 Fail0 Not gradable 1 of 1 test case failedWhat happenedQuestionWell failed to give full help for a clearly wrong learner answer. The feedback pointed at a series-circuit misunderstanding, but it did not explain why the answer was wrong, state the correct idea, or show a model answer; the end screen showed only an overall score. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The learner's answer is partly correct | 2 Pass0 Fail0 Not gradable 2 of 2 test cases passedWhat happenedQuestionWell handles partly correct open-ended answers as partial rather than fully correct or wrong. It named the correct idea, named the missing idea, and told the learner what to add; it also showed a distinct partial-correct judgment and a 1.5/3 total in the same session. | 2/2 assessed2/2 gradablePublished test set | View Result → |
Grading1 pass2 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The learner's answer is partly correct | 2 Pass0 Fail0 Not gradable 2 of 2 test cases passedWhat happenedQuestionWell handles partly correct open-ended answers as partial rather than fully correct or wrong. It named the correct idea, named the missing idea, and told the learner what to add; it also showed a distinct partial-correct judgment and a 1.5/3 total in the same session. | 2/2 assessed2/2 gradablePublished test set | View Result → |
| The learner answers correctly in their own words | No published result | ||
| The learner answers some fixed-answer questions correctly and others incorrectly | No published result | ||
Learner Progress1 fail
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The learner checks whether they are improving | 0 Pass1 Fail0 Not gradable 1 of 1 test case failedWhat happenedQuestionWell fails this scenario: the learner view shows only whole-quiz scores, not topic-level progress. The same attempts appear broken out by learning outcome on the teacher side, so the missing detail exists but is not shown to learners. | 1/1 assessed1/1 gradablePublished test set | View Result → |
Quiz Generation1 fail4 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The user turns study material into a quiz | 0 Pass2 Fail0 Not gradable 2 of 2 test cases failedWhat happenedQuestionWell produced multiple-choice quizzes from both chapters, with answer-quality problems in each. One quiz had a defensible unkeyed option and repeated a core idea. The Hindi quiz used Hindi throughout, but keyed equal branch currents despite the chapter’s 0.30 A and 0.18 A examples; another item’s statement did not fit its answer choices. | 2/2 assessed2/2 gradablePublished test set | View Result → |
| A cleanly scanned document | No published result | ||
| Important information appears in both text and a diagram | No published result | ||
| The user asks the quiz to test a particular learning goal | No published result | ||
| The user turns a recorded lecture into a quiz | No published result | ||
Class Reports1 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The teacher checks what the class struggled with | No published result | ||
Personalized Practice2 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| One topic is weaker than the others | No published result | ||
| The learner returns to the material later | No published result | ||
Quiz Delivery2 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A learner takes a quiz on their own | No published result | ||
| A teacher gives the quiz to a class | No published result | ||
Reading these Results
Published evidence and test coverage answer different questions.
Which scenarios have a Result?
A published Result is public evidence for this tool on one scenario. “No published result” does not say whether testing has taken place.
What does each Result cover?
Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Both use the pinned test count in that published Result.
Out of 15 scenarios
The summary counts each of the 15 scenarios once. A scenario fails when any of its published test cases failed. “No published Result yet” means nothing is public for that scenario; it does not say whether QuestionWell was tested on it.