Studyglen in Quiz Generation
Scenario-level performance from current published Results.
6 of 16 scenarios published
Where Studyglen failed
3 of 6 graded scenarios. Open a Result to see the conversation and the evidence.
The learner's answer is partly correct
Studyglen explained the learner's partial understanding, but graded the answer as incorrect without partial credit. It showed 55% similarity versus 0% for a response expressing no understanding; its feedback identified the correct brightness comparison and the missing voltage and battery-life ideas.
View Result →The learner's answer is partly correct
Studyglen explained the learner's partial understanding, but graded the answer as incorrect without partial credit. It showed 55% similarity versus 0% for a response expressing no understanding; its feedback identified the correct brightness comparison and the missing voltage and battery-life ideas.
View Result →The user asks the quiz to test a particular learning goal
Studyglen generated no question requiring an explanation of why other parallel lamps stay lit when one fails. Question 15 asked what happens, while Question 1 asked broadly why household lamps use parallel wiring.
View Result →How Studyglen performed
Open a capability to explore its scenarios. Each row reports the test set in its published Result.
Answer Feedback1 pass1 fail
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The learner gives a clearly wrong answer | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedStudyglen passes this scenario: it gives diagnostic feedback for a wrong answer that reflects a real misconception. On Question 15 it said the response was wrong, gave the continuous-path idea, and matched the source chapter's energy/current distinction. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The learner's answer is partly correct | 1 Pass1 Fail0 Not gradable 1 of 2 test cases passed · 1 failedWhat happenedStudyglen explained the learner's partial understanding, but graded the answer as incorrect without partial credit. It showed 55% similarity versus 0% for a response expressing no understanding; its feedback identified the correct brightness comparison and the missing voltage and battery-life ideas. | 2/2 assessed2/2 gradablePublished test set | View Result → |
Grading1 pass1 fail1 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The learner answers some fixed-answer questions correctly and others incorrectly | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedStudyglen correctly graded the learner’s mix of correct and incorrect fixed answers. It reported 10 correct and 10 incorrect answers, giving 50% for 10 correct out of 20. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The learner's answer is partly correct | 1 Pass1 Fail0 Not gradable 1 of 2 test cases passed · 1 failedWhat happenedStudyglen explained the learner's partial understanding, but graded the answer as incorrect without partial credit. It showed 55% similarity versus 0% for a response expressing no understanding; its feedback identified the correct brightness comparison and the missing voltage and battery-life ideas. | 2/2 assessed2/2 gradablePublished test set | View Result → |
| The learner answers correctly in their own words | No published result | ||
Quiz Delivery1 pass1 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A learner takes a quiz on their own | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedStudyglen let a learner finish and submit a 20-question quiz alone. It kept the responses as one attempt, with the same 50% score—10 correct and 10 incorrect—after reopening and reloading. Correct answers, marks and explanations appeared only after submission. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| A teacher gives the quiz to a class | No published result | ||
Quiz Generation1 fail4 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The user asks the quiz to test a particular learning goal | 0 Pass1 Fail0 Not gradable 1 of 1 test case failedWhat happenedStudyglen generated no question requiring an explanation of why other parallel lamps stay lit when one fails. Question 15 asked what happens, while Question 1 asked broadly why household lamps use parallel wiring. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| A cleanly scanned document | No published result | ||
| Important information appears in both text and a diagram | No published result | ||
| The user turns a recorded lecture into a quiz | No published result | ||
| The user turns study material into a quiz | No published result | ||
Class Reports1 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The teacher checks what the class struggled with | No published result | ||
Learner Progress1 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The learner checks whether they are improving | No published result | ||
Personalized Practice2 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| One topic is weaker than the others | No published result | ||
| The learner returns to the material later | No published result | ||
Reading these Results
Published evidence and test coverage answer different questions.
Which scenarios have a Result?
A published Result is public evidence for this tool on one scenario. “No published result” does not say whether testing has taken place.
What does each Result cover?
Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Both use the pinned test count in that published Result.
Out of 15 scenarios
The summary counts each of the 15 scenarios once. A scenario fails when any of its published test cases failed. “No published Result yet” means nothing is public for that scenario; it does not say whether Studyglen was tested on it.