DoctoQuiz in Quiz Generation
Scenario-level performance from current published Results.
4 of 16 scenarios published
Where DoctoQuiz failed
4 of 4 graded scenarios. Open a Result to see the conversation and the evidence.
A cleanly scanned document
DoctoQuiz turned a scanned Electric Circuits chapter into a ten-question quiz that mostly tested material the chapter never teaches. It asked about Ohm's law, capacitors and diodes, which the chapter never mentions; only two questions, on the ampere and on parallel current, touched the chapter, and both test its most generic facts.
View Result →Important information appears in both text and a diagram
DoctoQuiz generated a quiz that covered text-based concepts but omitted the diagram-only core idea. None of its ten questions assessed the Fenmoor Ditch food web’s feeding relationships.
View Result →The user asks the quiz to test a particular learning goal
DoctoQuiz returned ten multiple-choice questions when asked for one open-ended question testing an explanation goal. It provided no model answer or key points.
View Result →The user turns study material into a quiz
DoctoQuiz produced correctly keyed multiple-choice quizzes in English and Hindi, but both omitted core material while repeating other topics. Each ten-question quiz left out home circuits from a chapter with six core sections; the Hindi quiz kept every question, option and answer in Hindi.
View Result →How DoctoQuiz performed
Open a capability to explore its scenarios. Each row reports the test set in its published Result.
Quiz Generation4 fail1 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A cleanly scanned document | 0 Pass1 Fail0 Not gradable 1 of 1 test case failedWhat happenedDoctoQuiz turned a scanned Electric Circuits chapter into a ten-question quiz that mostly tested material the chapter never teaches. It asked about Ohm's law, capacitors and diodes, which the chapter never mentions; only two questions, on the ampere and on parallel current, touched the chapter, and both test its most generic facts. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| Important information appears in both text and a diagram | 0 Pass1 Fail0 Not gradable 1 of 1 test case failedWhat happenedDoctoQuiz generated a quiz that covered text-based concepts but omitted the diagram-only core idea. None of its ten questions assessed the Fenmoor Ditch food web’s feeding relationships. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The user asks the quiz to test a particular learning goal | 0 Pass1 Fail0 Not gradable 1 of 1 test case failedWhat happenedDoctoQuiz returned ten multiple-choice questions when asked for one open-ended question testing an explanation goal. It provided no model answer or key points. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The user turns study material into a quiz | 0 Pass2 Fail0 Not gradable 2 of 2 test cases failedWhat happenedDoctoQuiz produced correctly keyed multiple-choice quizzes in English and Hindi, but both omitted core material while repeating other topics. Each ten-question quiz left out home circuits from a chapter with six core sections; the Hindi quiz kept every question, option and answer in Hindi. | 2/2 assessed2/2 gradablePublished test set | View Result → |
| The user turns a recorded lecture into a quiz | No published result | ||
Answer Feedback2 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The learner gives a clearly wrong answer | No published result | ||
| The learner's answer is partly correct | No published result | ||
Class Reports1 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The teacher checks what the class struggled with | No published result | ||
Grading3 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The learner answers correctly in their own words | No published result | ||
| The learner answers some fixed-answer questions correctly and others incorrectly | No published result | ||
| The learner's answer is partly correct | No published result | ||
Learner Progress1 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The learner checks whether they are improving | No published result | ||
Personalized Practice2 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| One topic is weaker than the others | No published result | ||
| The learner returns to the material later | No published result | ||
Quiz Delivery2 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A learner takes a quiz on their own | No published result | ||
| A teacher gives the quiz to a class | No published result | ||
Reading these Results
Published evidence and test coverage answer different questions.
Which scenarios have a Result?
A published Result is public evidence for this tool on one scenario. “No published result” does not say whether testing has taken place.
What does each Result cover?
Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Both use the pinned test count in that published Result.
Out of 15 scenarios
The summary counts each of the 15 scenarios once. A scenario fails when any of its published test cases failed. “No published Result yet” means nothing is public for that scenario; it does not say whether DoctoQuiz was tested on it.