{ "dataset": "Sheelon AI quiz generator bake-off, September 2026", "license": "CC BY 4.0", "published": "2026-09-20", "updated": "2026-09-20", "prompt": "A 10-question multiple-choice quiz on photosynthesis for grade 7 science students. Four answer options per question, exactly one correct answer, questions should test understanding (what plants need, where photosynthesis happens, inputs and outputs, why it matters), not only vocabulary recall.", "method": "On 19 and 20 September 2026 we gave six AI quiz generators the same prompt: a 10-question multiple-choice quiz on photosynthesis for grade 7 science, four options per question, exactly one correct answer, testing understanding (what plants need, where photosynthesis happens, inputs and outputs, why it matters) rather than vocabulary recall, in English. Each tool got the prompt in whatever fields it exposed: Kahoot, Wayground and Formative took the full text in one box; Edcafe took it as additional instructions; Sheelon's 200-character topic field forced a trimmed version with the grade typed into its audience field. Where a tool had a grade, type or count control we set it to 7th grade, multiple choice and 10. We recorded the seconds from clicking generate to a quiz that could be saved or hosted. Two graders, working blind to each other, judged every question's key, reading level, cognitive level and distractor quality on a 1 to 5 scale; an adjudicator ruled on every disputed key. A script then counted correct-answer positions and how often the correct option was the longest. Six tools ran; QuestionWell was run on 20 September 2026 after its sign-in wall was passed by a signed-in teacher account.", "caveats": [ "One run per tool on one topic. Generators are non-deterministic: Formative and Kahoot produced different question sets on earlier attempts that were lost to script failures, and Edcafe's first run had different questions, so a second run would give a different quiz and possibly a different tally.", "Grade 7 photosynthesis is a well-covered topic; results on a thinner or more specialised topic may differ.", "Formative ran on the Paid Teacher trial that new accounts get, not the free tier, so no AI cap or paywall was observed there.", "Sheelon ran on the owner's Ultimate account, so its free-plan caps (5 lifetime AI quizzes, 50 players, 3 question types) come from the pricing page and were not exercised. Sheelon is our product; the graders and adjudicator worked from the questions only.", "Kahoot delivered 9 usable questions, not 10, because the tenth card was a premium poll the free plan cannot add. Its position and length statistics are over 9 questions, and its distractor average excludes the poll.", "Two graders disagreed on the cognitive level of one question each for Edcafe and Wayground, and on Formative's reading level (one grader rated six items too easy, the other rated all ten as fitting grade 7); the table shows both where they differ.", "Timings were polled at 0.25 to 3 second intervals, so each figure is an upper bound within that window. Wayground's true value lies between 9.1 and 12.1 seconds.", "Kahoot's editor, Edcafe's save dialog and Wayground's library defaulted to public visibility; no quiz was published or shared, and Edcafe's generated quiz was not saved to its library for that reason (host and join observations there came from a pre-existing quiz)." ], "tools": [ { "tool": "Kahoot!", "ran": true, "plan_used": "Account is on Kahoot! GO (free) with a persistent \"Upgrade\" button and a top banner \"Get Kahoot!+ from $3/mo", "inputs_the_tool_accepted": "Kahoot! AI Assistant (\"Create with Kahoot! Assistant\" / \"Topic to kahoot\"), reached from the creator at https://create.kahoot.it/creator. Fields: (1) Source selector: Topic (free), PDF (free), URL (Premium feature), Wikipedia (Premium feature), Your slides (Premium feature). (2) One free-text textarea, placeholder \"Enter a topic, paste text, or add instructions\": the full prompt was pasted verbatim, unchanged. (3) Format combobox (default Quiz). (4) Language combobox (default English; ~60 languages listed, kept English). (5) Skill level combobox: Beginner / Intermediate / Advanced (kept the default Intermediate; there is NO grade field, so \"grade 7\" lives only in the prompt text). (6) Kahoot length combobox (default \"Around 20 questions\"; set to \"Around 10 questions\"). There is no explicit \"question type\" or \"number of options\" field; \"multiple choice, four options, one correct\" could only be expressed in the prompt text. Generation is triggered by a \"Create\" button; results appear as cards with a checkbox each, then \"Add selected (N)\" adds them to the kahoot (\"Add all\" carries a premium star).", "seconds_to_playable_quiz": 20, "question_types_offered": "The generator's Format picker (\"Choose your format\") lists: Quiz (free, \"Learn and test knowledge\"), and the following all marked with the premium star: Micro lesson, Vocab review, Question extractor, True or false, Presentation, Exit ticket, Practice test, Step-by-step solver (preview), Scenario practice. Even in the free \"Quiz\" format the generator mixes in other block types on its own: every run led with a Poll card (premium-starred, not addable on the free plan) and run 2 also produced a True/False question. Answer options are fixed at 4 per question (\"Add more answers\" carries a premium star). Filters on the format picker: All / For you / Learn and review / Engage your class / Support mastery.", "students_need_account_observed": "Details page offers \"Host live - Display on a big screen\", \"Lecture\", \"Assign - Send to participants\" (assignment: end date default in 3 days, \"Create an assignment then share it with participants in the next step\", up to 40 participants), plus self-study modes (Learn, Flashcards, Play solo). Clicking \"Host live\" opened play.kahoot.it/v2/?quizId=... with the game-mode chooser (Classic / Professional (Upgrade) / Teams / Accuracy / Confidence); that host page showed a \"Log into Kahoot!\" modal because this profile copy's session covers create.kahoot.it only, so I did not proceed to the PIN lobby (no sign-in per the rules). Nothing on the host/assign screens says students must sign in; the flow is the standard Kahoot join-by-game-PIN / share link for participants. Not directly verified beyond that.", "questions": [ { "n": 1, "type": "quiz (multiple choice, single select)", "text": "Which description best explains what photosynthesis mainly allows green plants to do every day?", "options": [ "Create soil nutrients", "Make plant minerals", "Store light energy", "Cool the air" ], "correct_index": 2, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 3, "flaw": "Key wording is vague ('store light energy'); the expected grade 7 answer 'make food' is absent, and 'make plant minerals' is not a real misconception." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 2, "flaw": "Stem is convoluted and the key omits the word 'food'; a textbook would say 'make food using light energy'." } }, { "n": 2, "type": "quiz (multiple choice, single select)", "text": "A student sets up plants in a dark closet; what will most likely happen?", "options": [ "Extra chlorophyll", "No photosynthesis", "Stronger stomata", "More photosynthesis" ], "correct_index": 1, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 3, "flaw": "'Extra chlorophyll' and 'stronger stomata' are throwaway distractors; 'no photosynthesis' is the obvious pick." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 2, "flaw": "'Stronger stomata' and 'extra chlorophyll' are giveaways." } }, { "n": 3, "type": "quiz (multiple choice, single select)", "text": "Where in a plant cell does photosynthesis mainly take place during a sunny day?", "options": ["Vacuole", "Chloroplast", "Nucleus", "Cell wall"], "correct_index": 1, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3, "flaw": "Mitochondria, the classic confusion, is missing; 'during a sunny day' is filler." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3, "flaw": "'During a sunny day' is filler." } }, { "n": 4, "type": "quiz (multiple choice, single select)", "text": "Which pair of substances are the main raw materials that plants use for photosynthesis?", "options": [ "Water and carbon dioxide", "Water and oxygen", "Oxygen and glucose", "Nitrogen and oxygen" ], "correct_index": 0, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 4 }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3 } }, { "n": 5, "type": "quiz (multiple choice, single select)", "text": "A plant near a busy road gets extra carbon dioxide; how might photosynthesis change?", "options": [ "Stops completely", "Could increase", "Never changes", "Always decreases" ], "correct_index": 1, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 3, "flaw": "Hedged key ('could increase') against absolute distractors ('always', 'never', 'stops completely') is a test-wiseness giveaway." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 2, "flaw": "Absolutes ('never', 'always', 'stops completely') versus the hedged 'could increase' give the answer away." } }, { "n": 6, "type": "quiz (multiple choice, single select)", "text": "Complete the sentence: Photosynthesis helps animals survive mainly because it produces what they need.", "options": [ "Shelter and fur", "Heat and sound", "Water and bones", "Oxygen and food" ], "correct_index": 3, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 1, "flaw": "'Shelter and fur', 'heat and sound', 'water and bones' are silly; says 'complete the sentence' but there is no blank." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 1, "flaw": "'Shelter and fur', 'heat and sound', 'water and bones' are nonsense distractors." } }, { "n": 7, "type": "quiz (multiple choice, single select)", "text": "Which change would most likely make photosynthesis slower in a healthy green plant leaf?", "options": [ "More leaves", "Less light", "More water", "More chlorophyll" ], "correct_index": 1, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 2, "flaw": "Key is the only 'less' among three 'more' options; the pattern gives it away." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 3 } }, { "n": 8, "type": "quiz (multiple choice, single select)", "text": "When a plant photosynthesizes, which substance is released into the air as a main product?", "options": ["Helium", "Oxygen", "Nitrogen", "Carbon dioxide"], "correct_index": 1, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3, "flaw": "'Helium' is a throwaway; only carbon dioxide is a real misconception." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 2, "flaw": "'Helium' is a throwaway." } }, { "n": 9, "type": "quiz (multiple choice, single select)", "text": "How are photosynthesis and cellular respiration related in the flow of matter and energy?", "options": [ "They are identical processes", "They use opposite materials", "They both use sunlight", "They both make light" ], "correct_index": 1, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 3, "flaw": "'They use opposite materials' is vague; a textbook says the products of one are the reactants of the other. 'Both make light' is silly." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 2, "flaw": "Key wording is vague; 'they both use sunlight' is the only real misconception offered." } }, { "n": 10, "type": "poll (no correct answer); shown with a premium star in the generator and NOT selectable/addable on the free Kahoot! GO plan, so the saved kahoot has 9 questions", "text": "How confident do you feel about explaining how photosynthesis works to a friend today?", "options": [ "Super confident", "Kind of confident", "A little unsure", "Totally confused" ], "correct_index": -1, "final_key_verdict": "wrong", "ruling": "This is a poll asking students how confident they feel, with four feelings and no correct answer (correct_index -1). It tests no science at all. The brief asked for multiple-choice questions with four options and exactly one correct answer, so a question with zero correct answers fails the brief and cannot be graded as anything but wrong. It was also premium-locked and never made it into the saved kahoot.", "grader_1": { "key": "wrong", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 1, "flaw": "Poll counted as one of the 10; it is premium-only, so the saved free-plan kahoot has 9 questions. Off-prompt." }, "grader_2": { "key": "wrong", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 1, "flaw": "Poll counted as one of the ten; it is premium-locked on the free plan, so the saved kahoot has only 9 questions, short of the prompt's 10." } } ], "summary": { "tool": "Kahoot! (AI Assistant, free Go plan)", "questions_delivered": "9 of 10 requested (10 cards generated; the tenth was a confidence poll marked premium and not addable on the free plan)", "keys_correct": "9/10 (the poll has no correct answer and counts as wrong; all 9 quiz questions keyed correctly)", "recall_understanding_application": "3/3/3 (poll excluded; both graders agree)", "distractor_avg": 2.5, "answer_position_spread": "A/B/C/D = 1/6/1/1 over 9 scored questions", "correct_is_longest": "2/9 (ties 1); avg length correct 15.8 vs wrong 15.0 chars", "seconds_to_playable": 20, "plan_note": "Free Kahoot! Go. The poll the generator produced could not be added on this plan, Add all is premium, and assignments cap at 40 participants. No credit counter shown; three generations went through unblocked.", "ambiguous_or_wrong_examples": "Wrong: Q10 \"How confident do you feel about explaining how photosynthesis works to a friend today?\" is a poll with four feelings and no correct answer. No ambiguous items.", "inputs_note": "One free-text box plus Format (Quiz), Language, Skill level (Beginner/Intermediate/Advanced, no grade field) and length (Around 10). Type and option count could only be stated in the prompt text.", "reading_level_note": "Fits grade 7 throughout; options are 1 to 4 words." } }, { "tool": "Edcafe AI", "ran": true, "plan_used": "Account badge shows \"Free\"", "inputs_the_tool_accepted": "Create Quiz form fields: (1) Source tabs: Topic / Text / Webpage / Files, with a free-text \"Topic\" textarea (placeholder \"Enter a topic (e.g., Solar system, Photosynthesis)\"); (2) Question type select: Multiple Choice / Short Answer / Mixed; (3) Number of questions select: Automatic / 5 / 10 / 15 / 20 / 30; (4) Additional instructions (optional) free-text textarea (placeholder mentions student level, standards, special instructions) plus a \"Saved prompts\" button; (5) Output language select (English default, ~55 languages incl. Hebrew, Arabic). There is NO grade/level field and NO options-per-question field. What I entered: Topic = \"Photosynthesis (grade 7 science)\"; Question type = Multiple Choice; Number = 10; Additional instructions = the full prompt verbatim (\"A 10-question multiple-choice quiz on photosynthesis for grade 7 science students. Four answer options per question, exactly one correct answer, questions should test understanding (what plants need, where photosynthesis happens, inputs and outputs, why it matters), not only vocabulary recall.\"); Output language = English. Adaptation: grade 7 and the four-options/one-correct constraints could only be conveyed through the Additional instructions text; the tool honoured all of them (10 questions, 4 options each, one correct).", "seconds_to_playable_quiz": 16, "question_types_offered": "Quiz generator \"Question type\" select offers exactly three: Multiple Choice, Short Answer, Mixed. (Create New menu also offers other content types: Chatbot, Quiz, YouTube Quiz, Flashcards, Reading Activity, Assignment Grader, Slide Deck, Teaching Resources, Summary Note, Lesson Plan, AI Speech, AI Image.)", "students_need_account_observed": "No account needed. Assign dialog gives a QR code, \"Copy link\" (https://app.edcafe.ai/quizzes/), Save QR, Embed, Google Classroom and Microsoft Teams buttons; no join PIN/code. Opening the student link shows the quiz title, author, a single \"Your name\" text input and a \"Play Quiz\" button, with no sign-in prompt. Edcafe is a self-paced/assigned-quiz model (Classic form-based, Practice, Assessment modes), not a live-hosted synchronous game.", "questions": [ { "n": 1, "type": "multiple_choice", "text": "Which three raw materials does a typical green plant need to carry out photosynthesis?", "options": [ "Sugar, oxygen, and sunlight", "$CO_2$, $H_2O$, and sunlight", "Soil minerals, sugar, and water", "Oxygen, water, and soil bacteria" ], "correct_index": 1, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3, "flaw": "Raw LaTeX in options ($CO_2$, $H_2O$); sunlight is listed as a 'raw material' though textbooks call it the energy source." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3, "flaw": "Raw LaTeX ($CO_2$, $H_2O$) shown in the key only, which also flags it visually; 'raw materials' misapplied to sunlight." } }, { "n": 2, "type": "multiple_choice", "text": "Where in a leaf does most photosynthesis occur?", "options": [ "In the outer waxy cuticle", "Inside the xylem vessels", "In the stomata pores", "In the mesophyll cells" ], "correct_index": 3, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "too hard", "cognitive_level": "recall", "distractor_quality": 4, "flaw": "Cuticle, xylem and mesophyll are beyond the grade 7 brief (which asked 'where photosynthesis happens' at the cell/organelle level)." }, "grader_2": { "key": "correct", "reading_level": "too hard", "cognitive_level": "recall", "distractor_quality": 3, "flaw": "Mesophyll, xylem and cuticle are leaf-anatomy terms from grade 9-10, not grade 7." } }, { "n": 3, "type": "multiple_choice", "text": "Which of these is a direct product of the light reactions of photosynthesis?", "options": ["$O_2$", "Glucose", "$CO_2$", "Soil nutrients"], "correct_index": 0, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "too hard", "cognitive_level": "recall", "distractor_quality": 3, "flaw": "Raw LaTeX ($O_2$, $CO_2$). 'Light reactions' is not grade 7 content; a grade 7 student sees glucose as an equally valid product of photosynthesis. Off-brief." }, "grader_2": { "key": "correct", "reading_level": "too hard", "cognitive_level": "recall", "distractor_quality": 3, "flaw": "Splits photosynthesis into light reactions, which grade 7 does not teach; a grade 7 student would reasonably pick Glucose. Raw LaTeX in three options." } }, { "n": 4, "type": "multiple_choice", "text": "Why is chlorophyll important for photosynthesis?", "options": [ "It stores sugars produced by the plant", "It builds the cell wall", "It absorbs light energy for the reactions", "It transports water from roots to leaves" ], "correct_index": 2, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 4 }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 3 } }, { "n": 5, "type": "multiple_choice", "text": "A student places a plant in the dark for several days. Which change best explains why the plant's leaves become pale?", "options": [ "The plant uses up all its oxygen at night", "Chlorophyll production decreases without light", "Soil nutrients are washed away", "Stomata permanently close and stop gas exchange" ], "correct_index": 1, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 3, "flaw": "'Soil nutrients washed away' is not tied to darkness at all." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 3 } }, { "n": 6, "type": "multiple_choice", "text": "Which pair correctly describes the main inputs and main outputs of photosynthesis?", "options": [ "Oxygen and sunlight → Carbon dioxide and water", "$CO_2$ and $H_2O$ → Sugar and $O_2$", "Sugar and soil minerals → $CO_2$ and water", "Nitrogen and water → Protein and oxygen" ], "correct_index": 1, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3, "flaw": "Raw LaTeX in three of the four options." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 3, "flaw": "Raw LaTeX in two options; arrow notation is fine." } }, { "n": 7, "type": "multiple_choice", "text": "How does increasing carbon dioxide concentration around a healthy plant usually affect the rate of photosynthesis, assuming light and water are adequate?", "options": [ "It stops photosynthesis completely", "It causes the plant to produce less sugar", "It cools the leaf surface", "It usually increases the photosynthesis rate" ], "correct_index": 3, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 3, "flaw": "Stem 'usually affect' is echoed only in the key ('usually increases'), a mild giveaway; 'cools the leaf surface' is a throwaway." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 2, "flaw": "'Cools the leaf surface' and 'stops completely' are throwaways." } }, { "n": 8, "type": "multiple_choice", "text": "Why do most food chains begin with plants or algae?", "options": [ "Because they are the only organisms that move", "Because they produce energy-rich food by photosynthesis", "Because they live longest", "Because they eat other organisms first" ], "correct_index": 1, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 2, "flaw": "'Only organisms that move' and 'eat other organisms first' are silly." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 2, "flaw": "'Only organisms that move' and 'eat other organisms first' are silly." } }, { "n": 9, "type": "multiple_choice", "text": "If a plant keeps its stomata closed for long periods, what trade-off happens?", "options": [ "It gains more $CO_2$ and loses water faster", "It saves water but reduces photosynthesis", "It produces more sugar and more oxygen", "It increases root growth immediately" ], "correct_index": 1, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 3, "flaw": "Raw LaTeX ($CO_2$); option A is self-contradictory." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 3, "flaw": "Raw LaTeX in one distractor." } }, { "n": 10, "type": "multiple_choice", "text": "Which observation best shows that photosynthesis is happening in a plant experiment?", "options": [ "Leaves become slightly warmer", "Soil becomes moist", "Roots grow toward water", "Bubbles of $O_2$ appear on the leaf surface" ], "correct_index": 3, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 3, "flaw": "Raw LaTeX ($O_2$) in the key. 'Bubbles on the leaf surface' assumes the leaf is underwater, which the stem does not say." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 2, "flaw": "Raw LaTeX in the key; 'bubbles on the leaf surface' presupposes the plant is underwater, which the stem never says; other options are weak." } } ], "summary": { "tool": "Edcafe AI (Create New > Quiz, free plan)", "questions_delivered": "10 of 10", "keys_correct": "10/10", "recall_understanding_application": "4/2/4 (grader 1) or 3/3/4 (grader 2); the graders split on Q6", "distractor_avg": 2.9, "answer_position_spread": "A/B/C/D = 1/5/1/3", "correct_is_longest": "4/10 (ties 0); avg length correct 36.0 vs wrong 30.9 chars", "seconds_to_playable": 16, "plan_note": "Free plan: 100 AI generations a month, 40 responses per quiz, Classic mode only (Practice and Assessment modes are paid). No credit counter shown.", "ambiguous_or_wrong_examples": "None wrong or ambiguous. Five of ten questions show raw LaTeX in the options, for example Q1 \"$CO_2$, $H_2O$, and sunlight\".", "inputs_note": "Topic box, Question type (Multiple Choice), Number (10), Additional instructions (full prompt pasted here), Output language. No grade field and no options-per-question field.", "reading_level_note": "8 fit grade 7; 2 too hard (mesophyll and xylem in Q2, \"light reactions\" in Q3)." } }, { "tool": "Sheelon", "ran": true, "plan_used": "This profile (Mario Finly) is NOT on the free plan: /settings shows \"Current Plan: Ultimate Plan\" and /settings/billing shows Ultimate ACTIVE $9.99/month with limits Max Players 500, Max Quizzes Unlimited, Total Questions Unlimited, Question Types 10, Insights Full, Team Mode Yes, CSV Export Yes, Classes 50, Students per class 500, \"No payment history yet\"", "inputs_the_tool_accepted": "Dialog \"Generate Quiz with AI\" (reached via Dashboard > New Quiz > \"Generate with AI\" card at /quizzes/new) has three source tabs: Topic / Text / Document. Fields on the Topic tab: (1) Topic, free text, maxlength 200 (placeholder \"e.g. World War II, Photosynthesis, JavaScript basics\"); (2) toggle \"Write a reading passage for this quiz\" (left off); (3) Audience, free text, REQUIRED, maxlength 200 (placeholder \"e.g. High school students, Corporate team\") - this is the only place to state a grade, there is no grade dropdown; (4) Quiz Language select (default English, left as is); (5) Difficulty: Easy / Medium / Hard (left at default Medium); (6) Number of Questions: slider 5-20 plus an \"Auto\" button, default 10 (left at 10); (7) Question Types checkboxes (default Multiple Choice + True/False checked; I unchecked True/False so only Multiple Choice remained); (8) AI ENHANCEMENTS: \"Auto-fetch images\" (off by default, left off) and \"Generate explanations\" (on by default, left on). ADAPTATION: the 290-char prompt does not fit the 200-char Topic cap, so I entered Topic = \"Photosynthesis: what plants need, where it happens, inputs and outputs, why it matters. Questions should test understanding, not only vocabulary recall. Four options, exactly one correct.\" (187 chars) and Audience = \"Grade 7 science students\". Count 10, MC only, Medium, English. The Text tab was not used because it is for source-passage text, not instructions.", "seconds_to_playable_quiz": 25.5, "question_types_offered": "Multiple Choice, True / False, Type Answer, Fill in the Blank, Matching, Ordering, Poll, Word Cloud, Slider, Slide (10 checkboxes with \"Select all\" / \"Clear\"; on this Ultimate account none were locked). Generated quiz labels each question \"MCQ · 60s · 1× pts\" in preview, and the editor list shows the type, timer and points multiplier for each (Multiple Choice, 60s, x1).", "students_need_account_observed": "No account needed for live play. Public /join page (signed-out view): \"Join a Game - Enter the game PIN shown on the host's screen\", a PIN field and \"Join Game\" button, plus \"Have a class code? Join your class\" and \"Want to host a game? Sign in here\" (sign-in is for hosts only). The editor's \"Start game\" dropdown offers Classic (Synchronized, host-paced), Team Mode (4 teams, auto-assigned) and Classwork (Each student goes at own speed); the separate \"Homework\" button links to /quizzes//challenge. Pricing page says class members \"join once with a six letter code\" (Ultimate feature) and has an FAQ \"Do my students have to pay?\". I did not start a game or homework because the editor states \"Starting a game publishes it\".", "questions": [ { "n": 1, "type": "Multiple Choice", "text": "Which structure inside a plant cell is directly responsible for capturing sunlight during photosynthesis?", "options": [ "The chloroplast", "The central vacuole", "The cell wall", "The nuclear membrane" ], "correct_index": 0, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3, "flaw": "Mitochondria, the usual confusion, is missing; 'nuclear membrane' is oddly specific." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3 } }, { "n": 2, "type": "Multiple Choice", "text": "During a science experiment, a student measures the mass of a potted plant over several months as it grows into a large shrub. Where does the vast majority of this added solid mass primarily originate from?", "options": [ "Minerals absorbed from the surrounding soil", "Carbon dioxide from air and water taken up", "Sunlight transformed directly into solid tissue", "Liquid fertilizers added to the root zone" ], "correct_index": 1, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 5, "flaw": "Stem is wordy ('vast majority of this added solid mass primarily originate')." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 4, "flaw": "Stem is wordy ('vast majority of this added solid mass primarily originate'); borderline for weaker readers." } }, { "n": 3, "type": "Multiple Choice", "text": "How do carbon dioxide molecules from the atmosphere enter the internal tissues of a typical green leaf?", "options": [ "Through the main veins located on the stem", "Via microscopic channels in the root hairs", "By passing straight through the thick cuticle layer", "Through tiny pore openings called stomata" ], "correct_index": 3, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 4, "flaw": "Stem is overwritten ('internal tissues of a typical green leaf'); 'main veins located on the stem' is confused wording." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3 } }, { "n": 4, "type": "Multiple Choice", "text": "What are the primary chemical end products generated by the process of photosynthesis?", "options": [ "Amino acids and nitrogen", "Proteins and fatty acids", "Glucose and oxygen gas", "Cellulose and methane gas" ], "correct_index": 2, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 2, "flaw": "No distractor is a real grade 7 misconception (carbon dioxide/water as products would be); 'cellulose and methane' is a throwaway. 'Primary chemical end products' is stiff." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3, "flaw": "'Primary chemical end products' is stiffer than needed." } }, { "n": 5, "type": "Multiple Choice", "text": "Why does the green pigment chlorophyll appear green to our eyes when we look at plant leaves?", "options": [ "It absorbs blue and red light while reflecting green.", "It filters out various colors except green ray bands.", "It absorbs green wavelengths and reflects red light.", "It converts green sunlight directly into stored starch." ], "correct_index": 0, "final_key_verdict": "ambiguous", "ruling": "The science in the key is right: chlorophyll soaks up mostly red and blue light and bounces green light back, which is why leaves look green (option A). The problem is option B, 'It filters out various colors except green ray bands.' 'Filters out' means 'removes', and chlorophyll does remove red and blue while leaving green, so B is a fuzzier true statement about the same thing rather than a wrong one. A is the best answer because it names the colours absorbed and says the green is reflected, but a grade 7 student who knows the science could defend B. Swapping B for a clearly wrong distractor (for example 'It filters out green and lets red through') would have fixed it.", "grader_1": { "key": "ambiguous", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 2, "flaw": "Option B restates the key; 'green ray bands' is not real vocabulary. Topic (light absorption) is outside the prompt's brief." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 3, "flaw": "Option B ('filters out various colors except green') is a vague paraphrase of the key and could be argued as also right; topic is slightly outside the prompt's listed areas." } }, { "n": 6, "type": "Multiple Choice", "text": "How do photosynthesis and cellular respiration depend on each other within biological systems?", "options": [ "Cellular respiration produces the glucose that drives photosynthesis.", "Both processes require direct sunlight to function properly.", "The products of photosynthesis serve as reactants for cellular respiration.", "Both pathways release carbon dioxide and consume oxygen gas." ], "correct_index": 2, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 4, "flaw": "'Reactants', 'pathways', 'biological systems' are high-school register for grade 7." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 4, "flaw": "'Reactants' and 'within biological systems' are high for some grade 7 readers." } }, { "n": 7, "type": "Multiple Choice", "text": "What role do root hairs play in supporting the process of photosynthesis in land plants?", "options": [ "They pull dissolved carbon dioxide down from the atmosphere.", "They capture underground light rays to help power root cells.", "They manufacture extra glucose to store in the root tissue.", "They absorb liquid water from the soil to supply the leaves." ], "correct_index": 3, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 3, "flaw": "'Capture underground light rays' is silly." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 3 } }, { "n": 8, "type": "Multiple Choice", "text": "In the famous historical experiment conducted by Jan Baptist van Helmont in 1643, what did he conclude about where a growing willow tree gets its mass?", "options": [ "From direct contact with heat radiated by the sun", "From the water it absorbed over the five-year period", "From invisible nitrogen gas trapped in the flower pots", "From the rich minerals and vitamins found in the dirt" ], "correct_index": 1, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3, "flaw": "Pure history recall; 'vitamins in the dirt' and 'nitrogen trapped in the flower pots' are throwaways. Date 1643 is one of several cited start years." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3, "flaw": "History recall rather than understanding, and the prompt did not ask for it; the '1643' date is one of several cited for the experiment." } }, { "n": 9, "type": "Multiple Choice", "text": "Why are photosynthetic organisms considered the foundational base of almost all terrestrial and aquatic food webs?", "options": [ "They convert solar energy into usable chemical energy for consumers.", "They consume secondary carnivores to keep animal populations stable.", "They break down dead organic matter to enrich soil nutrients.", "They filter out harmful ultraviolet radiation from sunlight." ], "correct_index": 0, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "too hard", "cognitive_level": "understanding", "distractor_quality": 3, "flaw": "'Foundational base of almost all terrestrial and aquatic food webs' and 'secondary carnivores' are heavy for 12-year-olds; 'filter out ultraviolet' is a throwaway." }, "grader_2": { "key": "correct", "reading_level": "too hard", "cognitive_level": "understanding", "distractor_quality": 3, "flaw": "'Foundational base of almost all terrestrial and aquatic food webs' and 'photosynthetic organisms' read like a high-school text." } }, { "n": 10, "type": "Multiple Choice", "text": "If a plant experiences a prolonged drought and must close its leaf stomata to conserve water, what immediate effect will this have on photosynthesis?", "options": [ "Rate speeds up because sunlight absorption becomes more efficient.", "Rate stays the same because water is not needed as a reactant.", "Rate increases because more water stays trapped inside.", "Rate drops because carbon dioxide cannot enter the leaf." ], "correct_index": 3, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 4 }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 4 } } ], "summary": { "tool": "Sheelon (Generate Quiz with AI, owner's Ultimate account)", "questions_delivered": "10 of 10", "keys_correct": "9/10 (1 ambiguous, 0 wrong)", "recall_understanding_application": "4/4/2 (both graders agree)", "distractor_avg": 3.3, "answer_position_spread": "A/B/C/D = 3/2/2/3", "correct_is_longest": "1/10 (ties 1); avg length correct 48.4 vs wrong 48.3 chars", "seconds_to_playable": 25.5, "plan_note": "Ran on the owner's Ultimate plan, so no caps were hit. The pricing page says the free plan gets 5 lifetime AI quizzes, 50 players and 3 question types; Pro ($3.99/mo) has unlimited AI generation and 150 players.", "ambiguous_or_wrong_examples": "Ambiguous: Q5 \"Why does the green pigment chlorophyll appear green to our eyes?\" keys A (absorbs blue and red, reflects green) but option B \"It filters out various colors except green ray bands\" is a looser true statement of the same thing. Off-brief: Q8 asks what van Helmont concluded in 1643, history recall.", "inputs_note": "Topic (200-char cap, so the 290-char prompt was trimmed to 187 chars), required free-text Audience (\"Grade 7 science students\", no grade dropdown), Language, Difficulty (Medium), count slider (10), question type checkboxes (True/False unticked), explanations on.", "reading_level_note": "9 fit grade 7, 1 too hard (Q9 \"foundational base of almost all terrestrial and aquatic food webs\"); several stems use a stiff register (\"primary chemical end products\", \"reactants\")." } }, { "tool": "Wayground", "ran": true, "plan_used": "Sidebar shows \"Basic\" next to Mario Finly and a yellow \"Upgrade\" button", "inputs_the_tool_accepted": "Path: Home > Create (tab) > Assessment > \"Create with prompt or text\" (https://wayground.com/activity/admin/assessment). Form fields: one free-text textarea \"Enter a topic or paste content...\" (the full prompt was pasted verbatim, no truncation), Grade level dropdown (set to \"7th Grade\"), Depth of knowledge (DOK) checkboxes Level 1/2/3 (all three checked by default, left untouched), Number of questions chips Automatic/10/15/20/30 (set to 10), Output language dropdown (default English, left as is). There is NO question-type selector in the generator; multiple choice came from the prompt text. Button label flips from disabled \"Next\" to \"Create Resource\" once the form is valid. Adaptations: none to the prompt itself. Onboarding deviations: after K-12 > Teacher > \"Classroom Teacher\" a mandatory \"Select your subjects and grades\" modal appeared with no close/skip (Escape and outside click ignored, Continue disabled until a pick), so Science + 7th were selected; a second mandatory modal \"have you used Wayground before?\" was answered \"Never\". No school step was ever shown.", "seconds_to_playable_quiz": 12.1, "question_types_offered": "The generator form itself offers no type choice. The editor's \"Create question\" menu lists: Create with AI (Generate similar questions, Generate questions on topic); Basic: Multiple Choice, True or False, Multiple Select, Fill in the Blanks, Table Fill In, Word Cloud, Open Ended, Poll, Passage, Interactive Video; Interactive & higher order (all with a yellow lightning premium badge): Match, Reorder, Drag and Drop, Categorize, Dropdown, Labeling, Audio Response, Video Response, Hot Text (NEW), Match Table Grid (NEW); Mathematics (premium badge): Math Response, Graphing; Visual learning: Hotspot (premium badge), Draw; Other: Slide, Multi part (NEW, premium badge). All 10 generated questions came out as MULTIPLE CHOICE, 30 sec, 1 pt each.", "students_need_account_observed": "Evidence points to no student account needed: https://wayground.com/join is a single \"Enter a join code\" field with a Join button and no sign-in gate; the admin header has an \"Enter code\" entry; the plans table lists \"Deliver live or student-paced activities\" as included on Basic. Caveat: the generated quiz is saved as a DRAFT and the host/assign screen only appears after Publish, which the task forbade, so the actual host screen for this quiz was not opened, and the join page was viewed from a signed-in teacher profile (a guest view was not tested).", "questions": [ { "n": 1, "type": "multiple_choice", "text": "Which gas do plants take in from the air during photosynthesis?", "options": ["Carbon dioxide", "Oxygen", "Nitrogen", "Hydrogen"], "correct_index": 0, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3 }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3 } }, { "n": 2, "type": "multiple_choice", "text": "Where in a plant cell does photosynthesis mainly happen?", "options": ["Mitochondria", "Nuclei", "Cell walls", "Chloroplasts"], "correct_index": 3, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 4 }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 4 } }, { "n": 3, "type": "multiple_choice", "text": "What is the main sugar made during photosynthesis?", "options": ["Starch", "Protein", "Fat", "Glucose"], "correct_index": 3, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3 }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3 } }, { "n": 4, "type": "multiple_choice", "text": "A plant is placed in sunlight and watered regularly. Which additional resource does it need to carry out photosynthesis?", "options": [ "Milk from another plant", "Carbon dioxide from the air", "Salt from the soil", "Oxygen from an animal" ], "correct_index": 1, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 2, "flaw": "'Milk from another plant' is a joke option; 'oxygen from an animal' is close to silly." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 2, "flaw": "'Milk from another plant' and 'Oxygen from an animal' are silly giveaways." } }, { "n": 5, "type": "multiple_choice", "text": "A student covers part of a leaf with dark paper and leaves the plant in sunlight. Which part of the leaf will make more food?", "options": [ "The roots under the soil", "The leaf stem only", "The covered part", "The uncovered part" ], "correct_index": 3, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 2, "flaw": "Stem asks 'which part of the leaf' but offers 'the roots under the soil'; only 'the covered part' is a real distractor." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 2, "flaw": "Only 'the covered part' is a real distractor; roots and 'leaf stem only' are throwaways." } }, { "n": 6, "type": "multiple_choice", "text": "Which statement correctly describes the substances used and produced in photosynthesis?", "options": [ "Water and carbon dioxide are used, and glucose and oxygen are produced", "Glucose and oxygen are used, and water and carbon dioxide are produced", "Carbon dioxide and glucose are used, and sunlight and water are produced", "Oxygen and water are used, and nitrogen and protein are produced" ], "correct_index": 0, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3, "flaw": "Option C ('sunlight and water are produced') is nonsense." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 3, "flaw": "'Sunlight and water are produced' is an obvious throwaway." } }, { "n": 7, "type": "multiple_choice", "text": "Two identical plants are placed in different locations. Plant A receives light and water, while Plant B receives water but stays in darkness. What is the best prediction?", "options": [ "Plant B will make more glucose because darkness saves energy", "Plant A will make more glucose because it has light for photosynthesis", "Neither plant will need carbon dioxide because water is available", "Both plants will make equal amounts of glucose because they receive water" ], "correct_index": 1, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 3 }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 3 } }, { "n": 8, "type": "multiple_choice", "text": "A plant's leaves are covered with a substance that blocks carbon dioxide from entering. Even though the plant has water and sunlight, it grows poorly. What evidence-based explanation best fits this result?", "options": [ "Without soil minerals, sunlight cannot reach the roots", "Without extra oxygen, the plant cannot absorb water", "Without carbon dioxide, the plant cannot make enough glucose", "Without darkness, chloroplasts cannot produce food" ], "correct_index": 2, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 2, "flaw": "Three distractors are nonsense ('sunlight cannot reach the roots', 'without darkness chloroplasts cannot produce food'); 'evidence-based explanation' is filler." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 2, "flaw": "'Evidence-based explanation' is stiff phrasing; the three distractors are all absurd so the key stands out." } }, { "n": 9, "type": "multiple_choice", "text": "A student wants to test whether light affects photosynthesis. Which investigation would provide the fairest test?", "options": [ "Put one plant in light for a week and then change its soil type", "Place several different plant species in sunlight and compare their flower colors", "Give one plant sunlight and water, but give another plant darkness and no water", "Keep two similar plants supplied with equal water and carbon dioxide, but place one in light and one in darkness" ], "correct_index": 3, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 3, "flaw": "Key is by far the longest and most detailed option, a giveaway. Tests experimental design more than photosynthesis." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 3, "flaw": "Tests experimental design more than photosynthesis content; still within the brief." } }, { "n": 10, "type": "multiple_choice", "text": "A city plans to remove many trees to build a parking area. Which conclusion best explains one important effect of this decision?", "options": [ "Fewer trees will make sunlight disappear from the area", "Fewer trees will cause all nearby animals to stop using oxygen immediately", "Fewer trees will prevent rain from ever reaching the ground", "Fewer trees may reduce the removal of carbon dioxide from the air and the release of oxygen" ], "correct_index": 3, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 2, "flaw": "Hedged key ('may reduce') against absolutes ('all', 'immediately', 'ever'), and the key is the longest option." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 2, "flaw": "The key is the longest option and the only hedged one ('may'); the absolutes ('disappear', 'immediately', 'ever') give it away." } } ], "summary": { "tool": "Wayground, formerly Quizizz (Create > Assessment, free Basic plan)", "questions_delivered": "10 of 10", "keys_correct": "10/10", "recall_understanding_application": "4/1/5 (grader 1) or 3/2/5 (grader 2); the graders split on Q6", "distractor_avg": 2.7, "answer_position_spread": "A/B/C/D = 2/2/1/5", "correct_is_longest": "5/10 (ties 2); avg length correct 48.1 vs wrong 38.5 chars", "seconds_to_playable": 12.1, "plan_note": "Free Basic plan: 10 AI credits a month (no counter shown anywhere), 100 participants, 10 to 20 stored activities that expire after 14 days, 5 question types. Onboarding forced a subject and grade pick with no skip.", "ambiguous_or_wrong_examples": "None wrong or ambiguous. Q9 and Q10 give the key away by length and hedging: Q10 keys \"Fewer trees may reduce the removal of carbon dioxide...\" against three absolutes (\"all\", \"immediately\", \"ever\").", "inputs_note": "One free-text box (full prompt pasted), Grade level dropdown (7th Grade), Depth of knowledge levels 1 to 3 (all on by default), question count chips (10), Output language. No question-type selector; multiple choice came from the prompt.", "reading_level_note": "Fits grade 7 throughout (both graders, all 10)." } }, { "tool": "Formative", "ran": true, "plan_used": "Account badge reads \"Trial - Paid Teacher\" with an \"Upgrade now!\" button, so this session ran on a Paid Teacher trial, not a plain free account", "inputs_the_tool_accepted": "Structured form (Add question or content > Create With Luna tab): Question or content type dropdown (default Multiple Choice; kept); Prompt textarea (max 4000 chars; full prompt pasted verbatim, 3706 chars remaining); Grade (required, searchable multi-select chips; picked \"7th\"); Subject (required, searchable multi-select; picked \"Science\"); Difficulty (optional; left unset); Language (default English; kept); Standards (optional search; left empty); Number of questions (numeric 1-25, default 4; set to 10). Nothing in the prompt had to be adapted. There is also a free-text Luna chat panel in the editor (not used). Generated items land in a review modal (Keep question checkbox per item, editable options, Make it Easier/Similar/Harder, Regenerate, Add); pressing Add inserts them into the formative.", "seconds_to_playable_quiz": 9.1, "question_types_offered": "Luna generator type dropdown: Text passage, Categorize, Free Response, Matching, Multiple Choice, Multiple Selection, Numeric, Short Answer, True or False. Manual Add Item menu: Content = Audio, Embed, Image, Paired Passages, Slide, Text, Video; Free Questions = Drawing, Free Response, Multiple Choice, Multiple Selection, Short Answer, True or False; Paid Questions (badge \"Expires in 13 Days\") = Audio Response, Categorize, Drag and Drop, Dropdown, File Response, Fill in the Blank, Graphing, Hot Spot, Hot Text, Match Table Grid, Matching, Number Line, Numeric, Resequence, Video Response; plus Multi-part (NEW) and Section. Luna chat also offers PDF/image-to-questions and image generation.", "students_need_account_observed": "No account needed: the Assign settings dialog lists a pre-checked \"Guest students\" target (globe icon, 0 people) alongside \"Add class\"; its settings page offers Teacher-paced / Student-paced / Game-paced modes, Quick start presets (Homework, Lesson, Retakes, Quiz), attempts, scheduling, random order, optional \"Require password to enter\" and \"Secure exam browser mode\". The join code/link is only revealed after pressing Assign, which was not done. Classes can also be rostered via Google Classroom, Clever, or Microsoft Teams.", "questions": [ { "n": 1, "type": "multiple_choice", "text": "What do plants use from sunlight to make food?", "options": ["Oxygen", "Chlorophyll", "Carbon Dioxide", "Nutrients"], "correct_index": 1, "final_key_verdict": "wrong", "ruling": "The question asks what plants use FROM sunlight to make food. The true answer is light energy. Chlorophyll (the key) is a green pigment the plant makes itself inside its chloroplasts; it catches sunlight, it does not come from sunlight. Read as written, the key states a misconception (that chlorophyll is something plants get from the sun), and none of the four options (oxygen, chlorophyll, carbon dioxide, nutrients) is a thing plants take from sunlight. A question whose key is false as worded and whose true answer is not on the list is wrong, not merely ambiguous. The intended question ('What do plants use to capture energy from sunlight?') would have made chlorophyll correct, but that is not the question a student sees.", "grader_1": { "key": "wrong", "reading_level": "too easy", "cognitive_level": "recall", "distractor_quality": 2, "flaw": "Malformed stem; no option is a correct answer to it." }, "grader_2": { "key": "ambiguous", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 2, "flaw": "Question stem is malformed; the keyed option (Chlorophyll) is not 'from sunlight'." } }, { "n": 2, "type": "multiple_choice", "text": "Where does photosynthesis mainly occur in plants?", "options": ["Leaves", "Stems", "Roots", "Flowers"], "correct_index": 0, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "too easy", "cognitive_level": "recall", "distractor_quality": 3, "flaw": "Brief asked where photosynthesis happens at the cell level; this stays at the organ level." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3 } }, { "n": 3, "type": "multiple_choice", "text": "Which gas do plants take in during photosynthesis?", "options": ["Carbon Dioxide", "Nitrogen", "Hydrogen", "Oxygen"], "correct_index": 0, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "too easy", "cognitive_level": "recall", "distractor_quality": 3, "flaw": "Near-duplicate of Q9's reverse; the set repeats the same input/output fact four times." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3 } }, { "n": 4, "type": "multiple_choice", "text": "What do plants release as a byproduct of photosynthesis?", "options": ["Oxygen", "Nitrogen", "Glucose", "Carbon Dioxide"], "correct_index": 0, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3 }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3 } }, { "n": 5, "type": "multiple_choice", "text": "Why do plants need water for photosynthesis?", "options": [ "To make chlorophyll", "To cool down", "To create glucose", "For growth" ], "correct_index": 2, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 3, "flaw": "'For growth' is vague enough that a weak reader may defend it." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 3, "flaw": "'For growth' is loosely true of water in general and could tempt a student, though not for photosynthesis specifically." } }, { "n": 6, "type": "multiple_choice", "text": "What is the main purpose of photosynthesis?", "options": [ "To produce food", "To absorb nutrients", "To grow roots", "To release energy" ], "correct_index": 0, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "too easy", "cognitive_level": "recall", "distractor_quality": 3 }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3 } }, { "n": 7, "type": "multiple_choice", "text": "Which of these is a raw material in photosynthesis?", "options": ["Sugar", "Chlorophyll", "Sunlight", "Oxygen"], "correct_index": 2, "final_key_verdict": "wrong", "ruling": "Every grade 7 textbook lists the raw materials of photosynthesis as carbon dioxide and water: the stuff the plant takes in and turns into sugar. Sunlight is the energy source that drives the change, not a material that gets used up and built into glucose. Neither carbon dioxide nor water appears among the options (sugar and oxygen are products, chlorophyll is the pigment that catches light), so no option is a raw material and the keyed answer 'Sunlight' is not correct. A student who learned the textbook definition would have no right answer to pick.", "grader_1": { "key": "wrong", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 2, "flaw": "Raw material vs energy source confusion baked into the key; chlorophyll is also 'needed' and could be argued." }, "grader_2": { "key": "wrong", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 2, "flaw": "No correct option; the key confuses energy source with raw material." } }, { "n": 8, "type": "multiple_choice", "text": "How do plants obtain sunlight for photosynthesis?", "options": [ "Through leaves", "Through soil", "Through flowers", "Through roots" ], "correct_index": 0, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "too easy", "cognitive_level": "recall", "distractor_quality": 2, "flaw": "'Obtain sunlight' is odd phrasing; repeats Q2." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 2, "flaw": "Soil/roots/flowers are giveaway distractors; trivial item." } }, { "n": 9, "type": "multiple_choice", "text": "What is made as a result of photosynthesis besides oxygen?", "options": ["Water", "Carbon Dioxide", "Chlorophyll", "Glucose"], "correct_index": 3, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3, "flaw": "Repeats Q4/Q6 content." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3, "flaw": "Near-duplicate of Q4 and Q6 (outputs asked three times)." } }, { "n": 10, "type": "multiple_choice", "text": "Why is photosynthesis important for Earth?", "options": [ "It produces oxygen", "It cools the air", "It grows food", "It provides shade" ], "correct_index": 0, "final_key_verdict": "ambiguous", "ruling": "Photosynthesis matters to Earth for two reasons that every grade 7 course teaches side by side: it releases the oxygen animals breathe, and it makes the sugar that is the food at the bottom of every food chain. The key, 'It produces oxygen', is correct. But 'It grows food' is a clumsy way of saying the second reason, and a 12-year-old who chooses it is not wrong about the science. Because two options point at real, textbook reasons and the question gives no way to prefer one, careful wording (asking specifically about the air, or replacing 'It grows food' with a clearly false distractor) would have fixed it.", "grader_1": { "key": "ambiguous", "reading_level": "too easy", "cognitive_level": "understanding", "distractor_quality": 2, "flaw": "Two defensible options (A and C); 'provides shade' is a throwaway." }, "grader_2": { "key": "ambiguous", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 2, "flaw": "Two defensible options; 'It grows food' is awkward wording." } } ], "summary": { "tool": "Formative (Create With Luna, Paid Teacher trial)", "questions_delivered": "10 of 10", "keys_correct": "7/10 (2 wrong, 1 ambiguous)", "recall_understanding_application": "8/2/0 (both graders agree)", "distractor_avg": 2.6, "answer_position_spread": "A/B/C/D = 6/1/2/1", "correct_is_longest": "2/10 (ties 0); avg length correct 11.6 vs wrong 10.8 chars", "seconds_to_playable": 9.1, "plan_note": "Ran on the Paid Teacher trial that new accounts get (13 days left, then $249 a year for advanced question types). No AI cap or counter appeared. The free tier keeps Multiple Choice and five other basic types.", "ambiguous_or_wrong_examples": "Wrong: Q1 \"What do plants use from sunlight to make food?\" keys Chlorophyll, which plants make themselves; no option is right as written. Wrong: Q7 \"Which of these is a raw material in photosynthesis?\" keys Sunlight; the textbook raw materials (carbon dioxide, water) are not offered. Ambiguous: Q10 \"Why is photosynthesis important for Earth?\" keys \"It produces oxygen\" but \"It grows food\" is also a textbook reason.", "inputs_note": "Structured form: type dropdown (Multiple Choice), 4000-char prompt box (full prompt pasted), required Grade (7th) and Subject (Science), optional Difficulty and Standards, Language, count (10). Nothing had to be adapted.", "reading_level_note": "Grader 2: fits grade 7 on all 10. Grader 1: 6 of 10 too easy, closer to grade 4 or 5; one-word options." } }, { "tool": "QuestionWell", "ran": true, "plan_used": "Account shows \"Upgrade\" CTA (free tier)", "inputs_the_tool_accepted": "Create > Quiz tab form: \"Get [10] [Multiple Choice] questions about [topic] in [English] at a [7th Grade] reading level\". The topic field is a single-line text input with no maxlength; it accepted the full 268-character fixed prompt verbatim (inputValue matched exactly). Count dropdown: 5 and 10 free; 20 and 30 marked premium with a \"5 left\" counter. Type dropdown: Multiple Choice free; Short Answer, Fill-in-the-Blank, True/False, Multiple Select marked premium under \"5 premium questions left\". Grade dropdown: Kindergarten through 12th grade (chose 7th Grade). Language dropdown (left at English). Source icon bar under \"based on\" with 7 icons (write/paste text, AI generate, book/reading, attach file (premium bolt), YouTube, web URL, and a target/standards icon); I used none, only the topic text (0/1,000 words source box stayed empty). Question Types accordion: \"Default\" selected; the five other presets (New Topic, Advanced Analysis, Quick Assessment, Deep Dive, Skill Practice) are premium with a \"5 Left\" counter. Clicked Generate Questions once.", "seconds_to_playable_quiz": 50, "question_types_offered": "Type dropdown: Multiple Choice (free, unlimited per pricing table \"5/10 at a time\"); Short Answer, Fill-in-the-Blank, True/False, Multiple Select (all premium, shared counter \"5 premium questions left\" this month = localStorage usageLimit used_premium_question_types limit 5). Question Types presets accordion: Default (free); New Topic, Advanced Analysis, Quick Assessment, Deep Dive, Skill Practice (premium, \"5 Left\" = used_blooms_question_types limit 5). The result page also has Comprehension / Discussion / Vocabulary tabs; Discussion questions are listed as unlimited on Free. Each generated question carries a DOK level badge (this set: DOK3, DOK3, DOK1, DOK1, DOK1, DOK2, DOK2, DOK2, DOK2, DOK3).", "students_need_account_observed": "QuestionWell has its own student-facing mode: Interactive Quiz opens a \"Your Assignment Code\" dialog (\"Generate an assignment code so students can access this question set\"), with optional section assignment, settings (show reading before quiz, mastery cutoff) and advanced options (full reading in sidebar, real-time feedback, show score at finish, Clever-only Login). Generate Code is capped \"5 Left\" per month on Free (created_assignment limit 5). Whether students need an account was not verified since no code was generated; the \"Clever-only Login\" toggle implies students normally join via the code with some login option, but the default student auth requirement was not observed. It is asynchronous self-paced assignment with a live dashboard, not a synchronous host-controlled game; the Game Show Quiz is a teacher-projected Jeopardy board.", "exports_observed": "Export / Assign requires selecting questions first (Select All). Page header: \"Assign your question set using QuestionWell\": Interactive Quiz, Game Show Quiz (Jeopardy-style, \"Create Jeopardy Game\"), Print Worksheet. Then \"Or select your preferred tool to export your question set\" with banner \"5 quiz exports left this month\" + Upgrade. 21 export targets (img alt text): Microsoft Word (DOCX), Google Forms, Google Slides, Google Docs, Kahoot, Quizizz, Blooket, Canvas (QTI 1.2), Microsoft Forms, Gimkit, Moodle (GIFT), Quizlet, Blackboard, Schoology (IMSCC ZIP), Socrative, ClassroomGo, Anki, GCSE Pod, Brightspace (D2L), QBank, Blackbaud LMS. Exports are free but capped at 5/month on the free plan (Premium: unlimited to \"15+ edtech platforms\"). Reading panel also offers Worksheet / Word / Google Docs export of the AI reading (exported_reading limit 3/month). Share button copies a teacher-to-teacher link (\"Share this link with other educators\"). More actions: Add Question, Print, Retake, Shuffle. Nothing was exported.", "questions": [ { "n": 1, "type": "multiple_choice", "text": "A plant is placed in a sealed box with only carbon dioxide and water. If it gets sunlight, what will be the main gas in the box after a day?", "options": [ "More carbon dioxide", "Less carbon dioxide", "More nitrogen gas", "Less oxygen gas" ], "correct_index": 1, "final_key_verdict": "wrong", "ruling": "The stem asks which gas will be the MAIN gas in the sealed box after a day. Every option is a change in amount ('more'/'less'), not a gas, so no option answers the question as asked; that is the stated rule for 'wrong'. The science: in light the plant takes in carbon dioxide and gives out oxygen, so the amount of CO2 falls and oxygen appears, which makes 'less carbon dioxide' a true statement, but a true statement is not an answer to 'what is the main gas'. The honest answer (oxygen builds up; whether it becomes the main gas in one day depends on how much CO2 the box started with) is not offered. 'More oxygen' is missing while 'less oxygen' is present, and 'more nitrogen' is impossible in a box that started with only CO2 and water. Grader 1's 'correct' credits the only biologically consistent option; grader 2's 'ambiguous' notes the stem/option mismatch. Under the rule that options must answer the stem, the item is wrong.", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 3, "flaw": "Options do not answer the stem: it asks 'what will be the main gas' but every option is a change ('more/less'); the true answer to the stem as written (oxygen) is not offered. 'More nitrogen' is silly with no nitrogen source in a sealed box." }, "grader_2": { "key": "ambiguous", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 2, "flaw": "Options do not answer the stem; 'more oxygen' is missing while 'less oxygen' is present; 'more nitrogen' contradicts the sealed-box setup." } }, { "n": 2, "type": "multiple_choice", "text": "A scientist finds a plant that can photosynthesize without any water. What key component of photosynthesis would this plant NOT need?", "options": [ "Glucose to store energy", "Sunlight to start the process", "Chlorophyll to catch light", "Carbon dioxide from the air" ], "correct_index": 3, "final_key_verdict": "wrong", "ruling": "Both graders agree and the rule is explicit. Water is a reactant of photosynthesis: the plant splits water to get the hydrogen it puts into glucose and the oxygen it releases, so a plant that photosynthesizes 'without any water' contradicts biology. Even inside the hypothetical, removing water does not remove the need for carbon dioxide, sunlight or chlorophyll; the plant still needs all three. The only thing such a plant would 'not need' is water, and water is not among the options. The keyed answer, carbon dioxide from the air, is a required input, so the item teaches a false fact. Glucose is a product, not a 'key component', so it does not rescue the item either. Wrong.", "grader_1": { "key": "wrong", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 1, "flaw": "Hypothetical contradicts biology (photosynthesis cannot run without water), the correct answer is absent from the options, and the marked answer is a required input." }, "grader_2": { "key": "wrong", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 1, "flaw": "Hypothetical contradicts biology (water is a reactant), none of the four options answers the stem, and the key teaches a false fact." } }, { "n": 3, "type": "multiple_choice", "text": "Where in a plant does photosynthesis mainly happen?", "options": [ "In the plant's stems", "In the plant's leaves", "In the plant's flowers", "In the plant's roots" ], "correct_index": 1, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3 }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3, "flaw": "Stays at the organ level; the prompt's 'where it happens' would be better served by a chloroplast/cell-level question." } }, { "n": 4, "type": "multiple_choice", "text": "What is the main product plants make for energy?", "options": [ "Oxygen gas for breathing", "Glucose sugar for food", "Water for the soil", "Carbon dioxide gas" ], "correct_index": 1, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3, "flaw": "'Water for the soil' is a throwaway option; 'for energy' is slightly loose but the key holds." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3, "flaw": "'Water for the soil' is silly; every option carries a trailing purpose phrase that makes the key read the most natural." } }, { "n": 5, "type": "multiple_choice", "text": "What gas do plants release during photosynthesis?", "options": [ "Oxygen gas", "Nitrogen gas", "Methane gas", "Carbon dioxide" ], "correct_index": 0, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 2, "flaw": "Nitrogen and methane are not real misconceptions, so only one distractor does any work." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3 } }, { "n": 6, "type": "multiple_choice", "text": "Why is photosynthesis important for life on Earth?", "options": [ "It makes food and air for life.", "It only takes in carbon dioxide.", "It helps rocks to form over time.", "It makes heat for the planet." ], "correct_index": 0, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 2, "flaw": "'It only takes in carbon dioxide' is not an answer to 'why is it important' and reads as a half-true statement made false by 'only'; 'air' is imprecise for oxygen. The correct option is the only one phrased as a benefit, which is a giveaway." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 2, "flaw": "'It only takes in carbon dioxide' is a fact fragment, not a reason, and the word 'only' is the give-away; 'air' in the key is loose where 'oxygen' is meant." } }, { "n": 7, "type": "multiple_choice", "text": "Which process is most like photosynthesis in how it changes energy?", "options": [ "Cooking food on a stove", "Burning wood for a fire", "Digesting food in your body", "Using solar panels for power" ], "correct_index": 3, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 4, "flaw": "'Burning wood' and 'digesting food' are genuinely reverse-process distractors, which is good; the analogy to solar panels is a reasonable transfer task." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 4, "flaw": "'Most like' invites some argument, but the intended parallel (light captured and converted) is clear enough for grade 7." } }, { "n": 8, "type": "multiple_choice", "text": "How do plants get the water they need for photosynthesis?", "options": [ "They absorb it from the air.", "They take it from other plants.", "They make it from sunlight.", "They get it from the soil." ], "correct_index": 3, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3 }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3 } }, { "n": 9, "type": "multiple_choice", "text": "What is the role of chlorophyll in photosynthesis?", "options": [ "It helps plants release oxygen.", "It helps plants absorb water.", "It helps plants capture sunlight.", "It helps plants break down food." ], "correct_index": 2, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3 }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "recall", "distractor_quality": 3 } }, { "n": 10, "type": "multiple_choice", "text": "A plant is placed in a dark closet for a week. What will happen to its ability to photosynthesize?", "options": [ "It will not work very well.", "It will make more oxygen.", "It will change its color.", "It will grow much faster." ], "correct_index": 0, "final_key_verdict": "correct", "grader_1": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "understanding", "distractor_quality": 3, "flaw": "Marked answer is vague ('not very well' when it stops entirely), and 'it will change its color' is literally true (a plant in the dark yellows as chlorophyll breaks down) even though it does not answer the stem about ability, which may tempt a strong student." }, "grader_2": { "key": "correct", "reading_level": "fits grade 7", "cognitive_level": "application", "distractor_quality": 3, "flaw": "'It will change its color' is biologically true (a plant kept in the dark for a week etiolates and yellows) even though it does not answer the stem about photosynthesis; the key is vague ('not very well' rather than 'it will stop')." } } ], "summary": { "tool": "QuestionWell (Create > Quiz, free plan)", "questions_delivered": "10 of 10", "keys_correct": "8/10 (2 wrong)", "ambiguous_or_wrong_examples": "Q1 'what will be the main gas in the box after a day?' offers only 'more/less' changes, never a gas, so no option answers the stem (grader 1 correct, grader 2 ambiguous, adjudicated wrong). Q2 'a plant that can photosynthesize without any water ... what key component would this plant NOT need?' keys carbon dioxide, an input the plant still needs; water, the only real answer, is not an option (both graders wrong).", "recall_understanding_application": "Grader 1: 5 recall / 2 understanding / 3 application. Grader 2: 5 recall / 1 understanding / 4 application (they differ only on Q10, understanding vs application). Both agree the set is half recall.", "reading_level_note": "Fits grade 7 throughout (both graders, all 10 questions); short one-clause stems and plain vocabulary.", "distractor_avg": 2.7, "answer_position_spread": "A/B/C/D = 3/3/1/3", "correct_is_longest": "3/10 (ties 1); avg length correct 24.4 vs wrong 23.6 chars", "seconds_to_playable": 50, "plan_note": "Free plan: unlimited multiple choice (5 or 10 at a time), 5 premium question-type uses, 5 exports and 5 assignment codes a month; generating did not use a counter." } } ], "position_and_length_stats": [ "Kahoot! scored q=9 pos A-D=1/6/1/1 correct-is-longest=2/9 (ties 1) avgLen correct 15.8 vs wrong 15.0 | 20s | types produced: quiz (multiple choice, single select),poll (no correct answe", "Edcafe AI scored q=10 pos A-D=1/5/1/3 correct-is-longest=4/10 (ties 0) avgLen correct 36.0 vs wrong 30.9 | 16s | types produced: multiple_choice", "Sheelon scored q=10 pos A-D=3/2/2/3 correct-is-longest=1/10 (ties 1) avgLen correct 48.4 vs wrong 48.3 | 25.5s | types produced: Multiple Choice", "Wayground scored q=10 pos A-D=2/2/1/5 correct-is-longest=5/10 (ties 2) avgLen correct 48.1 vs wrong 38.5 | 12.1s | types produced: multiple_choice", "Formative scored q=10 pos A-D=6/1/2/1 correct-is-longest=2/10 (ties 0) avgLen correct 11.6 vs wrong 10.8 | 9.1s | types produced: multiple_choice", "QuestionWell scored q=10 pos A-D=3/3/1/3 correct-is-longest=3/10 (ties 1) avgLen correct 24.4 vs wrong 23.6 | 50s | types produced: multiple_choice" ] }