Skip to main navigation Skip to search Skip to main content

Scaling assessment innovation: from immediate feedback MCQs to automated question generation with LLMs

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    9 Downloads (Pure)

    Abstract


    Managing assessment in large, multi-campus computing cohorts is challenging, especially with reduced contact hours and growing demand for distance learning. We describe a trial of a modified Immediate Feedback Assessment Technique (IFAT), combining automatically marked multiple-choice questions (MCQs) with peer review. This improved consistency, supported professional-style learning, and was well received by staff and students, but required extensive effort to author hundreds of MCQs. We present a classroom trial with a first student cohort, demonstrating technical feasibility and promising engagement. Subsequent reflection on how LLM-assisted assessment design can make innovative practices like IFAT more sustainable and scalable in computing education is also introduced. We then extend this approach with a novel opensource command-line tool that leverages large language models (LLMs) to automatically generate Moodle-ready GIFT files directly from course materials such as PDFs or Powerpoint slides; including images. This approach was trialled with a second student cohort, though outcome data here is still emerging.
    Original languageEnglish
    Title of host publicationProceedings of 10th Computing Education Practice CEP
    Subtitle of host publication8th January 2026, Durham University UK
    EditorsSteven Bradley, Karl Southern
    Place of PublicationNew York
    PublisherAssociation for Computing Machinery (ACM)
    Pages13-16
    Number of pages4
    ISBN (Electronic)9798400721212
    DOIs
    Publication statusPublished - 7 Dec 2025
    EventComputing Education Practice 2026 - Durham University, Durham, United Kingdom
    Duration: 8 Jan 2026 → …
    https://cepconference.webspace.durham.ac.uk/

    Publication series

    NameACM International Conference Proceeding Series
    PublisherACM

    Conference

    ConferenceComputing Education Practice 2026
    Abbreviated titleCEP 2026
    Country/TerritoryUnited Kingdom
    CityDurham
    Period8/01/26 → …
    Internet address

    UN SDGs

    This output contributes to the following UN Sustainable Development Goals (SDGs)

    1. SDG 9 - Industry, Innovation, and Infrastructure
      SDG 9 Industry, Innovation, and Infrastructure

    Keywords

    • cognitive skill
    • examination paper
    • factual recall
    • high order cognitive skill
    • computing science
    • education
    • multiple choice
    • immediate feedback assessment technique
    • LLM
    • Gen AI

    Fingerprint

    Dive into the research topics of 'Scaling assessment innovation: from immediate feedback MCQs to automated question generation with LLMs'. Together they form a unique fingerprint.

    Cite this