Scaling assessment innovation: from immediate feedback MCQs to automated question generation with LLMs

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Managing assessment in large, multi-campus computing cohorts is challenging, especially with reduced contact hours and growing demand for distance learning. We describe a trial of a modified Immediate Feedback Assessment Technique (IFAT), combining au- tomatically marked multiple-choice questions (MCQs) with peer review. This improved consistency, supported professional-style learning, and was well received by staff and students, but required extensive effort to author hundreds of MCQs. Early classroom tri- als with two student cohorts demonstrate technical feasibility and promising engagement, though outcome data is still emerging. We reflect on how LLM-assisted assessment design can make innova- tive practices like IFAT more sustainable and scalable in computing education. Separately, we extend this approach with a novel open- source command-line tool that leverages large language models (LLMs) to automatically generate Moodle-ready GIFT files directly from course materials such as PDFs or Powerpoint slides; including images. This enables the rapid creation of substantial MCQ banks in minutes, removing the major barrier to scaling the IFAT method.
Original languageEnglish
Title of host publicationCEP '26: Proceedings of the 10th Conference on Computing Education Practice
PublisherAssociation for Computing Machinery (ACM)
ISBN (Electronic)9798400721212
Publication statusAccepted/In press - 13 Oct 2025
EventComputing Education Practice 2026 - Durham University, Durham, United Kingdom
Duration: 8 Jan 2026 → …
https://cepconference.webspace.durham.ac.uk/

Publication series

NameACM International Conference Proceeding Series
PublisherACM

Conference

ConferenceComputing Education Practice 2026
Abbreviated titleCEP 2026
Country/TerritoryUnited Kingdom
CityDurham
Period8/01/26 → …
Internet address

Keywords

  • cognitive skill
  • examination paper
  • factual recall
  • high order cognitive skill
  • computing science
  • education
  • multiple choice
  • immediate feedback assessment technique
  • LLM
  • Gen AI

Fingerprint

Dive into the research topics of 'Scaling assessment innovation: from immediate feedback MCQs to automated question generation with LLMs'. Together they form a unique fingerprint.

Cite this