Understanding the role of time on task in formative assessment: The case of mathematics learning

D.T. Tempelaar*, B.C. Rienties, S.J.H. Giesbers

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingChapterAcademic


Mastery data derived from formative assessments constitute a rich data set in the development of student performance prediction models. The dominance of formative assessment mastery data over use intensity data such as time on task or number of clicks was the outcome of previous research by the authors in a dispositional learning analytics context [1-3]. Practical implications of these findings are far reaching, contradicting current practices of developing (learning analytics based) student performance prediction models based on intensity data as central predictor variables. In this empirical follow-up study using data of 2011 students, we search for an explanation for time on task data being dominated by mastery data. We do so by investigating more general models, allowing for nonlinear, even non-monotonic, relationships between time on task and performance measures. Clustering students into subsamples, with different time on task characteristics, suggests heterogeneity of the sample to be an important cause of the nonlinear relationships with performance measures. Time on task data appear to be more sensitive to the effects of heterogeneity than mastery data, providing a further argument to prioritize formative assessment mastery data as predictor variables in the design of prediction models directed at the generation of learning feedback.
Original languageEnglish
Title of host publicationComputer Assisted Assessment - Research into E-Assessment (18th International Conference, CAA 2015, Zeist, The Netherlands, June 22-23, 2015. Proceedings)
EditorsE. Ras, D. Joosten-Ten Brinke
Place of PublicationZug, Switzerland
Number of pages15
ISBN (Print)978-3-319-27703-5
Publication statusPublished - 1 Jan 2015

Publication series

SeriesCommunications in Computer and Information Science

Cite this