In this empirical contribution, a follow-up study of previous research , we focus on the issues of stability and sensitivity of Learning Analytics based prediction models. Do predictions models stay intact, when the instructional context is repeated in a new cohort of students, and do predictions models indeed change, when relevant aspects of the instructional context are adapted? Applying Buckingham Shum and Deakin Crick’s theoretical framework of dispositional learning analytics combined with formative assessments and learning management systems, we compare two cohorts of a large module introducing mathematics and statistics. Both modules were based on principles of blended learning, combining face-to-face Problem-Based Learning sessions with e-tutorials, and have similar instructional design, except for an intervention into the design of quizzes administered in the module. We analyse bivariate and multivariate relationships of module performance and track and disposition data to provide evidence of both stability and sensitivity of prediction models.
|Title of host publication||Computer Supported Education|
|Subtitle of host publication||7th International Conference, CSEDU 2015, Lisbon, Portugal, May 23-25, 2015, Revised Selected Papers|
|Editors||S Zvacek, M. T. Restivo, J. Uhomoibhi, M. Helfert|
|Volume||Communications in Computer and Information Science|
|Publication status||Published - 11 Feb 2016|
|Series||Communications in Computer and Information Science|
Tempelaar, D. T., Rienties, B., & Giesbers, B. (2016). Verifying the Stability and Sensitivity of Learning Analytics Based Prediction Models: An Extended Case Study. In S. Zvacek, M. T. Restivo, J. Uhomoibhi, & M. Helfert (Eds.), Computer Supported Education: 7th International Conference, CSEDU 2015, Lisbon, Portugal, May 23-25, 2015, Revised Selected Papers (583 ed., Vol. Communications in Computer and Information Science, pp. 256-273). [Chapter 15] Springer Verlag. Communications in Computer and Information Science, Vol.. 583 https://doi.org/10.1007/978-3-319-29585-5_15