Assessing Student Engagement in Online Programmes: Using Learning Design and Learning Analytics

Abstract

This paper presents the learning design framework used in the design of the Online MA in Photography at Falmouth University. It discusses the importance of evaluating the success of online learning programmes by analysing learning analytics and student feedback within the overall pedagogic context and design of the programme. Linear regression analysis was used to analyse the engagement of three cohorts of students that completed four modules of the Online MA Photography (n=33) with over 80,000 entries in the dataset. The research explored student engagement with online content that promoted low-order cognitive skills (i.e. watching videos, reading materials and listening to podcasts) as well as high-order cognitive skills (i.e. participating in online forums and webinars). The results suggest there is weak evidence of an association between average overall mark in all modules and the level of engagement with self-directed content (P = 0.0187). There is also weak evidence of an association between average overall mark in all modules and the level of engagement in collaborative activities (P < 0.0528). Three major themes emerged from the focus group 1) weekly forums and webinars, 2) self-directed learning materials and 3) learning design and support. Online learning was acceptable and convenient to postgraduate students. These findings are discussed further in the paper as potential predictors of student performance in online programmes.