We all understand the value of measurement of learnability or learning effectiveness can bring to an organization’s learning strategy and training delivery. In this article, I share a case study that showcases how you can practically evaluate the learnability of online courses.
Before outlining the case study that will illustrate how you can evaluate the learnability of online courses, I recap a few essential aspects from my previous article How To Predict And Measure The Learnability Of Online Courses.
Learner experience has a direct bearing on the effectiveness of your training initiative and eventually your ROI. If the learnability/learning effectiveness quotient of your online training is high, application of learning and the desired impact are taken care of automatically. Evaluation/measurement of learnability will help you predict the eventual impact and identify ways to better the learning experience.
While there are a few measures in place to evaluate learnability, Learning and Development professionals continue to look for an approach that can address the related challenges and help them:
As I had mentioned in my previous article, at EI Design, we have been working on the creation of a framework that can predict and evaluate the learnability of online courses since Jan’15. This maps very closely to the wish-list you may have to predict, measure, and validate the learnability of your online courses.
In this article, I use the same framework to illustrate exactly how we have used it to:
In my next article, I will use another case study to showcase how we can validate our predictive learnability from users through real time surveys.
You can use our framework to:
You can also use this framework to:
Background: The selected course is part of our Suite of 15 online courses for Instructional Designers.
Challenges: The course was developed in 2014 and during the last two years, many aspects have changed (from more wide ranging learning design possibilities to learner profiles that now feature millennials).
We felt that this is a good case study material to see how our learnability evaluation can enhance an existing course which was already delivering the required value.
Objective of the exercise: To transform a traditional eLearning course from an Instructional Design, design, and technology standpoint. Specifically, the exercise was carried out to:
Activities undertaken in the exercise: We followed the following steps to evaluate the current learnability and provide recommendations to enhance it. Specifically, we:
Outcomes Of The Learnability Evaluation And Recommendation Exercise
The learnability evaluation was done through several metrics notably:
Here is a screenshot of one of the metrics used for learnability evaluation.
Analysis and recommendations: The recommendations provided in the learnability evaluation helped the learners in getting a significantly better learnability (learning experience and effectiveness) as it provided them with:
View of the enhanced learnability: Here is a video (featuring before and after views) that reflects how the recommendations enhanced the existing learnability of the course and met the goals of the current exercise.
What more is possible: We have tested this framework and methodology with our courses and we have seen tangible gains accrue as a result.
Organizations looking to achieve a similar mandate have a lot to gain from our framework. Do contact me if you would like to sign up to measure and predict learnability of your online courses.
This article is one of the three articles on how to predict, measure, and validate the learnability of online courses.
Do refer to my previous article How To Predict And Measure The Learnability Of Online Courses for an overview of our learnability framework.
How Can You Measure The Learning Effectiveness Of eLearning Courses And Create A Positive ROI
Creative Instructional Design Featuring 7 Learning Strategies That’ll Work For You
How To Evaluate The Right Partner To Outsource Your eLearning Content Development