While it is obvious that Learnability or learning effectiveness of online courses has an impact on ROI, its measurement is rather a tall order. This article outlines how you can use our framework to predict, measure, and validate the learnability or learning effectiveness of your online courses.
Learnability or learning effectiveness of online courses can be defined as the ease and speed with which the learners can acquire the required information/knowledge/skill. There is an associated aspect that you need to be mindful of, that is, the scope of learnability. Once this measured, we can assess the progress from knowledge acquisition to application reflected as performance gain.
The scope of learnability evaluation can be looked at in two ways:
The significance of learnability is evident. Only well crafted courses with the right learnability can help learners perform better and help organizations meet their goals.
Studies have revealed that learners lose up to 40% of their time due to “frustrating experiences” with courses. The common causes being missing, hard to find, unusable, and irrelevant features of the course.
Similarly, a study carried out by Federico Borges found that learners get frustrated due to a variety of reasons including the learning strategy used, lack of prompt feedback, the company culture, the learning material that was designed, and so on.
Most of us are familiar with Kirkpatrick’s model of evaluation as shown here:
This model can be extended to measurement of ROI on training by mapping monetary value to the final gain (business impact).
Impact of Learnability on ROI on training: Learnability or learning effectiveness impacts each level of Kirkpatrick’s model, eventually helping you maximize ROI on training.
How does this really work to impact the ROI?
NOTE: Validation of the learning experience is important when it comes to determining ROI on training. As suggested by Keri Bennington of UNC Kenan-Flager Business School in a report, “ROI measures should be related to performance after the Learning and Development experience and, according to some, tied to a dollar figure. For example, time saved or increased output (or both) as a result of improved performance following participation in a development program can then be compared to a dollar figure.”
Yes, learnability or learning effectiveness of online courses can be measured but there are several challenges associated with this exercise:
In spite of the fact that measurement of learnability is a tall order, at EI Design, we offer a unique framework that you can use to predict, measure, and validate the Learnability of online courses (for new or legacy courses).
Our Approach: We began our exercise by looking at various building blocks of a course and how learners view them or interact with them. Using these cues, we created 6 metrics which map to each of these to help us evaluate the learnability or learning effectiveness as shown here:
Measurement: Our framework also allows you to dynamically assign the criticality based on the nature of the course, content, or learners. Then the aggregated Learnability Index is generated.
Take a look at an example of the Learnability Index of an existing course and how we upped it by enhancing it through our Learnability guidelines.
Validation: This can be validated by the learners and the feedback can be used to enhance the learning design further, if required.
Take a look at some reports that show how the course fared with learners (validation of the predictive learnability).
You can use our framework to predict the learnability of the courses you are developing. You can also use it to evaluate the Learnability of your legacy courses and then uplift it. Through our learnability framework, you will be able to:
With these, you will be able to have greater clarity on demonstrable gains for learners as well as the business and maximize your ROI on training.
Learning and Development teams can use our learnability framework to:
You can take a look at this video of our Webinar on How To Predict, Measure, And Validate The Learnability Of Online Courses for more in-depth insights:
I hope this article provides cues on how you can use our framework to measure and enhance the learnability or learning effectiveness of your online courses, how you can validate the predictive Learnability with your learners, and see if you are on target or what further measures will help you hit the bull’s-eye. If you have any queries on this, do contact me at firstname.lastname@example.org.
How Can You Measure The Learning Effectiveness Of eLearning Courses And Create A Positive ROI
Creative Instructional Design Featuring 7 Learning Strategies That’ll Work For You
How To Evaluate The Right Partner To Outsource Your eLearning Content Development