If you need to provide reports as a condition of a grant reward, online learning management systems (LMSs) provide a giant benefit.
They provide metrics, gathered automatically, all the time.
If you have received a grant award, you are probably required to submit various reports so the funder can monitor your progress and performance. If that grant is for some type of capacity-building or training, you have a handy data source that makes your job easier.
Agencies that leverage insights on how program participants behave and perform can spend less time hunting and more time focused on their main goals.
The trick is to be systematic about it and know how to interpret the types of data that your learning system provides. Make sure that monitoring progress and behavior is part of your performance and progress reports.
This article walks through 10 reports that are essential for your requirements and also for knowing how well your online training program is going on a day-to-day basis.
10 Top LMS Reports
- Enrollment rates
- Logged in vs. completions
- Last login
- Learner progress
- Learner participation and engagement
- Total time spent in lessons
- Online assessments
- Certificates Earned
Your program may be tightly controlled, and you know exactly who is participating and when. Open-enrollment programs allow for less control, so a report that shows how many people enrolled will help you understand interest.
In the above example, you can see at a glance the vast difference between enrollment from month to month. May had very few compared to October.
That may be expected to you, for example if you do did a big promotional push in October. But if you didn’t, this report can help you look elsewhere for external influences that are affecting your registration.
Logged in vs. completions
It’s easy to focus on the successful completions in a course (see below section on certificates). If you compare that information to the number of logins, you’ll find some interesting trends.
If the numbers are even—good job! You’ve got great engagement from the beginning to end. If not, you can start to see deeper.
In this example above of the diversity training course, seven times the number of people logged in vs. completed. This tells you that many people started the course but dropped out before finishing. It’s a good idea to measure this so you can identify any barriers to completion. Sometimes this is poor alignment with participants (i.e., the wrong people are signing up for the course).
Looking at the last login date on a course will help you zero in on people who have disappeared. This is crucial for follow-up. A good practice is to check this at least once per week for ongoing courses.
Checking learner progress will reveal how far along completion they are. You can see which modules they’ve completed and if they’re moving at a rate you’re expecting. Looking at student specific usage lets you monitor each person’s performance so you can step in if you see anything unusual. This sort of report, when compared against others, can help you identify high performers vs. low performers.
Learner participation and engagement
Checking daily statistics to see who’s logged into the course can be helpful to show the busiest and slowest days. The above chart shows that in September, traffic spiked. It also reveals that Mondays, Fridays and Sundays are some of the highest trafficked. When those bars are low and are consistently dropping off, you might need to do some outreach.
Total time spent in lessons
Participants in your course need to be spending enough time in the lessons to benefit. If you look at the total time they’ve spent in lessons, you can get a great overview. The example above shows how long people are spending in each page and how many times each page has been accessed. The result is that you can assess how invested they are in the online course or if interest is lagging.
Online assessments are one of the best gauges of how much progress your participants are making and how well they’re performing. It’s best if you can issue a pre-course assessment and a post-course assessment so you can see the each person’s improvement (see Knowledge-gain below).
Assessments individually or collectively can also tell you if the information you’re delivering is being received the way you want it to.
Some of the best indicators for knowledge gain are pre-course assessments, post-course assessments and self-assessments, which should all align with the learning objectives you developed in advance. Ask participants the same questions before the training as after, and you’ll be able to see an increase or plateau of knowledge. If increase isn’t significant enough, it’s time to change something.
Knowledge-gain is an improvement percentage that is the ratio of positive change. How to Calculate Improvement Percentage from Sciencing has a helpful how-to.
Certificates are a powerful motivator for many employees, and they’re required for many healthcare training courses. Checking your LMS reports for how many certificates were earned—and by whom—can help you make sure you’re reaching your objectives.
With the work it takes to implement a training program, it can be difficult to find time and resources to evaluate the effectiveness of it. By ignoring how well (or poorly) your training program is engaging participants and making a difference in their work, you could be wasting time and money.
A learner satisfaction survey, even a simple one, can help you gather data on how much your participants value the training. Higher satisfaction equals higher engagement and success overall.
Some basic satisfaction questions you can add into your evaluations are:
- The facilitator answered all my questions.
- How would you rate your experience in this course?
- Which parts of the training are most useful in your job?
Make sure these LMS reports are included in your regular monitoring, bonus if you can schedule them to be delivered the week before you’re due to submit your grant report. Even if you don’t have a grant reporting requirement, still fold in these best practices so you know how your training is performing and make timely adjustments as needed.People vector created by vectorjuice – www.freepik.com