Learning Impact: Premise

Learning Impact

Why we care:

One of the most common questions we get is, “How can our learning function show impact?” Though the more useful question is “How can learning functions actually have impact?” the enduring nature of the question indicates learning functions feel pressure to tie learning to the business, using numbers. And a lot hinges on getting the answer right – not least L&D reputation and budgets.

Measuring the impact of learning has always been difficult. It requires measuring the knowledge and skills of individuals, and measuring how what individuals know affects the overall performance of the organization.

And it’s even more complicated today. Different types of learning methods, an emphasis on skills that aren’t easily measured with a multiple choice assessment, new tools that allow employees to dip in and out of learning at will, and a general recognition that learning also happens as a natural part of work, complicates the process of how to have (and show) learning impact.

And, unfortunately, the 20+ learning measurement models and the many thousands of articles written about ROI are barely helpful in this new reality.

Today, we’re launching a formal research project, sponsored by forMetris, into how organizations can (and more importantly, should) measure the impact of their employee development.

Hypothesis:

The premise driving this project is a simple one: Traditional mindsets and methods of measuring learning impact hobble the organization – not just the L&D function – the organization.

We must rethink how we show learning impact to account for new tools, metrics, data sources, and learning methods. This is a bold statement, we realize. Two quick examples to illustrate how what we’ve done is no longer sufficient:

Primarily measuring courses.

Almost all organizations (and every single learning measurement model we could find) use the course or initiative as the unit of analysis. We measure everything from what the course cost and how well people liked it to its return on investment, and perceived impact on business.

While measuring courses is our “safe space,”, it creates challenges. Among these: new types of learning are hard to isolate, particularly as learning becomes more integrated with the work itself. We no longer have complete control over the content, tools, and experiences that employees use in their development efforts. If we’re only measuring courses or initiatives that we are responsible for, we’re missing the myriad other things that impact employee development and readiness.

Measuring only courses or L&D initiatives shortchanges the organization by drawing focus away from a broader definition of employee development. This in turn keeps us from enabling key activities outside our direct control that could vastly increase the effectiveness of the workforce.

Over-focusing on conformity.

Back in the early days of the efficiency movement, Taylor established training as one of the most important things organizations could do to improve worker efficiency, as measured by output . Since then, organizations have been built with a focus on efficiency.

And L&D has been built to serve that focus: efficiently teaching employees to do the same tasks in the same way in hopes of realizing efficiency (productivity) gains. This approach no longer works (if it ever did). Most organizations tell us that innovation and agility are increasingly important in their increasingly competitive environments. Neither agility nor innovation are inherently “efficient,” which means L&D’s focus on developing an efficient workforce is disconnected from the workforce the organization now needs.

In a world where the half-life of a workplace skill is between 2.5 and 5 years , workforces must adapt to changing market conditions, often acquiring skills that we often aren’t aware of yet. Effective learning focuses less on making sure that employees learn the same things in the same way, and more on creating the right conditions so employees have the tools, content, and connections they need to move business forward.

The traditional mindsets and methods learning functions have used to show impact are inhibiting progress. How and what you measure matters – not just to L&D, but to the organization .

This Project:

This project will look at how organizations and thought leaders are rethinking learning impact. Specifically, we’ll be exploring the following topics:

This is a tough problem and we’re looking for people with strong opinions about it. As with all research projects, we’ll be taking a much more collaborative approach to this project. Specifically, we’ll:

Ask you to engage in the process. Throughout the project, there will be short polls, invitations for interviews and roundtables and other opportunities for you to offer your input. Please do! The more heads working on this problem, the better.

Publish our results as we go along. Instead of one massive report after 6 months of work, we will be sharing our findings throughout. Planned outputs for this project include the following:

  1.      *  Premise: February 2019
  2.      *  Lit Review Findings: March 2019
  3.      *  Interview Summaries: April 2019
  4.      *  Key Findings Infographic: May 2019
  5.      *  Final Report: June 2019

We welcome comments from the getgo! Please comment, share with others interested in learning measurement / analytics, tell us where we’re wrong, suggest people we should talk to!

Follow this project:

Follow this project to receive updates about new learning impact articles, surveys, and other content and calls to participate in roundtables, interviews, and webinars.

14 Comments
      1. Ken

        How is IP (Intellectual Property) dealt with for contributors? Will there be an “open source” type approach or how does that work ?

        1. Dani Johnson

          Hey Ken – good question. Yes, participation will be open sourced. We believe strongly in giving credit where credit is due – so any insights that are gained from others will be sourced as such.

  1. Elena

    Fascinating! I am especially interested in measuring knowledge transfer into work environment. If and how performance changed after the training? Did face to face training have more impact in comparison with e-learning? What would help people to remember and implement new skills in their everyday work.
    Very exciting to find answers to these questions.

  2. Bonnie

    This will be fun. We try to start with the business goals first (start with the end in mind), then backward to learner/performer outcomes, then to behaviors, then to what they “consumed” and traditional learning metrics. We also try to pull in as much “environmental” data as we can….stuff like manager-to-staff ratio and such (all based on hypotheses of the “other factors”). Anxious to learn what others are doing and what we learn from this project

  3. I wholeheartedly believe there’s facts, evidence and data for the impact of training and learning on performance, behavior, organization goals, and business strategy. I predict this research will be groundbreaking!

Leave a Comment

Your email address will not be published. Required fields are marked *