Most learning and development measurement still starts and ends with completions, satisfaction scores, self-reported confidence and knowledge gain. These metrics offer some level of proof, but they rarely survive executive scrutiny, and for good reason: they measure activity, not impact.
Evidence of learning impact shows up concretely in observable workflow actions, decision-making and interpersonal engagements—leading signals that can move before lagging business metrics do. This article offers a practical approach to measuring behavior change with more rigor and leveraging artificial intelligence as an accelerator where it’s useful, so learning leaders can show real impact before business results fully materialize.
Why behavior is the hardest (and most important) layer to measure
No matter which measurement framework an organization uses—Kirkpatrick, Phillips, TDRp or LTEM—the pattern is the same. Basic utilization (completions) is fastest to capture and least connected to outcomes. Reaction, self-reported confidence, and knowledge gain come next. Behavior change sits farther up the framework. It takes longer to see and is harder to prove because it requires human observation or validation. That’s precisely why most organizations stop measuring there and wait for the lagging business metrics to eventually show up.
But behavior change deserves more attention, because it’s the layer where learning either becomes real or doesn’t. A completion rate tells you who has finished a course. It does not tell you whether they know what to do (knowledge), want to do it (will), can actually do it (skill) or whether the organization has created the environment for success (can), which includes the proper tools, processes and reinforcement. All four components have to be present before a new behavior shows up on the job. When results don’t appear, it’s tempting to conclude that people didn’t get enough training. Just as often, the real gap is that the environment around them never reinforced the new behavior.
This tracks closely with the distinction drawn in a recent Chief Learning Officer webinar we hosted on measuring learning velocity through activity and capability: more content, faster rollout and higher completion numbers don’t automatically produce faster capability and can even create the opposite (overload, slower decisions more hesitation).
Learning velocity, in that framing, isn’t how fast you launch training; it’s how fast the business gets measurably better at the work. And it only becomes visible through leading indicators—decision speed, confidence to act, willingness to experiment, reduced hesitation.
The maturity model behind the shift
In a live poll during the webinar, more than half of attendees said their organization still primarily tracks completions and participation. Why is that? Our “2025 Measuring the Business Impact of Learning Report” sheds some light on why completions and participation remain the dominant reporting metrics:
- 40 percent cite competing priorities as the primary barrier.
- 20 percent cite capability gaps in measurement skills.
- 17 percent cite data access challenges.
The pattern holds industrywide: Organizations aspire to measure beyond completion rates, but lack the resources, systems or operating model to do it consistently. We recommend using a measurement maturity model to assess a measurement practice across three categories: people, technology and process, each progressing from “emerging” to “mature.”
On the emerging end:
- Measurement lives with isolated specialists who have limited capacity and no real ownership beyond ad hoc advocacy.
- Standard LMS reporting and spreadsheets are built on traditional learning and utilization data analyzed manually.
- Processes around the measurement practice have little governance: Measurement gets designed around compliance or a learning objective, executed as a default set of learning metrics and used reactively, if at all.
On the mature end:
- A strategic leader owns the measurement practice, has resources that extend across the enterprise and is supported by specialists who are externally recognized thought leaders.
- Integrated and automated people, learning and business data enable AI to move past descriptive reporting into exploratory and predictive analytics that enable personalized learning.
- Full governance and standardization are in place, with L&D and the business collaboratively planning measurement initiatives annually.
Most organizations are on the emerging end of the spectrum. That’s not a criticism; it’s the reason this piece exists.
AI as an accelerator for measuring behavior, not just for delivering it
Behavior has always been hard to measure because someone had to watch it happen, like a manager running down an observation checklist or a coach sitting in on a call. Both approaches are slow, inconsistent and expensive to scale. AI now makes it possible to observe behavior at a scale no human team could match.
One practical example: a prompt to evaluate executive presence built for project managers. After completing training, which included a rubric for what strong executive communication looks like, participants could feed a recording and transcript of an actual meeting into any AI chat tool, along with the prompt. The AI evaluated communication style, message structure, audience engagement and executive presence against that same rubric, then returned individualized feedback.
What made the experience especially valuable was that it didn’t stop at the feedback. Participants could continue the conversation, asking questions tailored to their own learning needs, such as, ”How could I have phrased that differently?” Or, “What would executive-level communication sound like here?”
The result was personalized reflection, practice and skill-building. At the end of the engagement, the prompt would include a link to a brief survey that captured relevance and key takeaways, providing an additional source of leading-indicator data.
Nothing about this required a licensed platform, a custom model, or a vendor relationship. It’s a single, detailed prompt that can be copied, adapted and reused across teams. What it produces is
