Implications for learning and development
If AI is reshuffling organizational operations and skills, it means the learning and development function needs to adapt too. Here is how:
AI impacts the learning and development function in two ways: the function itself is changing (inside-out effect), and the function needs to help the organization learn and embrace the new technology (outside-in effect).
Traditional L&D has long followed the ADDIE model – Analysis, Design, Development, Implementation, and Evaluation – a structured approach involving needs assessment, instructional design, content creation, delivery, and measurement of outcomes.
Similarly, the Kirkpatrick evaluation model has been the standard for measuring learning effectiveness across four levels: reaction (participant satisfaction), learning (knowledge acquisition), behavior (application of skills), and results (business impact).
According to Kilshaw, AI is now completely reimagining these established processes.
“The traditional ADDIE model involves structured steps: interviews, focus groups, design, testing, RFPs, outsourcing, and ‘smiley sheets’ at the end for evaluation,” Kilshaw explains. “I’m building a system that instead takes curriculum documentation, throws it into a vector store, and uses an AI interface that tracks emotional context, frustration levels, and learning challenges in real-time.”
This approach transforms both content creation and measurement. “Instead of traditional learning models, you can hyper-personalize education, start new programs in an hour, and track learner progress individually,” Kilshaw notes. “This system has 50 measures of learner progress, including detecting frustration through mouse movements or voice tone.” The implications for learning evaluation are profound: “The whole idea of Kirkpatrick and four levels of learning evaluation has just disappeared,” Kilshaw asserts. “You can now continuously measure emotional context, learning efficiency, and change adoption in real-time, providing significantly more insight than traditional evaluations.”