Back Back Search
close

Search report

Impact_2

Ensuring real learning, real impact

In 2022 we established the Impact Office – our centralized hub for the design of processes to measure the impact of learning across our range of programs. The data gathered provides faculty, staff, and external stakeholders with actionable insights and recommendations for improvement.

When and how we Measure Impact

We measure impact at three points in time after the learning interventions. The first, the Immediate Impact survey, is conducted right after the program and measures the relevance, utility, and satisfaction of the program for participants. The data collected provides valuable information about their ability and motivation to put the learnings into practice once they have completed their training. The more lasting impact of learning will be actualized over the following months when participants are hopefully applying new knowledge and skills in their daily lives.

This we measure after four months with a second survey where we assess whether participants were able to apply their learnings in practice, achieve their learning objectives, and build confidence in themselves. We also ask participants to estimate the impact on their teams and organization in the areas of improved support, performance, and effectiveness. Additionally, we ask executives to reflect on whether the program led to a breakthrough change in their professional life.

Finally, at the 12-month mark, we ask another set of questions to evaluate the impact from a longer-term perspective. We ask participants to evaluate whether the program had an impact on their professional life and whether they were able to start new initiatives in their organization. We also aim to discover if participants were able to leverage some of their learnings to create an impact on society and/or the environment.

ImpactMeasurement-Timeline

Reflections, insights, and recommendations generate improvements and new ideas

Each survey produces a report, which is shared with faculty and clients. In many cases, the Impact Office provides aggregated reports for clients to draw insights and recommendations across several of their programs. For open programs, the Impact Office generates analysis and insights to recommend improvements or further development ideas. After the four-month survey, insights are also used in after-action reviews together with faculty and clients.

Impact in 2022

20,000 +

data points collected

+4-

month survey positive impact on effectiveness between 77% and 88%

43

reported ‘breakthrough changes’ in final survey

71

response rate to immediate survey

As the Impact Office develops and expands its activities in 2023, it aims to also develop custom impact evaluations for large custom program journeys and to improve response rates at all three survey points. The team will also look into extending impact measurement protocols from self-reported feedback to include managers, peers, direct reports, and other stakeholders.