Impact Framework

Challenge

Our client, a government entity focused on employment and training, was seeking to mature their evaluation framework. Specifically they wanted to be able to clearly demonstrate their impact, and areas for continuous improvement, so that future funding could be justified using an appropriate data-driven evidence-base. Additionally, they wanted further development of skills and knowledge, enabling ongoing engagement and continuous improvement of impact measurement approaches. 

Solution

Smarterknowledge carried out a top-down analysis simplification of the client’s Theory of Change, and simultaneously did bottom-up analysis of geographic data, to create a practical and meaningful Impact Framework. Simultaneous top-down and bottom-up analysis meant the Theory of Change took into account whether there was data that could be used to demonstrate impact, and data reporting could focus only on the Theory of Change.  

A set of performance indicators were developed against the client’s key impact areas that could be used immediately (data exists now) or in the future (data needs to be collected). Critically this data was geographic, and enabled our client to identify what parts of Australia were achieving our client’s key impact areas, and what locations needed the most assistance. This was done by creating custom geographic indices made up of relevant geographic data (demographics, employment related data, education related data, etc.) and comparing that data with the client’s geographic activity (how they interacted with Australia through their various programs and services). This data was then visualised using our Commpact geographic platform.  

Result

The primary outcomes for our client from this engagement were: 

• The ability to confidently demonstrate impact 
• Confidence there is alignment between data collection, analysis and reporting with the strategic priorities of the organisation 
• A deeper understanding of the cause-effect relationships between program interventions and impact on targeted stakeholders 
• Ability to prioritise and more effectively target investment of capital or other program resources, and 
• Visually compelling presentation of data and impact for presentation to the Minister and departmental executives