EVALUATION

Evaluations seek to determine address one or more questions relating to whether, where, why, how and for whom an intervention is working. Evaluation projects are method-driven, with research designs most often tailored to investigate a set of key evaluation questions.

​

A rich body of academic research and theory drives the construction of research approaches across the evaluation field. The academic debates about evaluation practice confirm that there is no one-size-fits-all approach to conducting evaluations, with bespoke methods used to match the needs of each evaluation, taking into account budget, time and other constraints.

​

Policy Performance is well-placed to work with you to determine an appropriate evaluation approach and to conduct rigorous, robust and reader-friendly evaluation reports that triangulate information across multiple sources.

The following approaches may be used:

• Evaluability assessment: Determining whether a given intervention can be evaluated and advising on appropriate methods 

• Developmental evaluation: Working broadly with stakeholders during the rollout of a program, with the aim of promoting feedback loops and supporting adaptation of the program in real-time  

• Lapsing program evaluation: A structured evaluation approach, often conducted during the latter phases of a program's funding period, with the aim of identifying successes and areas for improvement

• Longitudinal evaluation: Evaluation conducted over more than one phase to determine changes over time

​

Policy Performance frequently uses the following evaluation techniques during its evaluation projects:

• Logic modelling: Helping to understand and visually depict the theory of change (program logic) and theory of action (implementation approach)

• Monitoring and evaluation frameworks: Developing a comprehensive monitoring and evaluation approach to be implemented across a given program, policy area or organisation, including data collection tools

• Surveying: Design, implementation and analysis of qualitative or quantitative (Likert) surveys

• Interviewing: Structured, semi-structured or unstructured (individual or group) stakeholder or fieldwork interviews

• Focus groups: Conducting facilitated forums with a small number of key questions for a selected sample of attendees

• Case studies: Developing place-based (e.g. in a school or region) or service-based (e.g. organisation or program area) summaries of practice into a short stand-alone writeup

• Literature review: Learning about different policy levers and approaches that could be used to achieve desired ambitions, and understanding the results of evaluations into these interventions

• Benchmarking: Comparing results between different locations, jurisdictions or countries

• Program data review: Analysis of program data, often to triangulate findings with primary research sources or for data visualisation purposes.

​

Policy Performance is engaged in the evaluation field via participation in the Australasian Evaluation Society (AES) and the University of Melbourne's Centre for Program Evaluation. Contact us to discuss all your evaluation needs.

​