EVALUATION
Evaluation broadly encapsulates all elements of evidence collection and analysis.
Evaluation involves systematic data collection to address questions relating to whether, where, why, how and for whom a given intervention is working. Evaluation projects are most often method-driven, with research designs tailored to investigate the areas of greatest interest.
A rich body of academic research and theory drives the construction of research approaches across the evaluation field. The academic debates about evaluation practice confirm that there is no one-size-fits-all approach to conducting evaluations, with bespoke methods used to match the needs of each evaluation, taking into account budget, time and other constraints.
Policy Performance is well-placed to work with you to determine an appropriate evaluation approach and to conduct rigorous, robust and reader-friendly evaluation reports that triangulate information across multiple sources.
The following approaches may be used:
-
Evaluability assessment (evaluation readiness review): Determining whether a given intervention can be evaluated and advising on appropriate methods
-
Developmental evaluation: Working broadly with stakeholders during the rollout of a program, with the aim of promoting feedback loops and supporting adaptation of the program in real-time
-
Lapsing program evaluation: A structured evaluation approach, often conducted during the latter phases of a program's funding period, with the aim of identifying successes and areas for improvement
-
Longitudinal evaluation: Evaluation conducted over more than one phase to determine changes over time
Policy Performance frequently uses the following evaluation techniques during its evaluation projects:
-
Logic modelling: Helping to understand and visually depict the theory of change (program logic) and theory of action (implementation approach)
-
Monitoring and evaluation frameworks: Developing a comprehensive monitoring and evaluation approach to be implemented across a given program, policy area or organisation, including data collection tools
-
Surveying: Design, implementation and analysis of qualitative or quantitative (Likert) surveys
-
Interviewing: Structured, semi-structured or unstructured (individual or group) stakeholder or fieldwork interviews
-
Focus groups: Conducting facilitated forums with a small number of key questions for a selected sample of attendees
-
Case studies: Developing place-based (e.g. in a school or region) or service-based (e.g. organisation or program area) summaries of practice into a short stand-alone writeup
-
Literature review: Learning about different policy levers and approaches that could be used to achieve desired ambitions, and understanding the results of evaluations into these interventions
-
Benchmarking: Comparing results between different locations, jurisdictions or countries
-
Program data review: Analysis of program data, often to triangulate findings with primary research sources or for data visualisation purposes.
Charlie Tulloch is a board member of the Australasian Evaluation Society (AES).
Contact us to discuss all your evaluation needs.