Designing data collection tools for field training programs

A DFAT-funded delivery team from the University of Newcastle engaged Policy Performance to update and enhance their approach to monitoring and evaluation for field epidemiology training programs across PNG, Vanuatu and the Solomon Islands.
This sought to respond to program challenges associated with variable data collection tools across the program, limited ability to measure outcomes and little information about post-training workplace or health system impacts.
With 3 different training programs of varying lengths (3-month, 9-month and multi-year), bespoke data collection approaches were needed.
Policy Performance first re-designed a proposed data collection flow, in line with the New Kirkpatrick training evaluation model. This sought to assess training quality/effectiveness, personal growth, workplace impact and broader impact over time.
In line with the approved flow, we developed baseline and end-of-training surveys for program participants, plus feedback processes for workplace projects, including via engagement with supervisors. We also established alumni surveys to collect information over time - these sought to better understand career pathways and on-the-job impacts at routine 12-monthly datapoints.
We socialised the approach with program leaders in PNG and then tailored all tools to the three different country settings.
The engagement concluded with document handover, prior to the 2026 launch of the full training suite.

