- Home
- Evaluation Report
- The Evaluation Methodology
The Evaluation Methodology
The evaluation combines a variety of approaches to monitor program progress and impact, applying both quantitative and qualitative methods. Starting with the care workers, we have collected and analysed data to identify, who wants work, who gets work, and the employee’s experience.
How it works
Those who apply for work, and enter the Skills Hubs pipeline, provide a cohort of individuals, and data on their demographic characteristics and their progress through from enquiry to employment and retention. These data are analysed in several ways, giving a snapshot of those who are interested in work, a timeline of their progress (Sankey Chart see page 25), and an analysis of the factors that affect slower and faster progress through each program stage (Time to event analyses pages 29-46). Moreover, since the program is expected to result in faster progress, we have undertaken separate analyses for more recent data and data from earlier in the program.
Analysis Methodologies
Latent Class AnalysisWe have also used a statistical approach called Latent Class Analysis
which uses probabilistic methods to characterise major groups with
common characteristics. This approach provides insights into the major
“archetypes” of people who are applying for work (see pages 47-51).
Online SurveysTo gain a more in-depth understanding of the employees experience, we
have conducted online surveys for people who have been employed for
one month, and with follow-ups at three and six months.
InterviewsAdditional depth of understanding was gained through 10 care worker interviews. To gain insights from the employer perspective, we have invited care providers to participate in interviews which attempt to understand their views of recruitment and retention of care workers.
We have completed 14 interviews. We have also identified one provider who has agreed to be treated as a case study, providing a fuller view of their employment processes and their innovative approaches.
Interviews with the consortium members have been conducted throughout the program to catch the evolution of program activities, to assess progress, and identify emerging challenges and responses.
Those who apply for work, and enter the Skills Hubs pipeline, provide a cohort of individuals, and data on their demographic characteristics and their progress through from enquiry to employment and retention. These data are analysed in several ways, giving a snapshot of those who are interested in work, a timeline of their progress (Sankey Chart see page 25), and an analysis of the factors that affect slower and faster progress through each program stage (Time to event analyses pages 29-46). Moreover, since the program is expected to result in faster progress, we have undertaken separate analyses for more recent data and data from earlier in the program.
