Task 6 - Assemble evidence | Australian Public Service Commission

Contents

The number 6 in bold black text on a white circle, surrounded by a navy blue circle, denoting task 6

Data is converted into knowledge through the process of assembling evidence. In learning evaluation, practitioners use a three step process to assemble evidence against evaluation questions:

Data analysis
Data synthesis, and
Development of recommendations.

Evidence assembly is informed by in-depth subject knowledge and understanding of context. It is supported by common sense, an analytical and curious mind, and a capacity to build a line of argument.

Data analysis

Data analysis involves organising and interpreting your data sets and considering their interrelationships. Data analysis begins when the identified data from your monitoring and evaluation plans begins coming through. You can then begin to form insights and hypotheses from this analysis and continue to explore.

Findings against evaluation questions can be displayed and summarised in ways that others can engage with and find useful. Only after data analysis has been completed can you begin to draw out meaning and form conclusions from the data that has been collected.

Fact sheet 10 in the handbook contains information about data collection methods for evaluation.

Data synthesis

Data synthesis sits at the centre of any evaluation. It is the process of combining evidence to form an evaluative judgement, and deals with values in a transparent way.

Performance targets and evaluation rubrics offer transparency as judgements of actual performance and are assessed against the performance of the initiative. Your earlier effort spent on constructing key evaluation questions and criteria of merit rubrics starts to pay off here.

Subsequent value-laden conversations about performance and your conclusions the initiative's merit demonstrate how well values have been understood and shared.

Fact sheet 7 in the handbook summarises KEQs and criteria of merit for evaluation.

Fact sheet 12 in the handbook provides examples of how evaluative judgements are made transparent.

Form recommendations

The final step of the evidence assembly task involves translating evaluation conclusions and judgements into a set of preliminary recommendations and lessons for adaptation and improvement.

Recommendations suggest a course of action for how to proceed in light of your evidence and conclusions. Your recommendations for further consideration need to be useful, feasible and carefully worded as they will attract scrutiny. Before they are finalised, recommendations can be incorporated in your draft report and discussed during facilitated conversations for organisational insights.

Fact sheet 13 in the handbook outlines good practice for developing recommendations.