Evaluation scheme for the five transformative experiments
The TeRRItoria consortium elaborates a scheme to evaluate the five transformative experiments in four regions and in one municipality, as detailed by the project. By bringing together a wide range of stakeholders in the development and implementation of the five different experiments the project intends to address and mitigate territorial R&I challenges through the advancement of “Territorial RRI”.
The evaluation of activities is designed to assess the implementation of the experiments and their impacts produced throughout the project and use this knowledge to ensure a long-term sustainability of the experimental activities commenced. The assessment of activities comprises two distinct types of evaluations: formative and summative evaluation.
The former is an ongoing process evaluation which aims to assess the project’s international learning. It focuses on identifying enablers and barriers – as well as solutions to said hurdles – in the implementation phase of the different experiments. This evaluation is carried out as a mean to assist the territorial partners in their efforts to secure a timely and successful implementation of the experiments’ actions and initiatives.
On the other hand, the summative evaluation, takes place towards the end of the project and aims to asses the impacts of the experiments in terms of whether expected changes took place or not. It also provides knowledge about experimental actions in relation to what works, for whom it works, and the circumstances in it works.
The entire evaluation process is divided into three phases. In the first phase, called co-design phase, project partners will be encouraged to give a step-by-step rundown of their implementation plan, indicate which stakeholders should be involved in the process, and explain the kind of obstacles they are expecting.
During the second phase, or the implementation phase, project partners will discuss and evaluate whether and which obstacles they have been faced with and how the evaluation team can assist them to find a solution. These two phases are, in turn, divided into seven steps:
- Co-design phase
- Mutual agreement between partners on the evaluation objectives and research questions;
- Mutual agreement between partners on the process evaluation instruments/process in terms of data collection;
- Partner identification of operational success criteria/TE objectives/intervention logic and targeted beneficiaries.
- Implementation phase
- Data collection process (self-assessment questionnaires, document analysis <e.g. regional profiling>, and qualitative semi-structured follow-up interviews);
- Data analysis;
- Feedback to TE teams and stakeholders;
- Formative evaluation report.
In the third and final phase of the project, the post implementation phase, the teRRItoria consortium will need the data and documentation secured through the implementation phase in order to write the final summative evaluation by month 36. The data already collected throughout the project will be supplemented by follow-up interviews, on a need basis, to fill knowledge gaps and secure the collection of relevant information as well as a correct representation of stakeholder perceptions and reasoning of events, actions, and changes.
You can have a look at the evaluation scheme by clicking here.