Learning-Oriented Real-Time Impact Assessment (LORTA)
In 2018, the Independent Evaluation Unit (IEU) of the Green Climate Fund (GCF) started the multi-year Learning-Oriented Real-Time Impact Assessment (LORTA) programme. The goal is to strengthen the capacity of accredited entities, implementing partners and project staff in assessing the impact of their intervention. Specifically, the LORTA team uses impact evaluation (IE) techniques —a specific type of evaluation based on causal inference—to help project teams understand which activities are working, which are most efficient and which approaches to scale up. Empirical evidence on impacts of climate-related projects is rather scarce, which enables LORTA to become one of the leading global programmes on impact evaluations of climate interventions.
LORTA stands on three pillars:
The LORTA programme takes two approaches in capacity-building:
- First, we help GCF projects develop and implement rigorous evaluation designs for their projects. Our annual design workshops offer training to participating project staff and stakeholders on how to develop comprehensive IE designs adjusted to their circumstances. We cover various topics in the field of evaluation, including the concept of counterfactuals, experimental/non-experimental methods, behavioural science, and the application of satellite data. During the workshop, participants are given the opportunity to think through the benefits of impact evaluation for their projects and assess the financial and administrative feasibility of this approach to establishing causal evidence.
- Second, we assist GCF projects in implementing the established IE plans, including those which focus on assessing behavioural interventions. Following each workshop, we onboard some of the participants into the LORTA programme and continue our engagement during the implementation of the established IE plans. Our technical services offered is demand driven and ensures ownership by project teams by strictly tailoring our service to their needs. Meeting the needs of accredited entities is made possible through frequent and close communication, helping to keep our vision aligned with both on-site staff and stakeholders alike.
The figure below shows the four phases of LORTA programme, detailing what happens once a selected GCF project enters the LORTA portfolio. The in-depth engagement spans from Phase I (deep-dive impact evaluation workshop) to Phase III (final impact evaluation analysis and results). Phase IV is optional and only a selected impact evaluation report that meets the academic standards can be considered and tailored for an academic publication, which helps disseminate the results broader and inform the academic community.
The LORTA programme has engaged with more than 50 GCF-funded project teams, all of whom have benefited from capacity-building sessions and technical assistance in conducting impact evaluations. 25 of these projects have been onboarded to the programme, equivalent to around 10 per cent of all approved GCF projects. LORTA currently has seven IEs in the engagement and design stage (Phase 1), seven in baseline (Phase 2), eight IEs in postbaseline stages (Phase 3), and one completed IE (Phase 4).
Credit: Martina de Vries and Carine Valarché
LORTA utilises some of the insights offered by the IEU’s Behaviour and Design Lab (BaD Lab) in terms of behavioural science approaches, including evaluating how behavioural interventions can enhance GCF investments.
- Evaluation report
Key documents
2018
- Synthesis Report Phase I 2018
- 2-page GEvalNote | Available in English, Spanish and Arabic*
- 4-page GEvalBrief | Available in English, Spanish and Arabic*
2019
2020
2021
2022
2023
- Inception Report Phase 2018 | LORTA Design Workshop in Bangkok, Thailand:
- Inception Report Phase 2019 | LORTA Design Workshop in Mannheim, Germany
- Inception Report 2020 | LORTA Virtual Design Workshop
- Inception Report 2021 | LORTA Virtual Design Workshop
- Inception Report 2022 | LORTA Virtual Design Workshop
- Impact evaluation report for FP002: Scaling up the use of Modernized Climate Information and Early Warning Systems in Malawi
- Impact Evaluation midline report for FP026 - Sustainable Landscapes for Eastern Madagascar
- Impact evaluation report for FP069 - Enhancing adaptive capacities of coastal communities, especially women, to cope with climate change induced salinity
- Sustainable Landscapes in Eastern Madagascar: Baseline Household Survey Report
- Impact Evaluation Baseline Report for FP073: Strengthening Climate Resilience of Rural Communities in Northern Rwanda "Green Gicumbi Project"
- Impact evaluation baseline report for FP087: Building livelihood resilience to climate change in the upper basins of Guatemala's highlands
- Impact evaluation baseline report for FP072: Strengthening climate resilience of agricultural livelihoods in agro-ecological regions I and II in Zambia
- Impact evaluation baseline report for FP069: Enhancing adaptive capacities of coastal communities, especially women, to cope with climate change induced salinity