102 . MOPAN 2017-18 ASSESSMENTS . UNITED NATIONS RELIEF AND WORKS AGENCY FOR PALESTINE REFUGEES IN THE NEAR EAST MI 8.4: Mandatory demonstration of the evidence base to design new interventions Score Overall MI Rating Satisfactory Overall MI score 2.67 Element 1: A formal requirement exists to demonstrate how lessons from past interventions have been taken into account in the design of new interventions 2 Element 2: Clear feedback loops exist to feed lessons into new interventions design 3 Element 3: There is evidence that lessons from past interventions have informed new interventions 3 Element 4: Incentives exist to apply lessons learnt to new interventions N/E Element 5: The number/share of new operations designs that draw on lessons from evaluative approaches is made public MI 8.4 Analysis N/E Source document The UNRWA Evaluation Policy states that fields and headquarters’ departments are required to take relevant evidence from evaluation into account when developing strategic response plans and annual work plans and that evaluation findings, recommendations, and lessons learned should be incorporated into decision-making processes in order to strengthen learning and accountability in the Agency with the aim of improving operations and results. There does not appear to be a specific mechanism through which this takes place, nonetheless, there appears to be a practice of ‘informal’ evaluation and reflection taking place across the organisation and this being used to inform decision- 70, 73, 105, 108, 131, 137 making. There is no evidence as to whether incentives exist to apply lessons learnt to new interventions or whether the number/share of new operations designs that draw on lessons from evaluative approaches is made public. MI 8.4 Evidence confidence Medium confidence MI 8.5: Poorly performing interventions proactively identified, tracked and addressed Score Overall MI Rating Highly satisfactory Overall MI score 3.5 Element 1: A system exists to identify poorly performing interventions 4 Element 2: Regular reporting tracks the status and evolution of poorly performing interventions 4 Element 3: A process for addressing the poor performance exists, with evidence of its use 3 Element 4: The process clearly delineates the responsibility to take action 3 MI 8.5 Analysis Source document At a decentralized level, UNRWA Field Offices track performance and identify poorly performing interventions through the quarterly RBM progress review. In the Jordan Field Office, for example, all departments are required to state planned actions to address areas identified as ‘behind plan’. These 6, 20, 23, 70, 73, 105, areas are shared with HQ as part of the QMR and actions points of QMRs are prepared and circulated 108, 131, 137 by PSO and reviewed in the next QMR. QMRs are aggregated across the field offices to produce the mid-year results reports, which features agency-wide action points, and which are also then tracked. MI 8.5 Evidence confidence High confidence