96 . MOPAN 2017-18 ASSESSMENTS . UNITED NATIONS RELIEF AND WORKS AGENCY FOR PALESTINE REFUGEES IN THE NEAR EAST
A number of the reports are ‘achievement-focused’ and do not systematically reflect on progress
achieved overtime in relation to intended targets. For example, the Annual Operational Report
presents the baseline, the target and the actual results achieved for each year but does not show
progress overtime. The Annual Health Reports report results achieved for that year, but do not present
targets. Emergency Appeal reports present actual results and targets but not baseline results. Reports
present to varying degrees analysis of the factors affecting results.
Each of UNRWA’s programmatic areas have specific logframes, and in some cases theories of change
1, 3, 7, 8, 11, 12, 31,
36, 37, 40, 44, 59, 60,
69, 76, 79 , 86, 92, 109,
141, 142
for UNRWA’s interventions. UNRWA’s Gender Strategy, for example, is supported by a corresponding
results framework aligned to the MTS which is reported on annually. Subsequent to its education
reform, UNRWA’s Education Programme incorporates policies and strategies into a systemic approach
which is monitored and reported on through multiple levels with universal education indicators within
the CMM, applicable to each of the five Field Offices, as well as field-specific baselines and targets.
MI 7.2 Evidence confidence
High confidence
MI 7.3: Results targets set based on a sound evidence base and logic
Score
Overall MI Rating
Satisfactory
Overall MI score
3
Element 1: Targets and indicators are adequate to capture causal pathways between interventions and
the outcomes that contribute to higher order objectives
Element 2: Indicators are relevant to the expected result to enable measurement of the degree of goal
achievement
3
2
Element 3: Development of baselines are mandatory for new interventions
3
Element 4: Results targets are regularly reviewed and adjusted when needed
4
MI 7.3 Analysis
Source document
There is evidence across the different programme areas (health, education) of a well-developed set of
indicators supporting agency wide tracking to higher order goals. However, the MTS is not underpinned
by an explicit theory of change and the extent to which the interlinkages between targets and
indicators for UNRWA’s individual strategic outcomes and the assumptions underpinning them are
articulated is not consistent across and between all outcomes. Although output-level indicators are
generally relevant, some of the indicators aligned to outcomes are more appropriate as output level
indicators. . In the case specifically of protection, Field offices report challenges in reporting against
these and the CMM has baselines and targets covering the percentage of UNRWA interventions on
protection issues that prompt positive responses from authorities and the degree of alignment with
UNRWA protection standards across all aspects of programming. This suggests that the targets and
1, 11, 12, 28, 35, 47,
70, 73, 86
indicators within the CMM provide a basis for seeing how progress at different points/ work streams
of the Agency contributes to a positive direction towards the higher order objectives of the Agency.
Baselines were established at the beginning of the 2016-2021 MTS for all CMM indicators (with the
exception of new ones) in collaboration with all Fields to ensure ownership and common. Results
achieved are reviewed with all Fields quarterly/six-monthly and annually with respect to performance
against the set targets, and baseline and targets are adjusted with documented justification (e.g.
Action plans) after discussion between Fields and HQ.
MI 7.3 Evidence confidence
High confidence
Select target paragraph3
Connect to a paragraph
Connect to an entity
Disable highlights
Add to table of contents