Description of the engagement
Reason for the request: We are looking for organisations that can perform an external evaluation of the Sharaka-II programme we are carrying out with Arab Supreme Audit Institutions. As Sharaka-II is a multiyear cooperation programme (2021-2026), the evaluation will result in several reports. The engagement concerns an mid-term evaluation of the regional cooperation projects and of the bilateral cooperation with SAI Libya and a final evaluation of all cooperation projects.

Context
The Sharaka-II programme consists of three successive regional projects and three bilateral cooperation projects. Its aim is to strengthen good governance, effective public service and robust financial management. In the Sharaka-II programme we are working with seven SAIs in the MENA region (Middle East, North Africa): Algeria, Iraq, Jordan, Libya, Morocco, the Palestinian Territories and Tunisia.

The first regional project has already been completed (June 2022 – June 2023). It involved a parallel performance audit relating to the sustainable development goals (SDGs), more specifically to SDG 11 (sustainable cities and communities). The Kick-off Conference for the second regional theme was held in Rabat, Morocco, in January 2024. This second regional theme will include parallel performance audits of SDG 6 (clean water and sanitation) and SDG 13 (climate action). A Mid-term Conference will be held in The Hague in October 2024. Completion of the second regional theme is planned for Q1 2025. A third regional theme will then be launched. The topic is still to be decided. Completion of this third regional theme is expected at the end of Q2 2026.

Besides the regional projects, the Sharaka-II programme includes three bilateral cooperation projects, with Algeria, Libya and Morocco. These projects consist principally of intensive, one-on-one knowledge-sharing, advisory work and audit support (specifically for performance audits). The bilateral projects cover a variety of themes, such as facilitating and organising training courses regarding audit of government policy (performance audits), communication and stakeholder relations, setting up internal training programmes and integrity training. These themes are agreed in consultation with the Arab partners based on
needs analysis.

About half of the regional activities have already taken place as we are at the mid-point of the second regional project. Planning of the bilateral cooperation differs from country to country. The bilateral cooperation with Algeria to support performance audit is nearing completion. The cooperation on communication and stakeholder relations is progressing according to plan. Cooperation on quality control and quality assurance is slightly behind schedule and is still at an early stage. The bilateral cooperation with Libya to support performance audit has been completed. Cooperation on integrity is progressing as planned. The communication and stakeholder relations component will begin in Q1 2025. This bilateral cooperation is expected to be completed in mid-2026. The bilateral cooperation with Morocco relates to training of trainers and IT audit/data analysis and will start this Autumn. Communication and stakeholder relations cooperation is on schedule. The bilateral cooperation with Morocco is expected to be completed by the end of 2025.

Activities
Planning of the bilateral projects is not standardised. This was a deliberate decision but requires a tailored approach to ensure the consistency of the evaluation findings and lessons.

A mid-term evaluation report of the bilateral cooperation with Algeria and Morocco is not required. Final evaluation reports were prepared for the cooperation with them during the Sharaka-I programme (2016-2021). They should be used as a reference framework for the final evaluation of the bilateral cooperation with these two countries. 

The current engagement therefore consists of six reports to be issued as follows:

Report 1: a final evaluation of the bilateral cooperation with Algeria;
Report 2: a mid-term evaluation of the bilateral cooperation with Libya;
Report 3: a final evaluation of the bilateral cooperation with Libya;
Report 4: a final evaluation of the bilateral cooperation with Morocco;
Report 5: a mid-term evaluation of the regional cooperation;
Report 6: a final evaluation of the regional cooperation.

The evaluator will be responsible for the organisation, performance, and reporting of the evaluation. The evaluator will prepare a project proposal setting out the applicable approach, criteria, and methodology. It will in any event include analyses of project proposals (including intended goals, activities and output results), workshop programmes, work reports, and other documents, and analyses of internal evaluations, interviews and/or surveys with relevant respondents, and baseline and outcome measurements. The final agreed findings will be presented with conclusions and recommendations/lessons in a series of final reports. For each report, the evaluator will be asked to give a presentation of the outcomes.

A terms of reference will be drawn up before the engagement is awarded (model terms of reference are enclosed). They will lay down the specific goals, criteria, and agreements for the evaluation. An activity will be organised in The Hague from 14-18 October where initial talks can take place in person. The engagement must be formalised by 30 September.

Evaluation criteria
Evaluation must meet at least the OECD-DAC criteria and cover the following aspects:
1. Relevance
2. Coherence
3. Effectiveness
4. Efficiency
5. Impact
6. Sustainability

These criteria are described in detail at:
http://www.oecd.org/dac/evaluation/daccriteriaforevaluatingdevelopmentassistance.htm

Certain specific issues also need to be addressed.
1. Describe the institutional position and capacity of the Sharaka partners as a baseline from which to measure the programme’s development in the period evaluated.
2. Assess the extent to which the project has met its stated objectives, taking into account the broader context within which the SAIs operate.
3. Assess the added value and impact of the project in terms of strengthening good governance, accountability, public financial management and effectiveness of public services in the participating countries.
4. Assess the sustainability of the project outputs and outcomes, and identify the key risks that might prevent a Sharaka partner continuing with its institutional
development programme. To what extent can institutional development be continued without the support of the donors and the NCA as institutional partner?
How high is the ownership of results?
5. Assess the project design and implementation (relevance, effectiveness and efficiency), including an assessment of the level of ambition and the effectiveness
of different working methods and different forms of support, i.e. peer-to-peer cooperation, working visits to the Netherlands, the kick-off and mid-term review
meetings, the nomination of ‘ambassadors’, etc.

Location of the activities
The activities will take place in both the Netherlands and the countries concerned. The actual location will be decided in consultation with the evaluator.

Required experience/expertise
Knowledge and experience of the public sector and supreme audit institutions, especially in an international context. Experience working in the MENA (Arab) region. Knowledge of the international standards of Supreme Audit Institutions. Demonstrable experience evaluating peer-to-peer cooperation in the public sector in an international setting. Broadbased knowledge and experience measuring the effectiveness of capacity building, knowledge transfer and change management (in a fragile context). Capable of making qualitative assessments with practical advice based on analyses of situations that are difficult to measure quantitatively. Excellent written English: documents and reports must also be sent in English to partner institutions and donors (Ministry of Foreign Affairs,
Netherlands Enterprise Agency).

Experience and expertise that are specifically requested must be demonstrated by a CV, references, and reports on previous projects.

Aanvullende informatie
Wanneer u bij ons als leverancier een professional aanbiedt en deze wordt geplaatst, hebben we informatie van u als contractpartij nodig, onder andere met betrekking tot de Wet keten- en inlenersaansprakelijkheid.
De ‘WKA’ heeft als doel om misbruik te voorkomen bij de afdracht van loonheffingen bij alle schakels in de keten; van leverancier tot opdrachtgever.
Wij dekken deze risico’s voor onze opdrachtgevers af middels een geblokkeerde rekening, de G-rekening.
Dit is een rekening waarop een gedeelte van het factuurbedrag wordt gestort en waarvan u de loonheffingen en BTW kunt betalen aan de Belastingdienst.
Het af te storten percentage hangt ervan af of u een SNA-certificering (NEN-4400-1 of NEN-4400-2) heeft of niet en of uw bedrijf in Nederland of daarbuiten is gevestigd. De G-rekening kunt u aanvragen bij de Belastingdienst.
Indien u geen G-rekening kunt krijgen (en u kunt hier bewijs van de Belastingdienst van overleggen) dan heeft u ook de mogelijkheid elk kwartaal een accountantsverklaring (assurance report inzake inlening personeel) aan te leveren.
Hierin zal een gecertificeerd accountant (AA of RA) een verklaring afgeven over de juistheid, volledigheid en tijdigheid van de afdrachten. Let wel, de kosten voor deze verklaring komen voor uw eigen rekening