Presentation by Paulo Magina, Head of the Public Procurement Unit, OECD Public Governance Directorate, on the new maps: experiences from assessing public procurement systems, Tbilisi, 6-7 November 2019.

1. THE NEW MAPS:
EXPERIENCES FROM
ASSESSING PUBLIC
PROCUREMENT SYSTEMS
Paulo Magina
Head of the Public Procurement Unit
OECD Public Governance Directorate
3rd regional conference on public procurement
for ENP EAST Countries
Tbilisi, 6-7 November 2019

2. MAPS is…
2
• For all public procurement systems
• At any level of government and the public sector
• For any country, regardless of the level of development
UNIVERSAL
• To improve the effectiveness and efficiency of public procurement
• To ensure integrity and transparency in the use of public funds
• To encourage dialogue between stakeholders
A REFORM TOOL
• Using objective and comprehensive indicators
• Engaging various stakeholders
• Guaranteeing the highest standard through a quality assurance
mechanism
A RECOGNISED ASSESSMENT

3. MAPS complements other
assessment tools
Governments evaluate their economic and financial systems to:
• Ensure accountability
• Report to their constituents
• Identify opportunities for reform
• Monitor progress
MAPS –
procurement
TADAT – tax
PEFA – public
finance
Assessing
economic &
financial
governance
3

4. A flexible methodology for all
contexts
14 Indicators
55 Sub-indicators
4
MAPS can be seen as the international standard and
universal tool to evaluate any public procurement
system anywhere in the world.

5. MAPS suite
The MAPS Suite includes:
• MAPS core tool to assess the
procurement system as a
whole
• Guidance and templates to
support the assessment
• A quality assurance
mechanism ensured through
the MAPS Secretariat
• Supplementary modules to
focus and deepen the
analysis on a specific aspect
Supplementary
Modules
Sustainable
Procurement
Professionali
sation
E-
procurement
Sector
Level
Assessment
Entity Level
Assessment
Public
Private
Partnerships

6. Assessing the indicators in 3 steps
1
• Check quantitative assessment criteria
2
• Check qualitative assessment criteria
3
• Identify gaps against description in the MAPS
6

7. Gaps and red flags lead to
recommendations
Step 1: MAPS User’s Guide: “substantive or material gap”
• Less than substantial achievement of the criteria, essential elements
of the indicator are missing
Step 2: Gaps are frequent … but sometimes we raise the red flag:
• “factors likely to prevent appropriate action to improve the public
procurement system”
• Anything that could significantly impede the main goals of public
procurement
• Cannot be mitigated directly or indirectly
• Might be outside of public procurement: disagreement about
results, conflict with non-procurement laws or international
agreements conflict, external factors preventing improvement
7

8. The Assessment Milestones
8
Plan and
prepare the
assessment
Analyse
country
context
Assess system
and develop
recommendations
Validate
findings
Prepare
assessment
report
Quality
assurance
Publication
of
assessment
report

9. Main PP stakeholders to engage
Procurement
System
Employees
Stakeholders
Competitors
Unions Users
Contracting
Authority Contracting
Authority
Contracting
Authority
Contracting
Authority
Contracting
Authority
Public
interest
groups
and NGOs
Suppliers
Training
institutions
Financial
institutions
Judiciary &
criminal
enforcement
National and local
governments
Political
parties
Legislation
and policy
Supreme
Audit
Institution
9

10. 10
OECD supports MAPS
assessments on three continents
5 Caribbean
States
Brazil
Kazakhstan
Greece
Norway
Argentina

11. • Similar, but separate procurement systems for general
government and SOEs
• SOEs provide public services and conduct more
procurement than the government
• Assessment of the public procurement in Kazakhstan
as a whole: both government and SOEs
• Joint approach between many partners:
• EBRD
• World Bank
• IsDB
• ADB
Kazakhstan: with partners
towards a MAPS Assessment
11

12. 1(a) 4(a) 9(a) 11(a)
1(b) 4(b) 9(b) 11(b)
1(c) 5(a) 9(c) 11(c)
1(d) 5(b) 10(a) 12(a)
1(e) 5(c) 10(b) 12(b)
1(f) 5(d) 10(c) 12(c)
1(g) 6(a) 12(d)
1(h) 6(c) 13(a)
1(i) 7(a) 13(b)
1(j) 7(b) 13(c)
1(k) 7(c) 14(a)
1(l) 8(a) 14(b)
2(a) 8(b) 14(c)
2(b) 8(c) 14(d)
2(c) 14(e)
2(d) 14(f)
3(a) 14(g)
3(b)
2
3
12
6
13
7
14
8
Pillar I Pillar II Pillar III Pillar IV
1
4
9 11
5
10
MAPS highlights strengths and
identifies opportunities
12
MAPS in
Kazakhstan
Samruk-Kazyna

13. Our goal: Quality assessments
based in good practices
Clearly define
objectives
Ground the
assessment in
the country’s
context and
priorities
Involve relevant
stakeholders
Select a qualified
assessment
team, free from
conflict of interest
Rely on robust
evidence:
research, data
and information
Identify strengths
and weaknesses
Develop
actionable
recommendations
Follow-up on the
assessment
results
13

14. FOR MORE INFORMATION ON OECD WORK ON PUBLIC PROCUREMENT
OECD.ORG/GOV/PUBLIC-PROCUREMENT
14