The UNDP needed a partner with AI strategy and policy expertise to develop an online assessment tool that provides insights for a user into their country’s AI readiness. We carried out a rapid development, user testing, and iteration phase, involving UNDP stakeholders and policymakers. We developed the final version of the tool online with guiding materials. The tool has been piloted in three countries, and the UNDP uses it across engagements as a diagnosis tool and as a tool for beginning dialogue with government stakeholders on AI. 

The challenge

To complement its wider work on digital readiness, the UNDP wanted to develop an online assessment tool that provides users with insights into their country’s AI readiness. 

The tool needed to help users diagnose their country’s AI capacity, opportunities for AI to support national development goals, and gaps in areas such as strategy, governance, infrastructure, innovation, data and human capital. The UNDP also needed the tool to foster engagement across government and with public and private sector stakeholders.

Our approach

The Oxford Insights team partnered with the UNDP to develop its AI Readiness Assessment. It is an online tool that helps governments understand the AI landscape in their country and assess their level of expertise across sectors. The tool uses a framework that focuses on the role of governments as enablers, users, and stewards of AI. 

To develop the AI Readiness Assessment, our team first investigated the type of tool that would be most useful for both the client and users. We conducted a literature review of existing tools available across the public and private sectors and identified gaps where a new tool could be most impactful.

Once we had determined the shape and structure of the tool, we developed a first version of the assessment framework, composed of a qualitative and quantitative questionnaire. 

We undertook user testing with AI policymakers from five countries in order to observe their experience of using the tool, better understand the context in which it would be used, and to hear feedback. 

Next, we iterated our design for the assessment in response to this user testing. We developed a pilot assessment tool on an accessible online survey platform, and created communications and guidance materials for users. 

Our impact 

The UNDP uses the AI Readiness Assessment tool across its engagements with countries on issues of AI and digital development, both as a diagnosis tool and as a tool for engaging government stakeholders on the topics. The assessment has been piloted in three countries.

The tool is proving useful for countries at different stages of AI readiness. For countries at the beginning of the journey, it helps identify their current strengths and weaknesses to inform their AI strategy development. For countries who are already implementing their AI strategy, the assessment helps them to take stock of progress, track progress over time, and aids discussions about where further strategy, investment, and policy work is required. 

Grid image: Deborah Lupton / https://betterimagesofai.org / https://creativecommons.org/licenses/by/4.0/