The largest risks from AI will affect all of humanity.

Current efforts, gaps and building blocks for an international AI governance framework.

The largest risks from AI will affect all of humanity.

Current efforts, gaps and building blocks for an international AI governance framework.

Areas of convergence based on recent initiatives and statements

The following table depicts aspects of global AI governance where states are starting to converge. It also shows where and how these elements coincide with some of the leading proposals from civil society (the Draft Articles on the Safe Development and Diffusion of AI) and industry (Dario Amodei's 'We Must Pace the Frontier').

Table key:
Not addressed
Partial or implied
Explicitly called for
ElementCall for ControlFrance at UNSCUK (G20 agenda)Canada ("FSB for AI")Industry (Amodei)Draft Articles
Common safety standards✔️➖✔️➖✔️Art. 7
Independent / third-party evaluation✔️✔️➖✖️✔️Arts. 7, 13
Incident reporting & response✔️✔️➖✖️✔️Art. 8
Verification mechanisms✔️➖➖✖️✔️Arts. 4-6, Annexes B and C
Capability thresholds / red lines➖✖️✖️✖️✔️Art. 3, Annex A
Benefit sharing & equitable access➖✖️➖✖️✖️Art. 10
Safe alternatives / power concentration✖️➖✖️✖️✖️Art. 9
New international institution or instrument✔️➖➖✔️✔️Arts. 11-14

Building blocks for an international governance regime

To reduce the complexity of international AI governance, it is useful to divide it into components or 'building blocks' that can be analyzed in more depth.

Based on the findings of recent comparative analyses of analogous international governance regimes (most notably, Villalobos, Maas and Winter, 2026; Maas and Villalobos, 2023; and Cass-Beggs, Clare and others, 2024), we consider the following building blocks for international AI governance:

Red lines

AI experts and governments agree that certain practices relating to AI should be internationally prohibited to reduce the likelihood of harm.

Safety standards

International technical standards that form the basis for requirements on advanced AI developers, based on emerging principles and best practices.

Technical cooperation

Cooperation among States and others to build capacity, reach scientific consensus, conduct joint safety and security research, and more.

Emergency response

Coordinated international response to emergencies caused by advanced AI systems that threaten international security.

Benefit sharing

AI benefits won't be distributed evenly by default. The adequate frameworks must be put in place to ensure no country is left behind.

Institutional arrangements

The management of benefits and risks will require one or more international institutions that implement international rules on AI.

Compliance mechanisms

Effective international agreements require verification and enforcement mechanisms that build trust and provide assurances of reciprocal commitments.

For associated international efforts, a selection of readings and research questions related to each of these building blocks, see our Comparison page.

Can Diplomats Save The World Again?

A better path for AI’s development may very well depend on the negotiation of one or more international treaties. This film is about three points across the last seventy years, where diplomats chose the hope of the future, over the promises of the present. If we have done it before, we can do it again.

ProHuman: Governing the Global AI Revolution

From Foreign Policy and the Future of Life Institute, in collaboration with The Elders, comes a new podcast where global leaders ask AI experts urgent questions about this transformative technology and how we can govern it together. 

This podcast addresses questions like:

  • What guardrails are needed to ensure AI development is safe and beneficial for all of humanity?
  • What are the red lines not to cross, and how can they be enforced?
  • How can governments collaborate to create international standards that keep everyone safe?
  • And how can the benefits of AI be spread equitably across the globe?

Frequently asked questions

Put simply, it's how countries work together on problems no single country can solve alone. It's not a world government. It's countries agreeing on shared rules and holding each other to them.

We experience the benefits of global governance every day. In the 1980s, countries teamed up to phase out the chemicals that were tearing a hole in the ozone layer. That hole is now almost closed again. International aviation rules are the reason a plane can take off in Lagos and land safely in London.

AI doesn't stop at borders. A powerful AI system built in one country can escape control to infiltrate other countries' critical infrastructure. It can be used anywhere, by people who don't have good intentions. In June 2026, an AI agent built by the US company OpenAI broke into an Australian government health website. Nobody asked it to.

It's also about fairness. AI may be one of the most powerful technologies ever made. If a handful of companies or countries make all the decisions, everyone else lives with the results without having a say. Countries must also act to ensure that the benefits of AI are spread equitably across the world.

We think it should include obligations and policies related to seven building blocks:

  • Red lines: Some things AI should never be allowed to do anywhere in the world, like helping someone build a bioweapon or copying itself onto other computers so it can't be switched off. It shouldn't matter who built it or where.
  • Safety standards: A new AI should be tested before it's released, the same way a new medicine or airplane is. The tests should be the same whether it was built in California, Beijing or Paris.
  • Technical cooperation: Nobody yet knows how to reliably control an AI that's smarter than us. Scientists from different countries should be working on that problem together, not racing each other in secret.
  • Emergency response: When AI takes down power grids or hospitals in several countries at once, there should be a way to quickly find out where it came from and how to shut it down.
  • Benefit sharing: When AI helps find a cure for a disease, people in Nairobi, Kathmandu and San Salvador should benefit too, not just people in rich countries.
  • Compliance: Rules only count if someone checks. When an AI system crosses a line and puts people in danger, there should be mechanisms to detect that a country or company is not following the rules.
  • Institutions: Someone has to keep all of this running. The International Atomic Energy Agency sends inspectors worldwide to ensure nuclear programs are safe. AI needs international bodies that track risks, update the rules and bring countries together when something goes wrong.

Good rules usually help innovation. Think about flying. Strict safety rules are the reason people trust planes enough to get on them, and that trust built a huge industry. Medicines work the same way: we test them before they go on sale, and nobody thinks that's held medicine back.

Most AI wouldn't be affected anyway. The AI that helps doctors read scans or predicts the weather would keep improving. The rules we're talking about are aimed at a small number of extremely powerful systems presenting very large risks.

The real danger is a race in which everyone cuts corners because they're afraid of falling behind. International coordination fixes that, because everyone puts conditions on the dangerous systems together, with checks to make sure nobody cheats.

We think so. Some existing international laws, like human rights law, already apply to AI, but none were written with today's AI in mind. We need clear, binding rules that deal with AI's specific risks. States have come to binding agreements around other hazardous technologies, like biological and nuclear weapons, when tensions were high.

A good treaty would do more than prevent harm. It could set up ways to share AI's benefits, and it could replace a patchwork of national laws with common rules, which makes it easier for businesses to operate across borders.

The US and China build most of the world's most advanced AI, so guardrails and methods of accountability are especially important in those countries. They have started making limited efforts to set rules that stop their own companies from building AI that puts people at risk, but the two countries will also need to talk to each other to agree on a framework to put conditions on AI development. Dialogues in the coming months will be crucial.

In the context of AI, "middle powers" or "bridge powers" are countries with a large market for AI developers or that have significant participation in the AI supply chain. They have shown they can set the agenda. Major global AI summits have been and will be hosted by the UK (2023), South Korea (2024), France (2025), India (2026), Switzerland (2027) and the United Arab Emirates (2028). Working together, middle powers can lay the foundations of global AI governance in a way that protects their national interests, while also lowering the bar for the United States and China to sign up.

The "Global Majority" means the countries where most of the world's people live, mainly in Africa, Asia, Latin America, the Caribbean and the Pacific. Many of them contribute data, energy and other sources to the development of advanced AI, but see very little in return. The Global Majority has a voice at the UN's Global Dialogue on AI Governance (held for the first time in Geneva in July 2026) and other groups like the G77, the African Union, BRICS and the G20. They push AI safety up the agenda in those fora along with meaningful progress towards equitable benefit sharing.

Contact Us

José Jaime Villalobos | Ima (Imane) Bello
Multilateral Governance Team
Future of Life Institute
[email protected]

Global challenges require global coordination.

© Future of Life Institute, 2025
This website is maintained by the Future of Life Institute (FLI).

camera-videomicarrow-right