Safeguarded AI: Theory

Concepts

• research services
• ai safety
• ai systems
• advanced ai systems
• other ai agents
• ai
• safeguarded ai
• an ai system
• safeguarded ai:
• safeguard

Location

LONDON

Description

ARIA is an R&D funding agency built to unlock scientific and technological breakthroughs that benefit everyone. We empower scientists and engineers to pursue research at the edge of what is technologically or scientifically possible. We reach across disciplines, sectors and institutions to shape, fund and manage projects across the R&D ecosystem, from startups to universities, to break down silos and discover new pathways. We're looking for proposals for Safeguarded AI: Theory, for info see https://www.aria.org.uk/programme-safeguarded-ai/

Total Quantity or Scope

As AI becomes more capable, it has the potential to power scientific breakthroughs, enhance global prosperity, and safeguard us from disasters. But only if it's deployed wisely. Current techniques working to mitigate the risk of advanced AI systems have serious limitations, and can't be relied upon empirically to ensure safety. To date, very little R&D effort has gone into approaches that provide quantitative safety guarantees for AI systems, because they're considered impossible or impractical. By combining scientific world models and mathematical proofs we will aim to construct a 'gatekeeper', an AI system tasked with understanding and reducing the risks of other AI agents. In doing so we'll develop quantitative safety guarantees for AI in the way we have come to expect for nuclear power and passenger aviation. Our goal: to usher in a new era for AI safety, allowing us to unlock the full economic and social benefits of advanced AI systems while minimising risks. For more info see https://www.aria.org.uk/programme-safeguarded-ai/

Renewal Options

Additional funding, scope and duration could be added to any contracts awarded.

CPV Codes

• 73110000 - Research services

Indicators

• Bids should cover the whole contract.
• Options are available.
• Renewals are not available.
• Professional qualifications are sought.
• Award on basis of price and quality.

Other Information

Detailed timelines can be found in the programme call information on ARIAs website: https://www.aria.org.uk/programme-safeguarded-ai/ The application process consists of one stage: - Submission of a proposal - the deadline for submission of proposals is 28.05.24 (12:00 BST). The total funding value is the estimated budget available. We expect to fund multiple applicants. Funding is anticipated to be award via both contracts and grants. For information on how we fund https://www.aria.org.uk/faqs-funding/