aisi dsit offensive cyber capability and agent safeguards measurement

Concepts

• experimental development
• llm agent
• llms agents
• key capabilities
• an offensive cyber capability measurement
• dsit offensive cyber capability and agent safeguards measurement
• cyber
• aisi
• agents
• safeguards

Location

Description

this project is to identify and evaluate key capabilities that might pose dangerous risks from misuse by Creating an Offensive Cyber Capability Measurement by building on our existing work to create a series of structured non-public capture-the-flag scenarios that test for specific skills as well as sequential exercise that simulate an end-to-end attack. Building a suite of benchmark scenarios that characterize the vulnerability of LLMs agents to attackers whose goal is to bypass the built-in safeguards of the LLM system. By LLM agent, we mean an LLM system that has access to a selection of external functionality

Award Detail

CPV Codes

• 73120000 - Experimental development services

Indicators

• Contract is suitable for SMEs.
• Contract is suitable for VCOs.

Other Information

all redacted contract documents' are in this zip folder Redacted contract Documents https://www.gov.uk/government/organisations/department-for-science-innovation-an... n/a Complete_with_Docusign_Gray_Swan_DPS-Schedul (3) (3).zip