AISI Chem/Bio LLM Evaluations

Concepts

• research and development
• the ai safety institute’s large language model evaluation suite
• all biological evaluation research
• two main evaluation methodologies
• , human uplift study support and compliance evaluations
• aisi
• llm
• consultancy services
• dual use chemistry
• cb capabilities

Location

United Kingdom:

Description

The Department for Science, Innovation & Technology (referred throughout these documents as “DSIT” or the “Department”) wishes to commission a project to develop the AI Safety Institute’s large language model evaluation suite in relation to dual use Chemistry and Biology. AISI is looking to fund research to help the team develop and conduct evaluations on advanced AI systems related to CB capabilities. This includes supporting the development of two main evaluation methodologies as set out below. Please note, all biological evaluation research conducted by AISI will be based on peaceful applications of biology.

Total Quantity or Scope

An excerpt of the deliverables that the Supplier shall provide are: Supporting automated grader calibration, Human Uplift Study support and Compliance evaluations. Full details can be found in the Jaggaer Platform.

Renewal Options

This Contract may be extended by 6 months with both Buyer and Supplier approval

CPV Codes

• 73000000 - Research and development services and related consultancy services

Indicators

• Variant bids may be considered.
• This is a one-off contract (no recurrence)
• Renewals are available.

Other Information

** PREVIEW NOTICE, please check Find a Tender for full details. ** DO NOT APPLY DIRECTLY TO BUYER All submissions will be assessed in accordance with the Public Procurement Regulations that apply to this opportunity. Responses must be received by the date and time in the tender documentation; responses received outside of the deadline or not sent via the Jaggaer eSourcing portal will not be accepted or considered by the Contracting Authority further for this opportunity, unless a system outage is experienced, to which the Contracting Authority will advise upon accordingly. Interested organisations should ensure that they allow a sufficiency of time, prior to the deadline to allow all sections to be completed in full and any attachments to be uploaded. As a user of the Jaggaer eSourcing Portal you will have access to the Jaggaer messaging service which facilitates all messages sent to you and from you, as well as other messages and updates in relation to any specific tender event. Please note that any and all information secured outside of the messaging service, shall have no Legal Standing, merit or worth and should not be relied upon by any organisation submitting a tender response. Please note it is your organisations responsibility to access these messages on a regular basis to ensure you have sight of all relevant information applicable to this opportunity. The Contracting Authority expressly reserves the right: i. not to award any contract as a result of the procurement process commenced by publication of this notice; and ii. to make whatever changes it may see fit to the content and structure of the procurement; and under no circumstances as part of your organisations participation in this opportunity, will the Contracting Authority be liable for any costs incurred by any organisation as a result. If the Contracting Authority decides to enter into a contract with any successful organisation(s), this does not mean that there is any guarantee of subsequent contracts being awarded. Any expenditure, work or effort undertaken prior to contract award is accordingly a matter solely for the commercial judgement of your organisation in doing so. About UK Shared Business Services UK Shared Business Services Ltd (UK SBS) brings a commercial attitude to the public sector; helping our contracting authorities to improve efficiency, generate savings and modernise. Where UK SBS is not named as the Contracting Authority within the documentation, UK SBS will be acting as an agent on behalf of the Contracting Authority. Our broad range of expert services is shared by our customers. This allows our customers the freedom to focus resources on core activities; innovating and transforming their own organisations. For full details of our partner base please review the following link: http://www.uksbs.co.uk/services/procure/contracts/Pages/default.aspx