CJS2_211 Copernicus Data Stores Modernisation

Concepts

• entrusted entity for the copernicus climate change service
• copernicus atmosphere monitoring service
• reading
• information technology
• copernicus data stores modernisation
• copernicus climate change service
• modernisation of the software infrastructure
• data stores
• implementation of copernicus climate change
• art data

Location

On Contractor's premises

Description

ECMWF, as the Entrusted Entity for the Copernicus Climate Change Service (C3S) and the Copernicus Atmosphere Monitoring Service (CAMS) invites tenders for the modernisation of the software infrastructure supporting the implementation of the services and for the evolutive maintenance of the current Climate Data Store infrastructure and toolbox.

Total Quantity or Scope

Climate (CDS) and Atmosphere (ADS) Data Stores are the core infrastructures supporting the implementation of Copernicus Climate Change (C3S) and Atmosphere Monitoring (CAMS) Services, providing access to essential state-of-the-art data, tools, applications and other digital information. Currently in operation but looking forward to cope with new challenges, evolving demand and a changing technological environment, the underlaying infrastructure requires further modernisation taking onboard operational experience, user feedback, lessons learned, know-how and more advanced technologies. The improved version will be made more accessible to embrace open-source scientific software and ensure compatibility with state-of-the-art solutions, such as machine learning, data cubes and interactive notebooks. In summary, the goal of the tendered work is to evolve the current Data Store and Toolbox infrastructure into a modern, more usable and interoperable infrastructure that will engage with a wider user community and will facilitate a stronger integration with related platforms, such as WEkEO, maximising shared capabilities and resources. The Data Store will be hosted in an in-house cloud infrastructure and shall be re-engineered as to maximise its capabilities by moving into a hyper-scalable container-based application. To reinforce usability and interoperability the portal will implement discovery, view and download services following standards as mandated by the European INSPIRE directive. The selected contractor will be required to guarantee a smooth transition to the new infrastructure, supporting the migration and adaptation of current catalogue content and applications. The tender includes a dedicated work package for taking over the maintenance of the current Data Store infrastructure until replaced by the new infrastructure. ECMWF will facilitate the conditions and required actions to assure a smooth transition of responsibilities and knowledge from the current contractor. The modernized data store will also integrate the supporting infrastructure for a Content Integration Management (CIM) tool and the implementation of the Evaluation and Quality Control (EQC) function. It will also host a dedicated, centrally managed repository for observations data with the aim to facilitate the integration and accessibility of this data by the different system functionalities. Work at all stages in the project will be done in close collaboration with ECMWF. Development will follow an agile methodology or equivalent, implementing a CI/CD (Continuous Integration and Continuous Development) approach. Technological choices will be based on existing open-source software, Python being the preferable programming language. The result of the work tendered will itself be released under an open-source licence. The architecture of the system will have to be open and extendable both in terms of the number of concurrent users, handled data volumes and number of workflows and tools. The ECMWF Copernicus Data Stores infrastructure will provide an operational service supporting heavy workload and will have to be closely monitored. Usage statistics will have to be collected to support informed decision making, reporting obligations and carry out capacity planning.

Award Criteria

CPV Codes

• 72000000 - IT services: consulting, software development, Internet and support

Indicators

• Bids should cover the whole contract.
• Renewals are not available.
• Staff qualifications are relevant.
• Award on basis of price and quality.

Other Information

Please note the important additional information in Section VI.3) regarding funding and eligibility. Procedure to be applied: The procurement for the contract will be conducted in accordance with ECMWF's procedures as set out in Invitation to Tender documents, which will be available on ECMWF's eProcurement Portal (http://procurement.ecmwf.int/) and no other procedures will apply. In submitting this notice ECMWF does not waive the privileges and immunities granted to it by virtue of its status as an intergovernmental organisation or submit itself to any jurisdiction. Tenders must be submitted using ECMWF's eProcurement Portal. Hard copy (paper) submissions will not be accepted. Due to the need to include performance and compliance obligations in the contract, ECMWF will contract only with a single legal person or entity which is competent to undertake and commit to these obligations. ECMWF recognises that some bids will involve a number of organisations which may wish to work together to deliver the contract requirements. In such cases, these organisations must identify a lead contractor who will sign the contract with ECMWF and who will be responsible for putting in place legal arrangements to ensure that it can guarantee that all other organisations will also meet the contract obligations. ECMWF will not enter into multiple contracts with individual members of consortia or groups of service providers. Availability of funds: The basis for ECMWF’s ability to implement the Copernicus Atmosphere Monitoring and Climate Change Monitoring Services on behalf of the European Commission is the conclusion of a ‘Contribution Agreement’ between the European Union and ECMWF. The negotiations are currently ongoing. They can only be concluded following the EU Space Regulation is enacted by the European Union. Suppliers should note that the award of a contract as a result of this procurement procedure will therefore be conditional on the availability of funds following the signature and subsequent formal approval of the “Contribution Agreement” by the ECMWF Council. This approval is currently expected for Q2 2021. General eligibility: According to the prospective Contribution Agreement between the European Union and ECMWF, participation in calls for tenders shall preferably be open to entities established in Member States of the European Union and to entities established in Copernicus participating states in accordance with the conditions laid down in the EU’s Space Programme Regulation. The Regulation can be found at https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=uriserv%3AOJ.L_.2021.170.01.... It is currently ECMWF’s expectation that, in practice, entities established in other States may therefore be eligible exceptionally and subject to specific scientific or other requirements as well as express prior approval by an EU Procurement Board. This applies to both prime and sub-contractors. Accordingly, ECMWF is required to reserve the right to exclude ineligible persons or entities from tenders at any point in time. All tenderers as well as their sub-contractors must meet all eligibility criteria throughout the whole duration of the procurement exercise as well as their prospective contracts. Eligibility of United Kingdom (UK) entities: The above applies also to entities based in the UK. At present, the UK is neither an EU Member State nor participating in the EU Space Programme. However, the UK and the European Union agreed — in principle — that the UK may continue participating in, among others, the Copernicus component of the EU Space Programme as a third country for the period of 2021-2027. Detailed conditions for such a participation will require further negotiations between the UK and the European Union. Further information may be found in the following link of the UK Government, for the accuracy of which ECMWF will not assume any liability: https://www.gov.uk/guidance/uk-involvement-in-the-eu-space-programme ECMWF will publish relevant updates in this regard once they are available.