Prior Information Notice: Monitoring service

Statistics Finland is acquiring a cloud-based Machine Learning (ML) monitoring service to enhance trust and reliability in its machine learning operations. This service will complement an existing ML platform built on Azure Databricks. Objectives: Actively identify and manage degradation in ML models, ensuring high-quality and trustworthy outputs for official statistics. Support a growing community of internal users in their daily work, including statistics experts with varying levels of ML and data science experience. The service should either integrate directly with our existing Azure environment or, alternatively, be set up as a separate service within our own Azure tenant. In either case, the solution must ensure that no data leaves the desired geographic region (EU) and that all data security and protection requirements for potentially sensitive data are fully addressed. Scope of Acquisition: Licensing for a cloud-based ML monitoring service capable of initially supporting approximately 10 machine learning models, with scalability to accommodate an increasing number of models over time. Technical support and expert training for efficient platform use. Tools and metrics for: - comparing model predictions with realized ground truth results across a variety of ML problems (e.g. classification, regression) - monitoring various types of drifts in input data (e.g. covariate drift, concept drift, novel values) - evaluating model performance even in the absence of ground truth MARKET DIALOGUE AND REGISTRATION Please note that this document is not a Call for Tenders. This document serves as a Prior Information Notice, tenders or application for participation are not asked with this notice. All the information provided in this Prior Information Notice is preliminary and indicative prior information. The Prior information notice includes an invitation to a market dialogue, where all suppliers interested in the procurement have the opportunity to participate in a technical dialogue with the Statistic Finland. The purpose of the technical dialogue is to have a general level discussion about the subject of the procurement and its definition, as well as providing interested suppliers the opportunity to demonstrate their services. This Prior Information Notice does not bind the Contracting Authority to make any procurement based on this request. Participation to market dialogue does not in any way bind any party in a potential future Call for Tenders. Suppliers who refrain from participating in market dialogue are equally allowed to participate to the potential future Call for Tenders. The market dialogue initially consists of two sections: 1. Interested tenderers have the opportunity to demonstrate their service/product in one-on-one meetings, and 2. Written comments on draft tender materials before the possible publication of the Call for tenders. The first part of the market dialogue will be organized as one-on-one meetings, where interested tenderers (whom have registered to the market dialogue) will have the opportunity to initially demonstrate their service. The specific topics to be presented in the demonstrate session will be detailed in a separate invitation sent later. The second part is the written comment round of the drafts of the preliminary tender materials. The comment round will be organized via email, where preliminary drafts of the tender materials will be sent to all interested tenderers for comment. The procurement unit reserves the right to organize or not to organize the second part of the market dialogue. Interested suppliers are kindly requested to register for the market dialogue by 31.3.2025 at 10.00 (EET) via the following link: https://forms.office.com/e/jjxxQ7w9WG If a tenderer wishes to participate in the market dialogue after the aforementioned deadline, the extent of participation will be determined at the discretion of the contracting authority, taking into account the readiness of the tendering materials. All the information provided in this Prior Information Notice is preliminary and indicative prior information. Compensation is not paid for attending the market dialogue. PRELIMINARY TIMELINE - Market dialogue: April-May 2025 - Publication of the Call for Tenders: May 2025 - Comparison of the tenders: June-July 2025 - Procurement decision: July 2025.