Every year the size of the global big data market is growing. Analysing these data is essential for good decision-making. Big data technologies lead to a significant cost reduction with use of cloud services, distributed file systems, when there is a need to store large amounts of information. The quality of data analytics is dependent on the quality of the data themselves. This is especially important if the data has a retention policy and migrates from one source to another, increasing the risk of a data loss. Prevention of negative consequences from data migration is achieved through the process of data reconciliation – a comprehensive verification of large amounts of information in order to confirm their consistency.

This article discusses probabilistic data structures that can be used to solve the problem, and suggests an implementation – data integrity verification module using a Counting Bloom filter. This module is integrated into Apache Airflow to automate its invocation.

Cloud platforms and services have become an important factor in the explosive development of the digital economy in the last decade. The ability to quickly scale the service, coupled with a reduction in investment costs at the start of projects within the framework of the Iaas, PaaS, SaaS approaches, gave positive results and formed the basis of new business models and corporate solutions.

In this article, we discuss the reasons for the importance of multicloud and explore approaches to integrating cloud services in a multicloud architecture. The article also proposes a way to solve the problem of cloud migration - developing a system for migrating cloud resources between cloud services.