PMY & Google Cloud Partnership
LIV Golf AWS Media Library migration to Google Cloud
Creating a pipeline to move data from AWS to GCP without losing a single file and maintaining zero interruption in services utilizing the underlying files. PMY created a testing suite before beginning the procedure to guarantee functionality.
The challenge
LIV Golf needed to migrate over 1 Petabyte of video and metadata data from a complex AWS file structure to Google Cloud Platform. A huge range of file types and sizes needed to be transferred over without losing any data. This data also needed to be re-integrated into a cloud based Media Asset Management (MAM) solution purchased through Google Cloud’s Marketplace once migrated.
The Solution
Created a fast and secure data transfer pipeline using Google Storage Transfer Service. In order to maintain data fidelity, manifest files were created. Once a manifest was created, it would get saved into a Cloud Storage bucket and the transfer of files would begin. BigQuery was used to match paths in the Cloud Storage bucket to S3, making sure files were transferred 1:1.
The Result
A successful migration. All files were moved without interruption or incident from Amazon S3 into Google Cloud Storage for all regions around the world (Hong Kong, Europe, both North America coasts).
Google Cloud allows LIV Golf to create a foundation to drive synergy and efficiencies across Google’s best-in-breed products, whilst accelerating success via Google’s top tier tech partners, including PMY.