GCP Data Lake Migration for Enterprise Data Capture Leader
Our client had workflows running on AWS and wanted to migrate them to GCP. The ultimate long-term goal was to save costs.
Specific business goals for our client included:
- Migrate from Cloudera and AWS to Google Cloud Platform
- Review existing workflows as well as document them
- Create a data lake for data processing and analytics based on the POC delivered by SoftServe
SoftServe began with a discovery phase for further research. Initially, our client expected to quickly move all workflows running on AWS to GCP. However the investigation proved that such a migration required significant work and couldn’t be completed in the desired timeframe. So the client decided to instead build a data lake on GCP from scratch.
Conducting further investigation to advise on different approaches using the best technolog y stack for production, the Soft Serve team built a template to migrate all the future data from AWS to GCP, which will bring a quick wins for the rest applications; as well as built key data lake components and ingested the first data sets. Specific technologies used include Firestore and Apigee.
Leveraging the data lake and template delivered by SoftServe, our client will save costs moving from AWS to GCP and will reach quick integration of their applications in order to gain key insights. SoftServe continues to advise our client regarding the automation of daily data syncs between AWS and GCP for defined business processes.