Twitter will transfer a few of its core infrastructure to Google’s Cloud Platform for higher information administration, the corporate has introduced.
“We are excited to announce that we are working with Google Cloud to move cold data storage and our flexible compute Hadoop clusters to Google Cloud Platform,” Parag Agrawal, Chief Technology Officer at Twitter, mentioned in a weblog submit on Thursday.
“This will enable us to enhance the experience and productivity of our engineering teams working with our data platform,” he added.
Hadoop from Apache is an open-source software program for organising Big Data.
The Hadoop compute system is the core of Twitter’s information platform, and the corporate runs a number of massive Hadoop clusters which might be among the many greatest on the earth.
“In fact, our Hadoop file systems host more than 300PB of data across tens of thousands of servers,” Agrawal mentioned.
Google Cloud Platform’s information options and trusted infrastructure will present Twitter with the technical flexibility and consistency that its platform requires.
The migration, when full, will allow sooner capability provisioning, elevated flexibility, entry to a broader ecosystem of instruments and providers and enhancements to safety.
“Architecturally, we will also be able to separate compute and storage for this class of Hadoop workloads, which has a number of long-term scaling and operational benefits,” the submit learn.
Adapted From: Gadgets360