Twitter shifts offline analytics workloads to Google Cloud
The platform hopes to process trillions of data points to gain insights much quicker


Google Cloud Platform has signed a multi-year agreement with Twitter that will see the social media company shift its offline analytics, data processing and machine learning workloads to Google’s Data Cloud.
The deal means Twitter will be able to more quickly process trillions of data points generated by every tweet, retweet and like send on its platform to generate insights that, in turn, can be fed into improvements to the core product.
Twitter's data platform currently consumes hundreds of petabytes of data and runs tens of thousands of tasks over a dozen data clusters each day. It previously struck an agreement with Google Cloud Platform as part of its ‘Partly Cloudy’ strategy in 2018, when the firm moved its Hadoop clusters to Google’s infrastructure.
With this expanded partnership, Twitter will adopt a number of Google services including BigQuery, Dataflow, Cloud Bigtable and machine learning tools. Ultimately, it’ll allow the firm to expand its data ecosystem and generate insights much faster, as well as allowing for deeper machine learning-driven innovation.
"Our initial partnership with Google Cloud has been successful and enabled us to enhance the productivity of our engineering teams," said Twitter’s CTO Parag Agrawal. “Building on this relationship and Google's technologies will allow us to learn more from our data, move faster and serve more relevant content to the people who use our service every day.
"As Twitter continues to scale, we're excited to partner with Google on more industry-leading technology innovation in the data and machine learning space.
Twitter is also hoping to ‘democratise’ data access by offering a range of data processing and machine learning tools to better understand and improve how Twitter features are used. Previously, engineers and data scientists developed large custom processing jobs, although these can now be queried faster using SQL in BigQuery.
Get the ITPro daily newsletter
Sign up today and you will receive a free copy of our Future Focus 2025 report - the leading guidance on AI, cybersecurity and other IT challenges as per 700+ senior executives
The partnership, generally, will make it easier for both technical and non-technical teams to study data generated from the usage of Twitter, and gain insights from these.
"Helping customers manage the entire continuum of data - from storage to analytics to AI - is one of our key differentiators at Google Cloud," said Google Cloud CEO, Thomas Kurian.
"It's been phenomenal to watch this company grow over the years, and we're excited to partner with Twitter to innovate for the future and deliver the best experience possible for the people that use Twitter every day."
Keumars Afifi-Sabet is a writer and editor that specialises in public sector, cyber security, and cloud computing. He first joined ITPro as a staff writer in April 2018 and eventually became its Features Editor. Although a regular contributor to other tech sites in the past, these days you will find Keumars on LiveScience, where he runs its Technology section.
-
Young tech professionals are shunning a full-time return to the office – unless it pays more
News Young tech professionals who entered the workforce post-pandemic expect on-site work to be paid more than remote options.
By Emma Woollacott Published
-
Google shakes off tariff concerns to push on with $75 billion AI spending plans
News Google CEO Sundar Pichai has confirmed the company will still spend $75 billion on building out data centers despite economic concerns in the wake of US tariffs.
By Nicole Kobie Published
-
Learning and operating Presto
whitepaper Meet your team’s warehouse and lakehouse infrastructure needs
By ITPro Published
-
Four ways AI is helping knowledge workers excel
Case Study From medical diagnostics to mining and exploration, many industries are using AI to make their workers more effective
By Sandra Vogel Published
-
How to help IT manage itself with autonomous operations
Whitepaper Using AI and automation to proactively adapt to business disruptions
By ITPro Published
-
Green Quadrant: Enterprise carbon management software 2022
Whitepaper Detailing the 15 most prominent carbon management software vendors to see if they fit your requirements
By ITPro Published
-
insideBIGData: Guide to energy
Whitepaper How big data can help energy companies manage intense disruption
By ITPro Published
-
Machine learning vs statistics: What’s the difference?
In-depth Both machine learning and statistics involve collecting datasets, building models and making predictions, but they differ in approach
By Jonathan Weinberg Last updated
-
Magic quadrant for master data management solutions
Whitepaper Informing your MDM solution choices
By ITPro Published
-
Kyndryl partners with Teradata to boost AI and data modernisation
News The new service combines Kyndryl’s data and AI expertise with Teradata’s cloud analytics platform to help customers migrate data to the cloud
By Daniel Todd Published