To Learn More or Register: LinuxCon North America | CloudOpen North America
Back To Schedule
Wednesday, August 20 • 11:15am - 12:05pm
TSAR (the TimeSeries AggregatoR): How Twitter Counts 50+ Billion Daily Events in Real Time Using Open Source Technologies - Anirudh Todi, Twitter

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Twitter's 250+ million users generate over 50 billion tweet views per day. Aggregating these events in real time - in a robust enough way to incorporate into our products - presents a massive scaling challenge. In this talk I'll introduce TSAR (the TimeSeries AggregatoR), a robust, flexible, and scalable service for real-time event aggregation designed to solve this problem and a range of similar ones. I'll discuss how we built Tsar from the ground up, almost entirely on open-source technologies (storm, summingbird, kafka, aurora, and others), and describe some of the challenges we faced in scaling it to process tens of billions of events per day.

Survey this Session   


Anirudh Todi

Software Engineer, Twitter
At Twitter, Anirudh works on the Data Platform team. Anirudh and his team are chartered with processing and understanding the vast body of data that is generated by the operation of the Twitter platform. Their technologies are used to provide insights both to platform engineering... Read More →

Wednesday August 20, 2014 11:15am - 12:05pm CDT
Parlor C

Attendees (0)