Loading…
This event has ended. View the official site or create your own event → Check it out
This event has ended. Create your own
To Learn More or Register: LinuxCon North America | CloudOpen North America
View analytic
Wednesday, August 20 • 11:15am - 12:05pm
TSAR (the TimeSeries AggregatoR): How Twitter Counts 50+ Billion Daily Events in Real Time Using Open Source Technologies - Anirudh Todi, Twitter

Sign up or log in to save this to your schedule and see who's attending!

Twitter's 250+ million users generate over 50 billion tweet views per day. Aggregating these events in real time - in a robust enough way to incorporate into our products - presents a massive scaling challenge. In this talk I'll introduce TSAR (the TimeSeries AggregatoR), a robust, flexible, and scalable service for real-time event aggregation designed to solve this problem and a range of similar ones. I'll discuss how we built Tsar from the ground up, almost entirely on open-source technologies (storm, summingbird, kafka, aurora, and others), and describe some of the challenges we faced in scaling it to process tens of billions of events per day.

Survey this Session   

Speakers
AT

Anirudh Todi

Software Engineer, Twitter
At Twitter, Anirudh works on the Data Platform team. Anirudh and his team are chartered with processing and understanding the vast body of data that is generated by the operation of the Twitter platform. Their technologies are used to provide insights both to platform engineering and to other teams throughout the company. They build a range of cutting-edge services that can process petabytes of data per month in real time for insights into the... Read More →


Wednesday August 20, 2014 11:15am - 12:05pm
Parlor C

Attendees (29)