During our Bay Area trip two weeks ago, we had the chance to chat with Ben Lorica, Chief Data Scientist of O’Reilly Media at the Ritual Roaster Coffee shop in the Mission in San Francisco. It turns out, what we did very much resonated with Ben who had recently become interested in alternatives to scaling, and single-server systems. He was kind enough to write this great blog post about streamdrill.
The last few weeks we’ve been working on extracting the real-time analysis engine behind TWIMPACT’s social media demos. The result is streamdrill which we’ve just launched in a beta version.
Streamdrill is a real-time event processing engine which solves the top-k problem. You can pipe in up to several 10k events per second and instantaneously query the most active entries over the past minute, hour, day, or week.
If you’re interested, we’ll spin up a small instance for you to play with.
We already have clients in Python and Scala available here.