Treffer: Your server as a function

Building server software in a large-scale setting, where systems ex-hibit a high degree of concurrency and environmental variability, is a challenging task to even the most experienced programmer. Ef-ficiency, safety, and robustness are paramount—goals which have traditionally conflicted with modularity, reusability, and flexibility. We describe three abstractions which combine to present a pow-erful programming model for building safe, modular, and efficient server software: Composable futures are used to relate concurrent, asynchronous actions; services and filters are specialized functions used for the modular composition of our complex server software. Finally, we discuss our experiences using these abstractions and techniques throughout Twitter’s serving infrastructure.