Protector - a circuit breaker for InfluxDB
At trivago we store a subset of our realtime metric data in InfluxDB. We currently ingest 4 Mbit/s of incoming metric data and run hundreds of thousands of queries per day. Unfortunately it is pretty easy to overload the database or the clients by executing queries that return too many datapoints. Also deleting data and dropping a series are very expensive operations which should be prevented by default. That's why we wrote Protector - a circuit breaker for time series databases that blocks malicious queries. It's soon going to be released as Open Source.
At trivago, everything we do needs to scale to millions of monthly users. To achieve our goals, we need to come up with creative ideas for tricky problems. As a Backend Engineer working on Website Performance, I'm always looking for new ways to improve our core infrastructure. At the moment I containerize our web stack, extend our realtime monitoring and use Golang and Rust for internal tools. I like to ride my motorcycle, play guitar in Rock bands and drink hot chocolate.