Last year, we spoke about our vision for the Observability data lake in my talk "How to Scale Observability without Bankrupting the Company". This year we have the system running in production with all of our trace data. This update will discuss some of our learnings, challenges and results putting all of our trace data into the system for Netflix.
I’ve been playing with OpenTelemetry in my spare time because of a general interest for my current role heading up Telemetry at Netflix as it appears to be gaining traction in the industry as a standardized way of collecting traces, metrics and logs for Observability. While experimenting I also came across Google Cloud Run, which…
At Outlyer, as a monitoring company, we rely on time-series databases (TSDBs) as a foundation for building a scalable and reliable monitoring solution. Over the past few years, we’ve gone through 3 iterations of our architecture as we scaled up with more metrics and more customers, and we haven’t always gotten it right. We’ve tested…
Back in December 2014, we had a team Christmas hackathon and I decided I wanted to make Java Monitoring really simple via our agent and integration plugins. At that time we were recommending new users monitor Java services using solutions like Jolokia, listed in this blog we wrote back then. It was frustrating that our…
In the past few weeks, we closed our seed funding round at Dataloop.IO, moved to new offices, hired 2 more people and did some PR to announce our funding round. In parallel our meetup group, DevOps Exchange, has now grown to become the worlds 2nd largest DevOps meetup group and we hosted our largest event…
Every company has struggled to control their Observability costs as the amount of data that needs to be collected, stored and queried in real time has gone up exponentially! In this talk, I share some of the innovations and strategies we've used at Netflix to ingest huge amounts of data while giving all our engineers sub-second queries, without bankrupting the company!
My first personal blog in years. I actually looked back through all my posts and find it interesting how so many of my opinions have changed in the last few years doing my 2nd startup, moving to America, becoming a father. I don’t think I would write a blog praising Marget Thatcher as much today…
Having moved to the US two years ago, my son Tagir now has to do annual science fair projects at school, which are a great opportunity for him to learn about the scientific method and how to run experiments and analyse data. For his 7th grade project this year, as he’s super interested in electronics…
A couple of weeks ago I did a talk at Hacker News London on the Story of Dataloop.IO and how we got our initial customers and traction using Customer Development. David Gideh – Using Customer Development to get Traction in a Crowded Space from HN London on Vimeo. In this talk I share: What we…
Artificial Intelligence (AI) is like Fusion, its always 30 years away. The dream of building computers that are as intelligent (if not more) than we are is still a long way off, but there have been some recent changes that make several experts in the field more bullish that maybe this time, it really is…