Why Elon Musk Is Not a Genius — The Myth of Private-Sector Efficiency
The idea that the public sector is inherently slow and inefficient has fueled a common belief: wherever possible, government services should be handed over t...
Posts by Year
2024
2021
macOS is POSIX, they said. “It shouldn’t be too bad,” they said…
Disclaimer: this article is not only about complaining. I also hope to share a few useful tips for people working with MacOS.
2020
Bootstrapping a data platform infrastructure on Kubernetes
The goal of this article is to show how easily you can bootstrap a resilient, scalable, and budget-friendly data processing platform in the cloud with Terraf...
Spark ETL with Airflow on Kubernetes — Part 2
Let’s talk about the pitfalls and inconveniences of Airflow.
Spark ETL with Airflow on Kubernetes — Part 1
Apache Airflow has become one of the most widely used ETL schedulers today. What I really like about it is that you write ETL pipelines in plain Python code....
Running Spark Structured Streaming on Kubernetes
There are many ways to process real-time data. At the company I work for, we use Kafka as our messaging service. Naturally, we first leaned toward Kafka stre...
Why I moved away from Medium to GitHub Pages
It has been more than a year since I last updated my Medium space. Unfortunately, Medium does not seem to be the right tool for me anymore. As a technical pe...
2019
Understanding the Docker OOM killer from inside a container
Recently I wrote an article about Datadog on Kubernetes. In that case, the Datadog jmxfetch Java process was killed by the host OOM killer because of JVM hea...
How to collect JMX metrics from Kubernetes deployments with Datadog
Since 2018, my team has been using Datadog to collect application-related metrics.