Bootstrapping a data platform infrastructure on Kubernetes
The goal of this article is to show how easily you can bootstrap a resilient, scalable, and budget-friendly data processing platform in the cloud with Terraf...
Posts by Category
- Kubernetes 6
- Data-Engineering 3
- Airflow 2
- Observability 1
- Containers 1
- Linux 1
- SRE 1
- Blogging 1
- Jekyll 1
- GitHub-Pages 1
- DevOps 1
- Cloud-Infrastructure 1
- AWS 1
- macOS 1
- Docker 1
- Developer-Experience 1
- Politics 1
- Tech 1
- Space 1
Kubernetes
Spark ETL with Airflow on Kubernetes — Part 2
Let’s talk about the pitfalls and inconveniences of Airflow.
Spark ETL with Airflow on Kubernetes — Part 1
Apache Airflow has become one of the most widely used ETL schedulers today. What I really like about it is that you write ETL pipelines in plain Python code....
Running Spark Structured Streaming on Kubernetes
There are many ways to process real-time data. At the company I work for, we use Kafka as our messaging service. Naturally, we first leaned toward Kafka stre...
Understanding the Docker OOM killer from inside a container
Recently I wrote an article about Datadog on Kubernetes. In that case, the Datadog jmxfetch Java process was killed by the host OOM killer because of JVM hea...
How to collect JMX metrics from Kubernetes deployments with Datadog
Since 2018, my team has been using Datadog to collect application-related metrics.
Data-Engineering
Spark ETL with Airflow on Kubernetes — Part 2
Let’s talk about the pitfalls and inconveniences of Airflow.
Spark ETL with Airflow on Kubernetes — Part 1
Apache Airflow has become one of the most widely used ETL schedulers today. What I really like about it is that you write ETL pipelines in plain Python code....
Running Spark Structured Streaming on Kubernetes
There are many ways to process real-time data. At the company I work for, we use Kafka as our messaging service. Naturally, we first leaned toward Kafka stre...
Airflow
Spark ETL with Airflow on Kubernetes — Part 2
Let’s talk about the pitfalls and inconveniences of Airflow.
Spark ETL with Airflow on Kubernetes — Part 1
Apache Airflow has become one of the most widely used ETL schedulers today. What I really like about it is that you write ETL pipelines in plain Python code....
Observability
How to collect JMX metrics from Kubernetes deployments with Datadog
Since 2018, my team has been using Datadog to collect application-related metrics.
Containers
Understanding the Docker OOM killer from inside a container
Recently I wrote an article about Datadog on Kubernetes. In that case, the Datadog jmxfetch Java process was killed by the host OOM killer because of JVM hea...
Linux
Understanding the Docker OOM killer from inside a container
Recently I wrote an article about Datadog on Kubernetes. In that case, the Datadog jmxfetch Java process was killed by the host OOM killer because of JVM hea...
SRE
Understanding the Docker OOM killer from inside a container
Recently I wrote an article about Datadog on Kubernetes. In that case, the Datadog jmxfetch Java process was killed by the host OOM killer because of JVM hea...
Blogging
Why I moved away from Medium to GitHub Pages
It has been more than a year since I last updated my Medium space. Unfortunately, Medium does not seem to be the right tool for me anymore. As a technical pe...
Jekyll
Why I moved away from Medium to GitHub Pages
It has been more than a year since I last updated my Medium space. Unfortunately, Medium does not seem to be the right tool for me anymore. As a technical pe...
GitHub-Pages
Why I moved away from Medium to GitHub Pages
It has been more than a year since I last updated my Medium space. Unfortunately, Medium does not seem to be the right tool for me anymore. As a technical pe...
DevOps
Bootstrapping a data platform infrastructure on Kubernetes
The goal of this article is to show how easily you can bootstrap a resilient, scalable, and budget-friendly data processing platform in the cloud with Terraf...
Cloud-Infrastructure
Bootstrapping a data platform infrastructure on Kubernetes
The goal of this article is to show how easily you can bootstrap a resilient, scalable, and budget-friendly data processing platform in the cloud with Terraf...
AWS
Bootstrapping a data platform infrastructure on Kubernetes
The goal of this article is to show how easily you can bootstrap a resilient, scalable, and budget-friendly data processing platform in the cloud with Terraf...
macOS
macOS is POSIX, they said. “It shouldn’t be too bad,” they said…
Disclaimer: this article is not only about complaining. I also hope to share a few useful tips for people working with MacOS.
Docker
macOS is POSIX, they said. “It shouldn’t be too bad,” they said…
Disclaimer: this article is not only about complaining. I also hope to share a few useful tips for people working with MacOS.
Developer-Experience
macOS is POSIX, they said. “It shouldn’t be too bad,” they said…
Disclaimer: this article is not only about complaining. I also hope to share a few useful tips for people working with MacOS.
Politics
Why Elon Musk Is Not a Genius — The Myth of Private-Sector Efficiency
The idea that the public sector is inherently slow and inefficient has fueled a common belief: wherever possible, government services should be handed over t...
Tech
Why Elon Musk Is Not a Genius — The Myth of Private-Sector Efficiency
The idea that the public sector is inherently slow and inefficient has fueled a common belief: wherever possible, government services should be handed over t...
Space
Why Elon Musk Is Not a Genius — The Myth of Private-Sector Efficiency
The idea that the public sector is inherently slow and inefficient has fueled a common belief: wherever possible, government services should be handed over t...