Kafka is fast -- I'll use Postgres
2025-10-30 16:01:49.630586+01 by Dan Lyke 0 comments
Kafka is fast -- I'll use Postgres
Typically, youd expect Postgres to run more expensive than Kafka at a certain scale, simply because it wasnt designed to be efficient for this use case. Not here though. Running Kafka yourself would cost the same. Running the same workload through a Kafka vendor will cost you at least $50,000 a year. 🤯
Or: sure, you can get some more performance out of specialized databases, but development tools for Postgres are way way better, and hardware to run it on is generally speeding up faster than your grown and whatever additional performance under heavy load that the specialized solutions would get you.
Which... well... circa 2000 I was writing message passing and thread management code in C to process XML queries in a distributed database for an application that was, at the time, "web scale", single digit millions of authed queries per day, and saying "ya know, we could do this in Perl with PostgreSQL and..."