Flutterby™! : Kafka is fast -- I'll use Postgres

Next unread comment / Catchup all unread comments User Account Info | Logout | XML/Pilot/etc versions | Long version (with comments) | Weblog archives | Site Map | | Browse Topics

Kafka is fast -- I'll use Postgres

2025-10-30 16:01:49.630586+01 by Dan Lyke 0 comments

Kafka is fast -- I'll use Postgres

Typically, you’d expect Postgres to run more expensive than Kafka at a certain scale, simply because it wasn’t designed to be efficient for this use case. Not here though. Running Kafka yourself would cost the same. Running the same workload through a Kafka vendor will cost you at least $50,000 a year. 🤯

Or: sure, you can get some more performance out of specialized databases, but development tools for Postgres are way way better, and hardware to run it on is generally speeding up faster than your grown and whatever additional performance under heavy load that the specialized solutions would get you.

Which... well... circa 2000 I was writing message passing and thread management code in C to process XML queries in a distributed database for an application that was, at the time, "web scale", single digit millions of authed queries per day, and saying "ya know, we could do this in Perl with PostgreSQL and..."

[ related topics: Web development Content Management Weblogs Perl Open Source Theater & Plays Writing Law Sports Databases hubris ]

comments in ascending chronological order (reverse):

Add your own comment:




Format with:

(You should probably use "Text" mode: URLs will be mostly recognized and linked, _underscore quoted_ text is looked up in a glossary, _underscore quoted_ (http://xyz.pdq) becomes a link, without the link in the parenthesis it becomes a <cite> tag. All <cite>ed text will point to the Flutterby knowledge base. Two enters (ie: a blank line) gets you a new paragraph, special treatment for paragraphs that are manually indented or start with "#" (as in "#include" or "#!/usr/bin/perl"), "/* " or ">" (as in a quoted message) or look like lists, or within a paragraph you can use a number of HTML tags:

p, img, br, hr, a, sub, sup, tt, i, b, h1, h2, h3, h4, h5, h6, cite, em, strong, code, samp, kbd, pre, blockquote, address, ol, dl, ul, dt, dd, li, dir, menu, table, tr, td, th

Comment policy

We will not edit your comments. However, we may delete your comments, or cause them to be hidden behind another link, if we feel they detract from the conversation. Commercial plugs are fine, if they are relevant to the conversation, and if you don't try to pretend to be a consumer. Annoying endorsements will be deleted if you're lucky, if you're not a whole bunch of people smarter and more articulate than you will ridicule you, and we will leave such ridicule in place.


Flutterby™ is a trademark claimed by

Dan Lyke
for the web publications at www.flutterby.com and www.flutterby.net.