Streaming pipelines

This page lives in src/content/docs/pro-stream/ and therefore exists only under /pro-stream/. It needs no filter and no editions field — it was never shared in the first place.

Note that it is plain .md and still gets a diagram: d2 blocks are handled by a remark plugin, so they work in .md just as well as in .mdx.

Create a stream

koi stream create --name orders

Backpressure

Streams buffer in memory until the high-water mark is reached, then spill to disk rather than dropping messages or blocking the producer.

koi stream config orders --high-water-mark 10000