for brave souls interested in exploring a possible remote log alternative to Kafka for XTDB, I think my S2 Log implementation is ready for testing. https://s2.dev/docs/concepts is a lightweight distributed log/stream abstraction backed by object storage (currently S3 or S3 Express) - conceptually similar to what Warpstream, Bufstream, Tansu, etc are doing, but not pretending to be a Kafka (yet). It's currently free for use while in preview and intended to be significantly https://s2.dev/pricing than things like MSK. You can currently only create basins/streams in AWS us-east-1, write round-trip latencies are on the order of 50-500ms depending on storage type, and there is currently a hard 1MB limit on tx record sizes. This is also my first foray into XTDB, Kotlin, and Gradle so I'm sure there are outstanding bugs and performance and reliability issues. Given all that, if anyone still wants to try it, it's available here: https://github.com/chucklehead-dev/s2-log It's published via Github packages at the moment, which is a little tedious to consume, but figuring out how to publish on Clojars or Maven Central for the first time felt like one side-quest too many.
oh god, I hope it works
@chuck.cassel just this morning we've just some folks asking about the potential for S2 as an XT log in our https://discord.gg/VrdbKc3R 😄 have pointed them at your impl