Clojurians Log v2

Hey folks - here's the first preview of the 2.2 line! 🚀 Main news here is that XT now runs with an elected leader for each database - that leader is responsible for the harder work of resolving the transaction's effects; followers can then play the results. If you've bought in to multi-db from 2.1, this means that the indexing work will be shared around the cluster. What's more important with this one is what it enables: • Read-only secondaries: nodes that don't contend for the leadership. This opens up using XTDB as a 'federated' database - connect to and query across other instances of XTDB just by opening read-only access to their shared storage. Then, coming up next: • Multi-partition databases: horizontally scale your writes. • External sources: I'm particularly excited about this one - the idea being that you can ingest data into XT from wherever it lives, without needing to turn it into SQL transactions first. We currently have a Postgres source in labs (it behaves as a Postgres replica); we're adding Kafka Connect support shortly - but the real win will be being able to write your own source connectors. Think XT as a projection of your event-sourced systems, perhaps - open up your event-streams via time-oriented queries. We've also been working on: • PG ecosystem compatibility (particularly Metabase and Grafana): the big reason behind us going with SQL/PG compatibility was to be able to use the ecosystem of tools that already exist for PG out of the box - this release improves that experience - check out their respective query builders against XTDB 🔨 • Arrow ADBC and Flight SQL support: think JDBC/ODBC but Arrow-native. Given XT stores all of its data in Arrow format already, this means that there's less serialization/conversion overhead over the wire between you and the database. • Operations and observability: metrics, tracing and logging - nearly all based on real-world requests from folks using XTDB in production, thanks! • Performance and bugfixes, obviously. As always, let us know how you get on, if you want to get more involved with the external source previews, or if we can help answering any questions 🙂 James & the XT Team