xtdb

Stephen Castro-Starkey 2025-08-13T11:56:01.670359Z

Hey friends β€” contemplating an app rewrite at my current job and wondering if xtdb might be a good fit. One thing our customers require is the ability to run reports on their data from Snowflake. We currently have a sql server db whose data is synced into snowflake using FiveTran. Do folks think this kind of thing will be possible with xtdb2?

refset 2025-08-13T12:09:22.246089Z

Hey @stephen676 interesting, we haven't experimented with Fivetran before. In theory it would be ideal to be able to use the standard Postgres adapter, however we haven't attempted to implement logical replication / xmin CDC compatibility so it's not going to work out of the box. What kind of timescale are you working towards? We can potentially spend some time looking at the various other Snowflake integration options too. FlightSQL may be the better bet

jarohen 2025-08-13T12:12:58.220309Z

yep - I'd probably be looking at other methods of replication from XT -> Snowflake rather than a tool that's specific to Postgres's replication - we might be close to Postgres in a lot of ways but low-level replication behaviour isn't one of them πŸ™‚

Stephen Castro-Starkey 2025-08-13T12:37:38.198059Z

Yeah I was afraid of that. Especially in a schemaless world. Gonna look into FlightSQL! Thanks for the info!!

Stephen Castro-Starkey 2025-08-13T12:38:59.657669Z

As for timescale β€” this is likely a large-ish rewrite. 12-18 months until feature parity. But of course I’m trying my best to push back on kitchen sink syndrome. ☺️

Stephen Castro-Starkey 2025-08-13T12:40:40.027709Z

Given our budget and so forth we might have to settle for MySQL with bitemporal tables. πŸ€·β€β™‚οΈ

jarohen 2025-08-13T12:46:53.731099Z

the other avenue I might look into would be an XT Kafka connector that Snowflake could then read from - if it's a big enough project that requires it it's something we could raise up our prios

Stephen Castro-Starkey 2025-08-13T12:59:21.213359Z

I will keep that in mind!