Fork me on GitHub
Slack Archive

This page is not created by, affiliated with, or supported by Slack Technologies, Inc.

2022-09-21

Channels

#xtdb
<
2022-09-21
>
tatut07:09:06

another regression in 1.22.0 it seems. 

java.lang.Exception: Transaction ingester aborted.\n\tat xtdb.node$await_tx.invokeStatic(node.clj:60)\n\tat xtdb.node$await_tx.invoke(node.clj:36)\n\tat xtdb.node.XtdbNode.await_tx(node.clj:158)\n\tat xtdb.node.XtdbNode.await_tx(node.clj:155)\n
...
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:833)\nCaused by: java.lang.AssertionError: Assert failed: LMDB write lock timeout\n(pos? stamp)\n\tat xtdb.lmdb$acquire_write_lock.invokeStatic(lmdb.clj:39)\n\tat xtdb.lmdb$acquire_write_lock.invokePrim(lmdb.clj)\n\tat xtdb.lmdb.LMDBKv.store(lmdb.clj:238)\n\tat xtdb.fork.ForkedKvIndexStoreTx.commit_index_tx(fork.clj:188)\n\tat xtdb.tx.InFlightTx.commit(tx.clj:356)\n\tat xtdb.tx$__GT_tx_ingester$fn__45494$txs_index_fn__45502.invoke(tx.clj:567)\n\tat
haven’t seen these with 1.21.0

tatut07:09:50

our node is linux running on aws ecs

tatut07:09:37

idk exactly what pattern of usage causes this, it happened after it had been running a long while

tatut07:09:17

then we started a new node which restored from checkpoint and it seemed to index transactions ok

jarohen08:09:19

hey @U11SJ6Q0K, thanks for the report. we'll see if we can get a repro here

tatut08:09:58

reported on github issue as well

jarohen08:09:36

spotted - cheers 🙏

jarohen09:09:40

@U11SJ6Q0K I've released 1.22.0.1-20220921.091757-1 (snapshot) for the xtdb-lmdb module, reverting the most likely culprit for this regression

jarohen09:09:15

unfortunately I'm just about to get on a plane, will see if we can get a root cause

tatut09:09:40

I’ll check it out, thanks

tatut10:09:52

can’t find this on maven central or clojars

Hukka11:09:13

I guess using git(hub) dep

tatut14:09:28

I’m not seeing any tags or branches either, and snapshot usually is maven terminology

refset15:09:25

You may need to configure the snapshot repository if you haven't done so https://github.com/xtdb/xtdb#pre-release-snapshot-builds

refset15:09:35

> I guess using git(hub) dep XT is still a lein project, so git deps aren't available as an option unfortunately

tatut15:09:53

ah yes, I didn’t have the pre-release repo configured

👌 1
tatut15:09:49

but I’ve downgraded back to 1.21.0 in the mean time, will do more testing locally and wait for fixes

👍 1