Fork me on GitHub
#datalevin
<
2021-11-18
>
sb19:11:44

Hello Huahai! Is there any limit at string length (as Datomic 4k)? or at any type? The “valueType” could be edn/blob.. or is that automatic (convert to blob)?

Huahai23:11:24

You mean in the Datalog DB? There is no limit in data size.

Huahai23:11:12

If you do not specify valueType, it is treated as EDN blob automatically

Huahai23:11:36

There’s no limit in the size of EDN blob. Realistically, it depends on your hardware

Huahai23:11:00

for string and bytes, it’s the same, there’s no limit

Huahai23:11:23

The only limit is LMDB key size, 511 bytes. But if you are using Datalevin as a Datalog DB, it does not concern you, the system take care of things for you. Using it a key value store, you will need to make sure the key is less than 511 bytes

👍 1
Huahai23:11:40

value size is unlimited

Huahai23:11:51

This also means the attribute name (right now, a keyword) needs to be less than 511 bytes

Huahai23:11:39

Datalevin is very good for storing large binary blobs, read/writes are both very fast.

Huahai23:11:26

In fact, it’s going to be faster than storing them as files, because context switch of system calls are avoided. Some machine learning people use LMDB for image storage for this reason, saving training time

👍 1