Fork me on GitHub
#datomic
<
2017-06-19
>
deg12:06:44

I'm trying to setup Datomic to use DynamoDB, per the instructions in http://docs.datomic.com/storage.html. Running ensure-transactor, I get an error ... is not authorized to perform: iam:GetUser on resource .... What permission do I need to set?

val_waeselynck15:06:41

@baptiste-from-paris Chose promise chose dûe: the blog post for selling Datomic to business stakeholders https://medium.com/@val.vvalval/what-datomic-brings-to-businesses-e2238a568e1c

timgilbert16:06:05

Hey, how do people generally handle automated backups for datomic? I was running cron scripts on the transactor but they've been failing from OOM errors

timgilbert16:06:00

So I'm considering firing up lambda or something to do them, or just having a periodic instance that spins up, does the backup (to S3) and then shuts down

kwladyka16:06:35

Do you know production systems based on free version of datomic? I want to do some small things when price of datomic is totally too high, but still i want to be familiar with datomic and use it, because it is the closest to Clojure. But maybe it doesn’t make sense, maybe i just should use postgresql.

marshall17:06:15

@kwladyka Datomic Starter is licensed for production usage. The only ‘limit’ with Starter compared to a full paid license is that Starter only comes with 1 year of updates/maintenance

spieden18:06:15

@timgilbert that’s roughly how we’re doing it. lambda running an ECS task though, as we’re all docker

spieden18:06:59

@timgilbert i can share our dockerfile and shell script we use for it if you’re interested

spieden18:06:35

datomic tools like to be called from the CLI, so wrapping in lambda might be tricky

timgilbert18:06:27

That would be great @spieden, would like to see them. I had some trouble dockerizing the datomic transactor in the past, but maybe if I just need the CLI stuff it will be easier

spieden18:06:05

we have the transactor dockerized and running stably on a t2.medium too if you want to see our stuff for that

spieden18:06:16

FROM java:8

ARG VERSION=0.9.5344

RUN wget --http-user=xxxxx --http-password=xxxxx  -O datomic-pro.zip
RUN unzip /datomic-pro.zip

RUN apt-get update && apt-get install -y awscli jq && apt-get clean

COPY entrypoint.sh /
RUN chmod 755 /entrypoint.sh

CMD /entrypoint.sh

spieden18:06:35

#!/bin/bash -ex

DDB_TABLE=$(aws cloudformation --region ${REGION} describe-stack-resource --stack-name ${STACK_NAME} --logical-resource-id ${LOGICAL_RESOURCE_ID} | jq -r .StackResourceDetail.PhysicalResourceId)
/datomic-pro-*/bin/datomic backup-db datomic:ddb://${REGION}/${DDB_TABLE}/${DATOMIC_DB_NAME} s3://${BUCKET}/${STACK_NAME}/$(date +%s)

timgilbert18:06:55

Awesome, thanks

timgilbert18:06:30

Don't you lose the incremental backup stuff if you're using a timestamp-based S3 URL though?

spieden18:06:03

yes i can’t remember exactly why we did it that way

spieden18:06:18

our db is pretty small and we use a bucket policy to remove old backups

spieden18:06:29

maybe we’re doing fulls because of the latter

timgilbert18:06:41

Ok, well thanks, I owe you a beer

kwladyka18:06:48

@marshall but i think free version is not time limited?

kwladyka18:06:01

ah but it use only memory…

kwladyka18:06:32

Can you confirm i understand it correctly?

marshall18:06:22

@kwladyka Yes, Datomic Free only supports ‘mem’ and ‘free’ storages; Datomic Starter supports all storages as well as memcached, HA, PeerServer & Clients

marshall19:06:22

@val_waeselynck Thanks for sharing the blog post - fantastic!

kwladyka19:06:20

Which exactly are “free” storages in datomic?

marshall19:06:45

“free” is local storage used by the free transactor

kwladyka19:06:50

local storage mean file?

marshall19:06:52

http://docs.datomic.com/storage.html#sec-4 << Similar to “dev” use in the Starter license

marshall19:06:01

yes, it uses local disk storage

kwladyka19:06:49

so anybody did something on production with free ver.?

marshall19:06:52

Yes, I believe we do have customers running in production with Free. Definitely with Starter

alexisgallagher23:06:35

marshall: yup. FYI, we run free datomic in production at http://topologyeyewear.com. This is mostly for operational simplicity at the moment, rather than b/c of economics. Our needs are light at the moment.

eraserhd20:06:18

Not sure if this is a good place to ask, but I'm wondering if there's any prior art - papers, etc, on pull expressions. Or if there's a correspondence with some kind of CS or mathematical object.

eraserhd20:06:31

This question is weird because I'm not really even sure what I'm asking for, obvs.

eraserhd20:06:27

Basically, curious about information lost when a graph gets dag-ified?

val_waeselynck20:06:39

@eraserhd probably not very academic, but you should definitely look into GraphQL

val_waeselynck20:06:29

@kwladyka happily running with Pro Starter, though I'm a bit embarassed to admit it 🙂

spieden20:06:44

also on pro starter but have a line item for a real license in next year’s budget =)

csm22:06:18

does the client api support transacting database functions?

csm22:06:22

I’m working on some edn files that are shared between apps that use the peer API, and some that use the client API, and my guess is that trying to read #db/fn literals is going to fail on the latter