Fork me on GitHub
#datomic2015-06-04
>
srihari06:06:02

robert-stuttaford: Hmm. Don't have pro at the moment.

srihari06:06:24

It's cool. I have a working solution. Was just wondering if there was a neat way to do it in a datalog query.

srihari06:06:33

robert-stuttaford: Thanks anyway simple_smile

robert-stuttaford06:06:18

i’m sure that Rich or Stu or one of the other cognitects would have an answer for you pretty quickly. the trick is to put it in front of them simple_smile

srihari06:06:25

Can someone invite them here? 😉

robert-stuttaford06:06:58

they’re busy people. they probably won’t show up in here

stijn07:06:52

@martintrojer: about your do’s and don’ts article: use dynamo. which other backends have you tried that failed?

martintrojer07:06:44

we tried PSQL (with many peer nodes) obviously doesn’t scale like dynamo

martintrojer07:06:13

wanted to make that clear to people trying to figure out datomic

stijn07:06:05

we’re intending to use cassandra since we’re running on google cloud

martintrojer07:06:10

any SQL store would show similar characteristics

martintrojer07:06:51

Yeah, we wanted to limit our infrastructure so introducing cassandra / riak would blow our devops budget

stijn07:06:04

the big string thing, ran into that too. indexing would take forever after storing enough raw xml in datomic simple_smile

robert-stuttaford07:06:19

how big were your strings, stijn?

martintrojer07:06:30

yeah, I have a feeling people are putting json blobs into datomic without knowing the limitations.

stijn07:06:34

ranging from a few KB to a couple of MB

stijn07:06:38

we’re putting them in cassandra now, and store the key in datomic

stijn07:06:56

you lose the ‘change detection’ of datomic though

martintrojer07:06:23

still kind of off-putting if you ask me. It’s very nice to dump big documents into PSQL JSON columns (and to be able to query into them)

martintrojer07:06:53

datomic needs to feature

martintrojer07:06:02

also, the for love of god give us query planning.

stijn07:06:10

i read somewhere it’s on the todo list 😉

stijn07:06:17

the blob thing

tjg07:06:53

If I read this example properly (don't have a few minutes to test) Datomic supports unbounded recursion: https://gist.github.com/stuarthalloway/2002582

robert-stuttaford07:06:56

nice tjg! @srihari , see tjg’s link

tjg07:06:26

Though I hear datalog always terminates on finite data... If it supports sufficiently powerful recursion and always terminates... then I'd think something's gotta give. simple_smile

srihari09:06:50

tjg, robert-stuttaford: thanks! Will take a look.

tcrayford12:06:46

@martintrojer: I've thought about writing a query planner for datomic a few times. A trivial one ain't even that hard (but obviously you can ramp up how good it is a whole bunch)

robert-stuttaford12:06:15

what would a planner actually do?

robert-stuttaford12:06:51

determine the best order for the clauses on the fly?

stijn12:06:40

that would be pretty awesome simple_smile

robert-stuttaford12:06:40

some orders will always be the same - e.g. when working from :in values to :find values

robert-stuttaford12:06:03

but sometimes changing the order of clauses in the middle makes a huge difference

arohner20:06:24

using the AWS transactor appliance, what is the recommended way to do backups?

arohner20:06:37

by default you can’t SSH in, or put files on the box, so do you modify the AMI, or something else?