Fork me on GitHub
#datomic
<
2016-12-02
>
karol.adamiec13:12:19

is a separate partition for audit logs a good idea? I can easily store that on S3 as well, but why wyould i want to do that? if in db i can easily retrieve, query etc interesting audit infromation. Separate partition would also help in log rotation? And as one can see i do not work on high volume system by todays standards 🙂

robert-stuttaford14:12:02

what would go in your audit logs that you couldn’t just put on your transaction entities directly, @karol.adamiec ?

karol.adamiec14:12:56

hmm, say user A tried to log in and failed on auth checks.

robert-stuttaford14:12:32

ok, so logging events for user gestures

robert-stuttaford14:12:40

then yes, a separate partition is a good idea

robert-stuttaford14:12:11

we do this, but not the partition. planning to re-build our db and put them into its own partition

karol.adamiec14:12:02

ok. if i ever need to rotate the logs (keep a year only) does partition give me any advantage?

robert-stuttaford14:12:34

in that case, you’ll want a separate database, and you’d make a new database every time you rotate

robert-stuttaford14:12:06

you don’t want to put lots of data in that you plan to take out later. datomic isn’t really designed for that

karol.adamiec14:12:47

yeah, most likely i will never need to rotate that anyway. It is not a huge system….

karol.adamiec14:12:03

separate partition seems like a good compromise for now…

karol.adamiec14:12:48

at least will keep audit/log noise out of user space.

karol.adamiec14:12:39

indexing is per partition as far as i understood

jaret14:12:37

@timgilbert Thanks for the catch! I will update

nooga16:12:17

Is it a bad idea to create identities while adding data? I have a case where I query external API that returns things like {:id “foo” :badges_collected [”badge_bar” “badge_baz"]}

nooga16:12:10

I know that the set of badges doesn’t change very often but there’s a lot of them and I don’t have a decent way of extracting them all. I want to express the badges as enum so I’d transact something like: [{:db/id … :entity/id “foo” :entity/badges [:badge/bar :badge/baz]}]

nooga16:12:46

And I would need to transact [{:db/id … :db/ident :badge/bar} {:db/id … :db/ident :badge/baz}] first for every entity I’m about to save.

nooga16:12:55

is that a bad idea?

bhagany19:12:26

@nooga I’m going from memory here, but I believe idents are cached on each peer, so the more you have, the more memory you use. That might limit you.

robert-stuttaford20:12:29

yep, and i think there’s a 32k limit on the overall count, @nooga and @bhagany

nooga20:12:09

yep, I know about the limit

nooga20:12:31

but I expect no more than 40 kinds of badges

bhagany20:12:44

ah, I wouldn’t worry about it then

nooga20:12:45

I just don’t have a good way of listing them beforehand

nooga20:12:52

so I wanted my DB to “learn them"

bhagany20:12:16

yeah, I think your transact-as-you-encounter strategy is fine for that low of a number

az21:12:44

Hi all, really want to get started with Datomic. Any good tutorials or books out that that I’m missing? What’s the best way to start learning this?

az21:12:52

thank you

glowzilla22:12:45

This is probably a n00b question… but I’m trying to use the new client and I’m having some issues. If I use the REPL packaged with datomic, the connection works great. However, if I use the REPL in my own project… It gives me the

#:cognitect.anomalies{:category :cognitect.anomalies/unavailable, :message "java.net.ConnectException: Connection refused”}
Anyone have a hint to what might be wrong?

gdeer8122:12:04

@aramz it wouldn't hurt to get a mentor for a few months to make sure you're on the right path. what things do you know about Datomic right now?

az22:12:42

@gdeer81 would love to find a mentor

az22:12:07

I have gone through the training videos on http://datomic.com

az22:12:21

going to go through the learndatalogtoday

az22:12:16

So I feel I have a grasp on the idea and basics, but it’s still rough for me on how to work this into the stack

gdeer8122:12:16

so the dev ops aspect of it?

glowzilla23:12:12

Figured out my issue. Client uses jetty9…. which means if you’re using a ring server it does not play nicely since it’s a non jetty9 version 😞