@mikethompson: should we refer to the lib as “re-frame” or “Re-frame”?

I've always called it re-frame

Ok.

greetings all. I would like an opinion on something. What do you do with large sets of data that are updated a LOT. I mean like 1 or more times per second and the list is over 1000 items long. updating that in app-db is not performant. pagination is an option but that only solves the rendering part, not the updating part.

It works "ok", surprisingly, but I don't want mediocre performance.

@jstew what's the slow bit ?

I have a stream of data coming in over a websocket that could have duplicates, so I have to dedupe and merge into app-db.

de-dupe against my large list.

Hmm... I wonder if I could just use a set.

and you can't use a set or map or something ?

I tried a map but that didn't help that much. It could be that my problem is elsewhere. Only presents itself when my data set grows large though.

I'll keep poking around. I'm making sure I didn't miss anything obvious.

so your local dataset is 1000s of items, and new items are arriving on the websocket at the rate of ~1/s ... and you need to dedup and add or update the new item in the dataset ?

one thought - is yr dataset sorted or something ? re-sorting could be killing your perf ?

It is sorted. Yes.

And has to re-sort when items come in.

perhaps you could use a sorted-map-by ?

I bet that would help a lot! I haven't ever used sorted-map-by and didn't even know it was baked into clojure.

i've never used it in cljs...

I'll give it a try in a bit. thanks for your help.