Fork me on GitHub
#clojureverse-ops
<
2021-10-13
>
sb06:10:23

Is it possible download the slack history db from somewhere? I would like to search eg in Aleph channel, is that possible? Yes, I know there is https://clojurians-log.clojureverse.org/ but I cant search there.

oxalorg (Mitesh)06:10:43

Hey sb! Not at the moment. But you can search for this on google:

websocket site:

seancorfield07:10:31

(which is searchable, but you'll need to sign into Zulip)

seancorfield07:10:17

That goes back to Feb 1st, 2019 (which is likely when the Zulip Mirror Bot was added to #aleph)

sb07:10:02

Thanks @U04V70XH6 that is great info! @U013MQC5YKD Yes I do that. Just, I thought much easier to search eg in Slack exports within vscode or any query

eval202007:10:58

Zulip has a great API as well. The following would be needed to get messages from a Slack channel:

http -a "${ZULIP_AUTH}"  anchor==196931776 num_before==5000 num_after==0 narrow=='[{"operand": "slack-archive", "operator": "stream"},{"operand":"beginners","operator":"topic"}]' | jq '.messages' >> messages.json
More info: https://clojurians.zulipchat.com/#narrow/stream/212578-pink-gorilla-dev/topic/Zulip/near/179136412

👀 1
sb07:10:20

I dont know that, I check it! Thanks @U04V6FEES!

plexus08:10:52

See also the explanation here @U2T2ZEVPC, out of an abundance of caution we don't make the raw logs public, although we have shared them with people at times if they seem to have a legit use case. https://github.com/clojureverse/clojurians-log-demo-data#why-dont-you-just-make-the-raw-logs-public

💯 1
plexus08:10:39

I'm always a bit hesitant because even though I am the de facto steward of this data set, I don't really have any particular claim to it. Slack's position as far as I know is that the data belongs to the workspace owner and they can do what they want with it.

plexus08:10:09

There are also some messages we have been asked to remove from the public archive, which we have soft deleted, so they are still in the raw logs.

💯 1
sb10:10:58

@U07FP7QJ0 Yes, that is True. I forget this case. But after preparation maybe it could be a good idea add to clojureverse a search field, but ok for me a vscode server like at Github (ok that could be more dev risk with bad setup). I’m just thinking about, I don’t know what is possible or not here.

bananadance 1
plexus13:10:44

@U013MQC5YKD is working on full text search in the context of clojurists together funding

🙌 1
🍻 1