clojureverse-ops

sb 2021-10-13T06:52:23.035700Z

Is it possible download the slack history db from somewhere? I would like to search eg in Aleph channel, is that possible? Yes, I know there is https://clojurians-log.clojureverse.org/ but I cant search there.

plexus 2021-10-27T08:52:52.002600Z

See also the explanation here @sb, out of an abundance of caution we don't make the raw logs public, although we have shared them with people at times if they seem to have a legit use case. https://github.com/clojureverse/clojurians-log-demo-data#why-dont-you-just-make-the-raw-logs-public

πŸ’― 1
plexus 2021-10-27T08:54:39.002900Z

I'm always a bit hesitant because even though I am the de facto steward of this data set, I don't really have any particular claim to it. Slack's position as far as I know is that the data belongs to the workspace owner and they can do what they want with it.

plexus 2021-10-27T08:55:09.003200Z

There are also some messages we have been asked to remove from the public archive, which we have soft deleted, so they are still in the raw logs.

πŸ’― 1
sb 2021-10-27T10:55:58.013100Z

@plexus Yes, that is True. I forget this case. But after preparation maybe it could be a good idea add to clojureverse a search field, but ok for me a vscode server like at Github (ok that could be more dev risk with bad setup). I’m just thinking about, I don’t know what is possible or not here.

1
plexus 2021-10-27T13:12:44.013900Z

@mitesh is working on full text search in the context of clojurists together funding

🍻 1
πŸ™Œ 1
seancorfield 2021-10-13T07:05:12.036400Z

@sb There's also the Zulip archive: https://clojurians.zulipchat.com/#narrow/stream/180378-slack-archive/topic/aleph

seancorfield 2021-10-13T07:05:31.036700Z

(which is searchable, but you'll need to sign into Zulip)

seancorfield 2021-10-13T07:07:17.036900Z

That goes back to Feb 1st, 2019 (which is likely when the Zulip Mirror Bot was added to #aleph)

sb 2021-10-13T07:16:02.039700Z

Thanks @seancorfield that is great info! @mitesh Yes I do that. Just, I thought much easier to search eg in Slack exports within vscode or any query

eval2020 2021-10-13T07:18:58.039900Z

Zulip has a great API as well. The following would be needed to get messages from a Slack channel:

http -a "${ZULIP_AUTH}"  anchor==196931776 num_before==5000 num_after==0 narrow=='[{"operand": "slack-archive", "operator": "stream"},{"operand":"beginners","operator":"topic"}]' | jq '.messages' >> messages.json
More info: https://clojurians.zulipchat.com/#narrow/stream/212578-pink-gorilla-dev/topic/Zulip/near/179136412

πŸ‘€ 1
sb 2021-10-13T07:21:20.041200Z

I dont know that, I check it! Thanks @eval2020!

oxalorg (Mitesh) 2021-10-13T06:53:43.035800Z

Hey sb! Not at the moment. But you can search for this on google:

websocket site:

oxalorg (Mitesh) 2021-10-13T06:53:59.036Z