This page is not created by, affiliated with, or supported by Slack Technologies, Inc.
2022-07-31
Channels
- # announcements (7)
- # asami (2)
- # babashka (47)
- # beginners (8)
- # calva (42)
- # clj-kondo (58)
- # cljdoc (1)
- # clojure (88)
- # clojure-europe (11)
- # clojurescript (6)
- # conjure (7)
- # data-science (5)
- # emacs (9)
- # events (1)
- # holy-lambda (3)
- # introduce-yourself (5)
- # meander (3)
- # missionary (4)
- # nbb (18)
- # obb (5)
- # off-topic (1)
- # other-languages (10)
- # pathom (2)
- # reagent (6)
- # releases (3)
- # ring (3)
- # scittle (1)
- # shadow-cljs (1)
- # spacemacs (2)
- # xtdb (6)
#babashka-neil v0.1.36 is out! Featuring @seancorfield’s deps-new behind the neil new
command. Also added neil add nrepl
for adding an nrepl alias.
An easy way to set up your Clojure project:
neil new --name foobar
cd foobar
neil add nrepl
clojure -M:nrepl
neil add test
clojure -M:test
neil add build
clojure -T:build uber
Thanks to @U0CLCL6T0 who added both new features
I’ve released version 0.3.1 of https://github.com/nathell/skyscraper, a framework for structurally scraping whole sites in Clojure. Get it from Clojars: {skyscraper/skyscraper {:mvn/version "0.3.1"}}
Changes in this release:
• Backwards-incompatible API changes:
◦ parse-fn
is now expected to take three arguments, the third being the context. The aim of this change is to support cases where the HTML is known to be malformed and needs context-aware preprocessing before parsing. Built-in parse-fns have been updated to take the additional argument.
◦ Cache backends are now expected to implement java.io.Closeable
in addition to CacheBackend
. Built-in backends have been updated to include no-op close
methods.
• Optimization: Skyscraper no longer generates indexes for columns marked with :skyscraper.db/key-columns
when creating the DB from scratch. There is also a new option, :ignore-db-keys
, to force this at all times.
• Skyscraper now retries downloads upon encountering a timeout.
• Bug fixes:
◦ Fixed dev/scrape misbehaving when redefining processors while scraping is suspended.
◦ Fixed scrape mishandling errors with :download-mode
set to :sync
.
◦ Fixed an off-by-one bug in handling :retries
.
◦ Retry counts are now correctly reset on successful download.
The Closeable
change is prompted by a new, experimental backend that stores cached pages zstd-compressed in RocksDB. It’s not yet available in Clojars (use deps.edn’s git deps facility), but you can preview it here: https://github.com/nathell/skyscraper-cache-rocksdb.
As always, happy scraping!


migratus 1.4.0 is out - as a tool to do data migrations for SQL databases and more, thanks @yogthos for the release: • new feature: Run basic tests against PostgreSQL using testcontainers • new feature: Circle CI matrix runner - run against multiple clojure and jdk versions • new feature: Circle CI junit reports, run tests with kaocha • bug fix: https://github.com/yogthos/migratus/issues/181 • enhancement: https://github.com/yogthos/migratus/issues/221 https://github.com/yogthos/migratus/blob/master/CHANGES.md
https://github.com/prestancedesign/usermanager-reitit-example - A little demo web app in Clojure, using Integrant, Ring, Reitit, Selmer (and a database).
• Now has build.clj
and uses tools.build
to build an uberjar