Sounds worth a try if you are interested in getting it going! I generally don't use Python but happy to provide advice on the core.matrix side

There is indeed a core.matrix based Clojure(Script) deep learning library in the works but we aren't ready to release it yet. Possible it may be ready for public consumption by March/April but no promises.....