Clojurians Log v2

Nice! I think I know what I'm going to be doing this afternoon (as soon as I get off this call with our vendor 🙂 )...

Looking forward to see what you do with this! And I am also curious what your next need for a Calva API will be.

@pez What is [z-joylib.editor-utils :as eu]? I tried following the ignore_form example but I get Could not find namespace: z-joylib.editor-utils

Ah, it's in a subfolder! Sorry...

@pez What if you are connected to multiple REPLs, what part of the API controls which REPL you are sending a form to?

Shouldn't you be able to query the currently open sessions and get a unique id from those to indicate where to send?

E.g. if you are simultaneously connected to a joyride, JVM and nbb REPL

From what I gathered the current design only allows for one clj repl and one cljs repl connection at one time cutting down the selection (for the moment) to "clj" and "cljs" which can be passed to evaluateCode as session key. Although im not quite sure if the joyride connection is treated as a normal cljs repl session 🤔

Yeah, currently, if you have the Joyride nREPL connected and try to invoke Calva's evaluate API, it'll execute it via Joyride.

I developed most of my script interactively via the REPL, but then had to switch back to my Clojure nREPL connection to run my new script completely, since it relies on executing in a Clojure JVM environment.

Nice!! I'll give it a spin today. I also wonder how should I detect which session key to use? Daily development has me connected to a deps.edn + shadow.cljs so I jump between CLJS and CLJ. I could probably use the filename extension for this, but not sure about cljc :)

Yeah, my life is way simpler for only doing Clojure, but I do sort of look forward to a time where I might be doing cljs again (after seven year break at this point).

It sure would be nice if Calva supported a) more than two possible REPL connections and b) automatically figured out the right REPL based on the currently-active editor 🙂

The other immediate need that comes to mind to do interesting things is having access to constructs like current form, top level form etc etc.

Yeah, I was a bit disappointed that it would not be easy to get "current form" -- executing paredit commands and trying to figure out ranges is way too messy. We need all of the substitutions that customREPLCommandSnippets can use, accessible as API methods.

My thoughts exactly. I think adding a few more top level APIs like get current session key, get the current/top level form as text etc etc would allow for interesting combinations. Presumably Calva could also use the same API to do what it does today.

Early days. This is just the first API -- and it's pretty powerful -- so I'm sure a lot more will follow 🙂

@borkdude, about the ”which session”. So what @alpox says, Calva only has two at most. See this old issue for a discussion around this: https://github.com/BetterThanTomorrow/calva/issues/76. So the unique id:s are clj, or cljs, (and also cljc, as it happens, which is an alias for either of those, that the user controls).

Sure would be nice if it had more than two and had a different ID for Joyride 🙂

I choose to decouple this API from the ”magic” of automatically figuring out which session should be used. Thinking that an API for querying this makes more sense. Also thinking that in a world where Calva supports more configurable REPL connections, this whole story changes and less magic will help then.

I'm all for "less magic".

As for API for getting snippet-variables. That's on my todo. For now to get e.g. the current form text, we can do something like this:

(defn top-level-form-text []
  (p/let [_ (vscode/commands.executeCommand "paredit.rangeForDefun")
          selection vscode/window.activeTextEditor.selection
          document vscode/window.activeTextEditor.document
          code (.getText document selection)
          _ (vscode/commands.executeCommand "cursorUndo")]
    code))

That's fine for top-level form. What about "current form"?

For my symbol/expression needs, "current selection" is OK since you really kind of need to specify just how much text (code) should be evaluated, but having all those "custom REPL command snippet" substitutions easily available would be awesome!

As it happens, I think all those calls are synchronous, so we get away without the promise. A more general function:

(defn text-for-selection-command [selection-command-id]
  (let [_ (vscode/commands.executeCommand selection-command-id)
        selection vscode/window.activeTextEditor.selection
        document vscode/window.activeTextEditor.document
        code (.getText document selection)
        _ (vscode/commands.executeCommand "cursorUndo")]
    code))

(text-for-selection-command "paredit.rangeForDefun")
(text-for-selection-command "calva.selectCurrentForm")

For some reason it doesn't work for "editor.action.selectAll", I don't understand why...

To find the command ids, an easy way is to use the keyboard shortcuts editor:

Indeed !

With that particular command you can recreate calva's evaluate-thread-to-cursor command. You'll have to close the form, of course. Calva has code for that. I guess that's a candidate for an API function as well.

So cool. I will spend some time today hacking with all this.

Awesome. When you start playing with the evaluateCode API and thus run into the limitations with Calva's REPL session managament, there's a recipe over at ClojureVerse for how to give yourself some evaluate code in Joyride commands: https://clojureverse.org/t/say-hello-to-joyride-the-clojure-repl-in-vs-code/8957/3?u=pez

Thank you for this:

(text-for-selection-command "calva.selectCurrentForm")

(my vsode-calva-setup has been updated)

Seriously, this is really f'ing amazing 🙂

An alternative to calva.selectCurrentForm, is paredit.sexpRangeExpansion, which in many cases does the same things, but if you run it an even number of times it can be used for selecting enclosing forms N levels up. You'll then have to shrink the selection back an equal amount of times, of course, (or Undo Selection, which is equivalent for this purpose.)

🤓

When exposing these as API function we'll not be using Paredit really, because those commands are very much the same as what you get with the executeCommand function. We'll need to expose the underlying TokenCursor (similar in concept to a rewrite-clj zipper) in some nice way. Will be quite exciting to see what people do with that one. It often gives me a feeling of unlimited powers using it. 😃

I'd be interested in ways to parameterize my two scripts to reduce duplication.

I know I could refactor to a "library script" in subfolder, like you have with z-joylib in the examples but that seems a bit artificial. Providing that sort of stuff directly inside Joyride itself seems reasonable, in terms of providing a Calva-specific ns that we can use.

Maybe a joyride.calva namespace with some of the common stuff in?

It's not a perfect fit in Joyride, I think. But Calva could maybe provide it somehow... Right now Joyride only has the user and the workspace script folders on its class path, But if we provide a way to add to the classpath, then a calva joyride library could live in the calva extension folder. WDYT, @borkdude?

Ah, so it would be automatically available if you were running Calva? Interesting.

I can imagine several calva.* commands being available as direct functions, to make life easier.

Hm yeah, that's interesting

It could be general, Joyride checks all extensions for if they provide a library and adds to the classpath.

That would be nice also for the portal extension.

This feels like boilerplate, for example:

(def ^:private calva (vscode/extensions.getExtension "betterthantomorrow.calva"))

(def ^:private calvaApi (-> calva
                            .-exports
                            .-v0
                            (js->clj :keywordize-keys true)))

(defn- evaluate [code] ((:evaluateCode calvaApi) "clj" code))

Even this:

(defn- selected-text []
  (vscode/commands.executeCommand "calva.selectCurrentForm")
  (let [editor ^js vscode/window.activeTextEditor
        selection (.-selection editor)]
    (.getText (.-document editor) selection)))

@pez Is it possible to determine the loading order of extensions? E.g. extensions could also actively register extra joyride namespaces

And maybe a higher level execute function for this:

(-> (p/let [code (clojuredocs-url (selected-text))
            resp (evaluate code)
            url  (edn/read-string (.-result resp))]
      (vscode/commands.executeCommand "simpleBrowser.show" url))
    (p/catch (fn [e] (println (str "Evaluation error: " e)))))

There's always a boilerplate/flexibility balance to strike

(joyride.calva.evaluate (clojuredocs-url (joyride.calva.select-current-form)))

@borkdude, so if Calva want's to provide a library it would rather tell Joyride that, than that Joyride checks Calva for it?

Yeah, potentially it could call (joyride.api/add-namespace 'foo.bar {'dude (fn [] :hello)})

but this would only work if joyride would be loaded before calva I guess

I think it might be. But Calva could also wait for it to be active before it does it.

Is there a hook in VSCode to wait for all extensions to have finished loading, or extension("joyride").ready(fn ...) or so

Not that I know of.

Doesn't mean there isn't one, of course.

We could also do it another way. Whenever a namespace is loaded, we first search the classpath and then all extensions, lazily.

calva
.-exports
.-joyride_namespaces
.-the_namespace_you_were_looking_for

@seancorfield if Calva can provide a library to Joyride, it could deffo be used to reduce boilderplate.

Another idea:

(require '["extension-name$namespace" :as calva])
(calva/evaluatecode "...")

And then Joyride searches within the extension-name exports for the namespace object (and treats this like any other JS library)

extension-name would be calva here for this example

So the full example would be:

(require '[""betterthantomorrow.calva$joyride" :as calva])

Yes, I think that is very similar to what I had in mind starting this discussion. Even if I was thinking it would be a joyride/cljs library rather than a JS one.

It doesn't really matter, but in the end, the extension exports a JS object, so we can just treat like a JS library. Then other extensions not written in Clojure can also contribute functions we can use in joyride

I think as it stands, you'd have to do:

(require '["betterthantomorrow.calva$v0" :as calva])

(calva/evaluateCode ...)

Yeah, I like that

I'm thinking more that it would work very similar to what we do with user and workspace scripts. It would basically be joyride wrappers around the extension JS api.

There is no need to wrap, imo. You can just require the functions from the extension and use them

Ah, there could be other reasons why you would want to wrap things though. Some things only make sense to Joyride and the general API is not a good place for that.

That is why you can select a certain part from the extension that is the specific joyride API:

(require '["betterthantomorrow.calva$joyride" :as calva])

I think it makes sense to have these functions as compiled JS so any extension can participate, not only those built with ClojureScript

E.g. one could make a TypeScript extension and functions from those could be used from joyride as well in this way

I don't think it would limit things to extensions written in ClojureScript. Calva is written mostly in TypeScript. Anyway, I opened up a discussion on the repo for this: https://github.com/BetterThanTomorrow/joyride/discussions/70

I already responded to https://github.com/BetterThanTomorrow/joyride/discussions/69 which a couple of points. One point you seem to overlook is that extensions can provide functions directly, not code that should still be interpreted.

It seems 70 is a duplicate, let's close that one.

Ah, Github gave me errors so I didn't realize I had opened #69. Will update that one then.

I know I replied to your comment on the #69 discussion, @borkdude, but now Github seems to be hiding them. It says 2 replies in one place, and 0 replies in another, and the latter seems to be what it is using. 😃

Very nice. Feel free to PR this to the joyride examples directory

Ah, good point! Yup, I'll clean it up and add more comments and send a PR, along with the clojuredocs.cljs that I just wrote.

(they are very similar)

I've updated my VS Code / Calva setup repo with these scripts for the time being -- https://github.com/seancorfield/vscode-calva-setup