calva

knotschi 2025-08-13T09:11:35.167999Z

@pez is there a way to use the backseat driver to run the tests using calvas test-runner (e.g. command run-all-test) or are there plans / would it even be possible to add this to it?

Ludger Solbach 2025-08-13T09:29:00.178559Z

Add the test procedure to your copilot instructions. The models will use the REPL to run the necessary test on their own via run-tests. No need to use the calva commands here, IMHO.

Ludger Solbach 2025-08-13T09:30:15.972629Z

From my instructions of QClojure (copied from @pez, i think): Use the REPL for testing: 1. Load test namespace: (require 'namespace-test :reload) 2. Run tests: (run-tests 'namespace-test) 3. Test individual functions interactively

knotschi 2025-08-13T11:13:57.333729Z

thanks, that also works nicely! 🙏 I still see some small benefits if it could somehow use the calva test functions, e.g. • when running calvas "run all tests" it shows me icons in the ide which tests are fine (green checkmark) and which failed (red cross) • also if I ran the tests manually before, I could ask ai to do "run failing tests again" and then fix them step by step. -> basically it would make it more seemless to switch between manually running the tests and let ai do some work but probably not a priority feature ^^

pez 2025-08-13T11:39:28.821979Z

If you install Joyride you can tell the agent to use it for calling the Calva commands.

pez 2025-08-13T11:40:54.564709Z

I am not sure, but it may work to use VS Code’s built in test runner. For which Copilot has built-in tools.

pez 2025-08-13T11:42:42.341099Z

All that said, it may be that Backseat Driver should have a test tool. The reason being that then the agent doesn’t need to spend tokens/focus on getting the test runner code right.

pez 2025-08-13T20:02:09.067029Z

1