calva

seancorfield 2025-05-11T02:56:44.209749Z

It is pretty wild to be to tell VS Code, via voice, to make a change to your source files, and then tell it to run the tests and fix any problems 🙂

seancorfield 2025-05-11T03:03:05.963899Z

OK, truly wild...

seancorfield 2025-05-11T03:10:35.451529Z

Then I had it refactor functions -- and it automatically updated the tests to reflect the changes, even tho' it had to make a couple of passes to get everything right... then it explained to me exactly what changes it made.

pez 2025-05-11T14:08:19.673679Z

Sometimes it changes the tests to make them pass. 😃

seancorfield 2025-05-11T14:40:50.676089Z

Well, I was asking it to make changes that I knew would break tests. What I'll try this week, is asking it to change tests to the new behavior I want, so tests fail, and then asking it to change only the source code to make them pass. But Kent Beck has some cautionary tales about attempting TDD with AI, so I don't know how successful that will be 😄

seancorfield 2025-05-11T02:57:50.582579Z

(took me several attempts to get Copilot / Claude 3.7 to understand how to do that -- initially it wanted me to run tests via the terminal -- but now I have it running via the REPL, it's pretty slick!)

Panel 2025-05-13T22:18:55.793509Z

You can give more instruction on tool use in copilot-instructions.md I told him to set the namespace to the relevant file we are working on when using the reply tool. Otherwise, by default, it's doing everything from user ns

pez 2025-05-11T14:06:03.612419Z

Keep us posted about how you prompt it and such. There is probably a lot of room for improvements in the tool descriptions too: https://github.com/BetterThanTomorrow/calva-backseat-driver/blob/master/package.json#L91

seancorfield 2025-05-11T14:45:15.755309Z

I was kind of flailing around a bit, and getting frustrated (at least the AI doesn't mind if you yell at it), so I wasn't keeping track of what worked and what didn't. As I try it out this week at work, I'll take more notes...