Fork me on GitHub
#ai
<
2023-04-25
>
paul.legato19:04:34

The narrower the domain, the fewer examples you need. Training an assistant narrowly scoped to “Clojure code” would be far less burdensome to set up than a general purpose assistant. Wild guess — I’ll bet it would already be significantly useful just training it on the chatlogs and whatever Clojure code happens to be on GitHub, if not perfect.

john20:04:32

So there's probably two kinds of code assistants here. 1. A conversational, peer programming code assistant 2. A linting, code completion assistant

john20:04:02

We'll probably want both, because the conversation one probably won't need to be as fast as the completion one

john20:04:39

I bought the GPT copilot thing and just the code completion is worth it

john20:04:26

For good conversational peer programming, from what I'm reading about current open source models, you'll have a hard time getting human-like creativity out of a sub-50B model. But perhaps the code completion bot could be one of these 7B models fine tuned for code.

john20:04:21

It'll take some experimentation

john21:04:31

#C054XC5JVDZ now exists

🎉 6