curious as to what the Deep Diamond roadmap will include or includes currently... (e.g. transformers? with attention?)

my goal is primarily to provide core tools so that people can build whatever they need on top of that.

the first major addition will be RNN

on another note, does Neanderthal support Einstein Summation notation? Numpy (https://numpy.org/doc/stable/reference/generated/numpy.einsum.html) and Torch (https://pytorch.org/docs/stable/generated/torch.einsum.html) and probably others support it... It might be cool to see in Neanderthal

I don't plan to work on that, as I prefer clean explicit API. OTOH, this is something that would be nice to see from 3rd parties. This is why I created Neanderthal; to provide a powerful core that anybody can extend with whatever sugar they like.