https://github.com/google-deepmind/alta
Attention Is All You Need
RASP: Thinking Like Transformers
Tracr: Compiled Transformers as a Laboratory for Interpretability
Universal Transformers
Generalization without systematicity: On the compositional skills of sequence-to-sequence recurrent networks
โ โend-to-endโ directory