AxonLM: probing neuroanatomy in a language model
- Problem
- Can transformer representations encode neuroanatomical connectivity?
- My contribution
- Built the modular PyTorch GPT-2 research codebase and FFN probing scripts.
- Method
- Linear probes on feed-forward activations, compared with Allen Brain Atlas connectivity.
- Result
- The repository reports AUC 0.963 for neuroanatomical decoding.