3

Pretrain-Test Task Alignment Governs Generalization in In-Context Learning
In-context learning (ICL) is a central capability of Transformer models, but the structures in data that enable its emergence and …
Mary Letey, Jacob A Zavatone-Veth, Yue M. Lu, Cengiz Pehlevan
PDF Cite DOI