@behrouz_ali
Intern @Google, Ph.D. Student @Cornell_CS, interested in machine learning.
Attention has been the key component for most advances in LLMs, but it can’t scale to long context. Does this mean we need to find an alternative? P...