Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

That's a cool result because that's also kind of what's happening inside the transformer unit: project -> QKV fuzzy lookup -> unproject. And in a different direction, it's analogous in some sense to what's happening in stacked convolutional layers, where the layers at different levels learn to recognize features of increasing detail.


Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: