Name: ИИ-статИИ / paper readings - positional embeddings for transforemers (RoPE)
Start: 2024-06-30T15:00:00+03:00
Location: Факултет по математика и информатика, СУ

$\u0418\u0418-\u0441\u0442\u0430\u0442\u0418\u0418 \/ paper readings - positional embeddings for transforemers (RoPE)$

!! Place: FMI, hall 501
In this meeting we'll discuss the paper "RoFormer: Enhanced Transformer with Rotary Position Embedding" ( https://arxiv.org/abs/2104.09864 )
If you haven't attended before - we choose a scientific paper in the field of AI (every month or two) and come together to help each other understand it. There's no barrier to entry, but it would be nice if you've read the paper and/or related materials, so that we can get into specific questions ASAP. There's a moderator, that does an overview of the paper, and then we have free-form discussion to understand the specifics.
Relevant other papers we might get to if there's time to spare:
ALiBi ( https://arxiv.org/abs/2108.12409 )
Contextual Position Encoding ( https://arxiv.org/abs/2405.18719 )
Join our paper reading group to make a suggestion for the next topic and keep in touch: https://www.facebook.com/groups/1369557000588976
You can also subscribe to the DSS newsletter at https://www.datasciencesociety.net/