About this episode
Seventy3???NotebookLM???????????????????????????crypto????????AI????????????????????????????????????Extending the Context of Pretrained LLMs by Dropping Their Positional EmbeddingsSummary???????????????LM?????????????????????????????????????????????????????????????Dropping the Positional Embeddings??? DroPE??????????????????????????????????????????????Positional Embeddings, PEs??????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????DroPE ??????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????Rotary Positional Embedding???????????https://arxiv.org/abs/2512.12167
