Shubham Tulsiani (@shubhtuls)
2026-02-05 | โค๏ธ 730 | ๐ 91
[1/N] Rotary Position Embeddings (RoPE) are ubiquitous across transformers that process tokens from 1D, 2D, or 3D grids e.g. language, images, or videos. Our RayRoPE formulation extends these to multi-view transformers. Paper and code: https://t.co/abVobLRJxq https://t.co/cYhczUqrGc
๋ฏธ๋์ด
![]()