ℏεsam (@Hesamation)
2025-08-09 | ❤️ 715 | 🔁 106
The perfect weekend article just dropped by @rasbt on gpt-oss architectures.
It’s wild to see how fast these architectures have leveled up since GPT-2 in 2019.
abs positional emb → RoPE GELU MLP → Swish + SwiGLU one dense feed-forward → MoE Multi-head attention → GQA … https://x.com/Hesamation/status/1954237350512619868/photo/1
미디어
