> Manthan|
[home][about][blog][projects][dump][gallery]
homeaboutprojectsblogdumpgallery

Understanding how Flash-Attention works

Sep 5, 2026

This is my first blog, where I explained how FlashAttention works in a very intuitive and beginner-friendly manner;covering its core idea, memory-efficient attention mechanism, and the key optimizations that make it significantly faster.

transformersattentioncudagpu

My first Comp. sci class was quite boring

Dec 11, 2024

CollegeRant
-> Understanding how Flash-Attention works
-> My first Comp. sci class was quite boring