Hao AI Lab has introduced a new set of FP4 attention kernels designed for the Blackwell B300 architecture. These optimized kernels deliver performance improvements, achieving up to a 1.69x speedup compared to FlashAttention-4 (FA4).
The release focuses on enhancing computational efficiency for large language models running on NVIDIA's latest hardware through specialized floating-point precision techniques.