Seonglae Cho- Blackwell (5th Gen): Added TMEM (Tensor Memory), implemented CTA pair-based 2SM MMA operations, introduced single-thread MMA dispatch, expanded ultra-low precision data types (MXFP·NVFP4), introduced structural sparsity (pairs 4:8).
NVIDIA Blackwell Architecture Products
Nvidia reportedly delays its next AI chip due to a design flaw
Nvidia’s yearly AI chip refresh may not start this year.
https://www.theverge.com/2024/8/3/24212518/nvidia-ai-chip-delay-blackwell-b200-microsoft-amazon-google-openai-meta-artificial-intelligence
/cdn.vox-cdn.com/uploads/chorus_asset/file/11447597/acastro_180529_1777_nvidia_0002.0.jpg)