Seonglae Cho- Blackwell (5th Gen): Added TMEM (Tensor Memory), implemented CTA pair-based 2SM MMA operations, introduced single-thread MMA dispatch, expanded ultra-low precision data types (MXFP·NVFP4), introduced structural sparsity (pairs 4:8).
NVIDIA Blackwell Architecture Products
Nvidia reportedly delays its next AI chip due to a design flaw
Nvidia’s yearly AI chip refresh may not start this year.
https://www.theverge.com/2024/8/3/24212518/nvidia-ai-chip-delay-blackwell-b200-microsoft-amazon-google-openai-meta-artificial-intelligence
%2Fcdn.vox-cdn.com%2Fuploads%2Fchorus_asset%2Ffile%2F11447597%2Facastro_180529_1777_nvidia_0002.0.jpg?table=block&id=6002b479-43b3-4a87-8c00-16f41142ba8f&cache=v2)