TSP

Tensor Streaming processor

• MXM: For performing matrix ops

• SXM: For shift and rotate operations on vectors

• MEM: Memory read/write ops

• VXM: Arithmetic ops on the vectors

• ICU: Instruction Control Unit

Architecture

A Deep Dive into the Underlying Architecture of Groq's LPU

What powers the ground breaking performance of Groq's Langauge Processing Unit?

https://codeconfessions.substack.com/p/groq-lpu-design