Sensory space
The set of inputs that can influence a given output.
- In transformers, the receptive field is determined autoregressively via causal masking.
- In diffusion models, it expands through spatial locality and depth (layers).
Seonglae Cho
Seonglae Cho