Gate MoE networks

Creator

Created

2024 Mar 5 9:56

Editor

Edited

2024 Apr 3 5:16

Refs

MoEs are based on a gate network (or router) to determine which tokens are sent to which experts.

////////