MoE Routing

Creator

Creator

Seonglae Cho

Created

Created

2024 Jan 16 4:18

Editor

Editor

Seonglae Cho

Edited

Edited

2024 May 8 17:21

Refs

Refs

MoE Routings

Gate MoE networks

Sparse Gated MoE

Mixture-of-Experts with Expert Choice Routing

Mixture-of-Experts with Expert Choice Routing

https://ai.googleblog.com/2022/11/mixture-of-experts-with-expert-choice.html

Mixture-of-Experts with Expert Choice Routing

Octopus

NexaAIDev/Octopus-v4 · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

NexaAIDev/Octopus-v4 · Hugging Face

https://huggingface.co/NexaAIDev/Octopus-v4

NexaAIDev/Octopus-v4 · Hugging Face

DeepSeek

deepseek-ai • Updated 2024 Oct 16 2:25

Recommendations

///////