Mixture-of-Experts models
Find Mixture-of-Experts architectures, sparse activation, routing methods, and related open models.
Map the topic before choosing
For MoE, inspect total parameters, active parameters, routing, parallelism, and inference memory together. This page keeps architectures, mechanisms, and models on one exploration path.
Use this page to understand the topic and discover candidates. When you are ready to compare deployment, budget, or capability constraints, open the decision guide above.
Curated KG entry points
A small set of entry points for discovering this topic, not a paid ranking or an official product review. Return to the homepage for the full semantic retrieval and second-stage summary.
Mixture-of-Experts
An architecture where only a subset of experts (K) is active per token, but all
Mechanismsparse mixture-of-experts
KG-recorded mechanism related to 稀疏混合专家（MoE）; detailed English notes are not yet available.
MechanismMoE
layer carries 512 experts, activating 10 routed plus 1 shared per token
MechanismMoE
KG-recorded mechanism related to 混合专家模型（MoE）; detailed English notes are not yet available.
MechanismMoE
KG-recorded mechanism related to 混合专家（MoE）; detailed English notes are not yet available.
Mechanismhybrid Mamba–Transformer mixture-of-experts language model
KG-recorded mechanism related to 混合 Mamba–Transformer 混合专家架构; detailed English notes are not yet available.
MechanismSparse Mixture-of-Experts
KG-recorded mechanism related to 稀疏混合专家模型; detailed English notes are not yet available.
MechanismMoE Routing
KG-recorded mechanism related to MoE Routing; detailed English notes are not yet available.
Share feedback on this topic
Anonymous feedback is attached to this topic page, stays outside the KG, and is visible to other visitors.