Qwen 1.5 MoE

Qwen 1.5 MoE

Highly efficient mixture-of-expert (MoE) model from Alibaba

5.0•2 reviews•

55 followers

Visit website
•
Qwen1.5-MoE-A2.7B is a small mixture-of-expert (MoE) model with only 2.7 billion activated parameters yet matches the performance of state-of-the-art 7B models like Mistral 7B and Qwen1.5-7B.