• ZWQbpkzl [none/use name]@hexbear.net
    link
    fedilink
    English
    arrow-up
    3
    ·
    2 months ago

    Often they do that within the model’s architecture itself. You can save drastically on the filesize of the model itself by using this Mixture of Experts (MoE) strategy. Its how deepseek was able to break into the market.