Large Language Model系列之三:大模型并行训练(Parallel Training of Large Language Models)
Large Language Model系列之三:大模型并行训练(Parallel Training of Large Language Models) 1 各类并行算法 参考资料: 1 大模型并行训练 2 ZeRO(Zero Redundancy Optimizer)零冗余优化 ZeRO(Zero Red…
2025-09-18