DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. https://github.com/microsoft/DeepSpeed
天问 2620e8fe36 Update 'README.md' | 1 year ago | |
---|---|---|
README.md | 1 year ago |
DeepSpeed 只需单击一下即可实现类似 ChatGPT 的模型训练,与 SOTA RLHF 系统相比,速度提高了 15 倍,在所有规模上都降低了前所未有的成本
官网:
例子: