Infrastructure & Agents

What Is DeepSpeed?

DeepSpeed provides tools and techniques, including ZeRO, that make training and serving very large models more memory-efficient and faster. It is widely used for large-scale distributed training.