DeepSpeed | Microsoft Open Source Blog

Project updates March 21, 2022 6 min read

Supporting efficient large model training on AMD Instinct™ GPUs with DeepSpeed

This post was co-authored by Jithun Nair and Aswin Mathews, members of technical staff at AMD.

July 13, 2021 3 min read

Accelerate PyTorch training with torch-ort

With a simple change to your PyTorch training script, you can now speed up training large language models with torch_ort.

May 25, 2021 3 min read

Delivering reliable production experiences with PyTorch Enterprise on Microsoft Azure

At Microsoft, we use PyTorch to power products such as Bing and Azure Cognitive Services and we actively contribute to several PyTorch open-source projects, including PyTorch Profiler, ONNX Runtime, DeepSpeed, and more.