AI + Machine Learning

Project updates December 17, 2020 5 min read

Accelerate and simplify Scikit-learn model inference with ONNX Runtime

Scikit-learn is one of the most useful libraries for general machine learning in Python.
February 18, 2021 5 min read

Create privacy-preserving synthetic data for machine learning with SmartNoise

Watch our webinar on Open Data Science Conference Read the white paper on SmartNoise Differential Privacy machine learning case studies The COVID-19 pandemic demonstrates the tremendous importance of sufficient and relevant data for research, causal analysis, government action, and medical progress.
June 30, 2021 7 min read

Journey to optimize large scale transformer model inference with ONNX Runtime

With its resource-efficient and high-performance nature, ONNX Runtime helped us meet the need of deploying a large-scale multi-layer generative transformer model for code, a.
Tutorials and demos July 9, 2021 7 min read

Simple steps to create scalable processes to deploy ML models as microservices

This post was co-authored by Alejandro Saucedo, Director of Machine Learning Engineering at Seldon Technologies.
Project updates July 13, 2021 4 min read

ONNX Runtime release 1.8.1 previews support for accelerated training on AMD GPUs with the AMD ROCm™ Open Software Platform

This post was co-authored by Jeff Daily, a Principal Member of Technical Staff, Deep Learning Software for AMD.
July 13, 2021 3 min read

Accelerate PyTorch training with torch-ort

With a simple change to your PyTorch training script, you can now speed up training large language models with torch_ort.
Project updates September 2, 2021 5 min read

ONNX Runtime Web—running your machine learning model in browser

We are introducing ONNX Runtime Web (ORT Web), a new feature in ONNX Runtime to enable JavaScript developers to run and deploy machine learning models in browsers.
Project updates December 14, 2021 2 min read

Add AI to mobile applications with Xamarin and ONNX Runtime

ONNX Runtime now supports building mobile applications in C# with Xamarin.
Project updates March 21, 2022 6 min read

Supporting efficient large model training on AMD Instinct™ GPUs with DeepSpeed

This post was co-authored by Jithun Nair and Aswin Mathews, members of technical staff at AMD.
April 19, 2022 8 min read

Scaling-up PyTorch inference: Serving billions of daily NLP inferences with ONNX Runtime

Scale, performance, and efficient deployment of state-of-the-art Deep Learning models are ubiquitous challenges as applied machine learning grows across the industry.
June 6, 2022 5 min read

Live demos of machine learning models with ONNX and Hugging Face Spaces

Choosing which machine learning model to use, sharing a model with a colleague, and quickly trying out a model are all reasons why you may find yourself wanting to quickly run inference on a model.
Project updates September 12, 2022 2 min read

Feathr feature store joins LF AI & Data Foundation

Together with our colleagues at LinkedIn, we are happy to announce that Feathr is joining the LF AI Data Foundation, an umbrella foundation of the Linux Foundation supporting open source innovation in AI and data.