ONNX Runtime: a one-stop shop for machine learning inferencing
Organizations that want to leverage AI at scale must overcome a number of challenges around model training and model inferencing.
ONNX
-
-
Now available: ONNX Runtime 0.5 with support for edge hardware acceleration
ONNX Runtime 0.5, the latest update to the open source high performance inference engine for ONNX models, is now available. -
Announcing ONNX Runtime 1.0
One year after ONNX Runtime’s initial preview release, we’re excited to announce v1. -
ONNX joins Linux Foundation
Today the Open Neural Network eXchange (ONNX) is joining the LF AI Foundation, an umbrella foundation of the Linux Foundation supporting open source innovation in artificial intelligence, machine learning, and deep learning. -
Microsoft open sources breakthrough optimizations for transformer inference on GPU and CPU
This post is co-authored by Emma Ning, Azure Machine Learning; Nathan Yan, Azure Machine Learning; Jeffrey Zhu, Bing; Jason Li, Bing One of the most popular deep learning models used for natural language processing is BERT (Bidirectional Encoder Representations from Transformers). -
Announcing accelerated training with ONNX Runtime—train models up to 45% faster
ONNX Runtime is an open source project that is designed to accelerate machine learning across a wide range of frameworks, operating systems, and hardware platforms. -
GPT-2 fine-tuning with ONNX Runtime – a 34% speedup in training time
Model training is an important step when developing and deploying large scale Artificial Intelligence (AI) models. -
Introducing ONNX Runtime mobile – a reduced size, high performance package for edge devices
ONNX Runtime is an open source project that is designed to accelerate machine learning across a wide range of frameworks, operating systems, and hardware platforms. -
Adding RoBERTa NLP to the ONNX model zoo for natural language predictions
In summer 2019, I worked as a high school intern for the ONNX AI team at Microsoft and loved working on various projects with the team, including the BERT text classification model. -
ONNX Runtime scenario highlight: Vespa.ai integration
Since its open source debut two years ago, ONNX Runtime has seen strong growth with performance improvements, expanded platform and device compatibility, hardware accelerator support, an extension to training acceleration, and more. -
Accelerate and simplify Scikit-learn model inference with ONNX Runtime
Scikit-learn is one of the most useful libraries for general machine learning in Python. -
Scaling-up PyTorch inference: Serving billions of daily NLP inferences with ONNX Runtime
Scale, performance, and efficient deployment of state-of-the-art Deep Learning models are ubiquitous challenges as applied machine learning grows across the industry.
Microsoft Open Source
Open Source enables Microsoft products and services to bring choice, technology and community to our customers.
Connect with us on social
