ONNX Runtime Web unleashes generative AI in the browser using WebGPU
ONNX Runtime Web featuring WebGPU is now available in the ONNX Runtime 1.17 release—unlocking new possibilities.
Tag: ONNX Runtime
On-Device Training: Training a model in browser
Continuing the ONNXRuntime On-Device Training blog series, we are introducing ONNX Runtime Training for Web.
Boosting performance in ONNX Runtime with Intel® AMX for 4th Gen Intel® Xeon® Processors
ONNX Runtime harnesses Intel® AMX to accelerate performance for the 4th Gen Intel® Xeon® CPUs.
Connect fluid dynamics, machine learning, and virtual reality with ONNX Runtime
Using ONNX Runtime to unlock the promise of developments in science for solving real world problems.
On-Device Training with ONNX Runtime: A deep dive
Building upon the foundation we established earlier, this blog will present comprehensive information about the underlying details of…
Olive: A user-friendly toolchain for hardware-aware model optimization
Introducing Olive, an easy-to-use toolchain for optimizing models with hardware awareness. With Olive, you don't need to be…
Automate optimization techniques for transformer models
Intel has collaborated with Microsoft to integrate Intel® Neural Compressor into Olive, enabling developers to easily take advantage…
On-Device Training: Efficient training on the edge with ONNX Runtime
ONNX Runtime is a high-performance cross-platform inference and training engine that can run a variety of machine learning…
High-performance deep learning in Oracle Cloud with ONNX Runtime
In this blog post, we’ll share challenges our team faced, and how ONNX Runtime solves these as the…
Performant on-device inferencing with ONNX Runtime
The team at Pieces shares the problems and solutions evaluated for their on-device model serving stack and how…
Improve BERT inference speed by combining the power of Optimum, OpenVINO™, ONNX Runtime, and Azure
Make large models smaller and faster with OpenVino Execution Provider, NNCF and ONNX Runtime leveraging Azure Machine Learning.
Hugging Face Transformers now enabled in Apache OpenNLP by ONNX Runtime
We’re excited to share the recent integration of ONNX Runtime in Apache OpenNLP! Apache OpenNLP is a Java…
Live demos of machine learning models with ONNX and Hugging Face Spaces
Choosing which machine learning model to use, sharing a model with a colleague, and quickly trying out a…
Optimizing and deploying transformer INT8 inference with ONNX Runtime-TensorRT on NVIDIA GPUs
Mohit Ayani, Solutions Architect, NVIDIA Shang Zhang, Senior AI Developer Technology Engineer, NVIDIA Jay Rodge, Product Marketing Manager-AI,…
Scaling-up PyTorch inference: Serving billions of daily NLP inferences with ONNX Runtime
Scale, performance, and efficient deployment of state-of-the-art Deep Learning models are ubiquitous challenges as applied machine learning grows…