Build a Hyperlight C guest to securely execute JavaScript
This article will show you how to create a “guest” application that uses the Hyperlight library and have fun with some JavaScript.
Microsoft Open Source Blog
Performant on-device inferencing with ONNX Runtime
The team at Pieces shares the problems and solutions evaluated for their on-device model serving stack and how ONNX Runtime…
Improve BERT inference speed by combining the power of Optimum, OpenVINO™, ONNX Runtime, and Azure
Make large models smaller and faster with OpenVino Execution Provider, NNCF and ONNX Runtime leveraging Azure Machine Learning.
Faster inference for PyTorch models with OpenVINO Integration with Torch-ORT
Many developers opt to use popular AI Frameworks like PyTorch, which simplifies the process of analyzing predictions, training models, leveraging…
Towards debuggability and secure deployments of eBPF programs on Windows
eBPF for Windows native code generation is a new mode of execution that maintains the integrity of the kernel and…
Making culture count for Open Source sustainability—Celebrating FOSS Fund 25
To celebrate FOSS Fund #25 we have invited all employees whose projects were not selected in past FOSS Fund to…
Hugging Face Transformers now enabled in Apache OpenNLP by ONNX Runtime
We’re excited to share the recent integration of ONNX Runtime in Apache OpenNLP! Apache OpenNLP is a Java machine learning…
Feathr feature store joins LF AI & Data Foundation
Together with our colleagues at LinkedIn, we are happy to announce that Feathr is joining the LF AI Data Foundation,…
Live demos of machine learning models with ONNX and Hugging Face Spaces
Choosing which machine learning model to use, sharing a model with a colleague, and quickly trying out a model are…
Join Microsoft at KubeCon + CloudNativeCon Europe 2022
Welcome to KubeCon Europe 2022. While I am unfortunately stuck in rainy Seattle (coldest start to May in 20 years),…
Optimizing and deploying transformer INT8 inference with ONNX Runtime-TensorRT on NVIDIA GPUs
Mohit Ayani, Solutions Architect, NVIDIA Shang Zhang, Senior AI Developer Technology Engineer, NVIDIA Jay Rodge, Product Marketing Manager-AI, NVIDIA Transformer-based…
Scaling-up PyTorch inference: Serving billions of daily NLP inferences with ONNX Runtime
Scale, performance, and efficient deployment of state-of-the-art Deep Learning models are ubiquitous challenges as applied machine learning grows across the…
Supporting efficient large model training on AMD Instinct™ GPUs with DeepSpeed
This post was co-authored by Jithun Nair and Aswin Mathews, members of technical staff at AMD. In recent years, large-scale…