Hyperlight: Achieving 0.0009-second micro-VM execution time
In this post, we’ll take the demo application and show how it demonstrates one way you can use Hyperlight in your applications.
Microsoft Open Source Blog
Improve BERT inference speed by combining the power of Optimum, OpenVINO™, ONNX Runtime, and Azure
Make large models smaller and faster with OpenVino Execution Provider, NNCF and ONNX Runtime leveraging Azure Machine Learning.
Faster inference for PyTorch models with OpenVINO Integration with Torch-ORT
Many developers opt to use popular AI Frameworks like PyTorch, which simplifies the process of analyzing predictions, training models, leveraging…
Towards debuggability and secure deployments of eBPF programs on Windows
eBPF for Windows native code generation is a new mode of execution that maintains the integrity of the kernel and…
Making culture count for Open Source sustainability—Celebrating FOSS Fund 25
To celebrate FOSS Fund #25 we have invited all employees whose projects were not selected in past FOSS Fund to…
Hugging Face Transformers now enabled in Apache OpenNLP by ONNX Runtime
We’re excited to share the recent integration of ONNX Runtime in Apache OpenNLP! Apache OpenNLP is a Java machine learning…
Feathr feature store joins LF AI & Data Foundation
Together with our colleagues at LinkedIn, we are happy to announce that Feathr is joining the LF AI Data Foundation,…
Live demos of machine learning models with ONNX and Hugging Face Spaces
Choosing which machine learning model to use, sharing a model with a colleague, and quickly trying out a model are…
Join Microsoft at KubeCon + CloudNativeCon Europe 2022
Welcome to KubeCon Europe 2022. While I am unfortunately stuck in rainy Seattle (coldest start to May in 20 years),…
Optimizing and deploying transformer INT8 inference with ONNX Runtime-TensorRT on NVIDIA GPUs
Mohit Ayani, Solutions Architect, NVIDIA Shang Zhang, Senior AI Developer Technology Engineer, NVIDIA Jay Rodge, Product Marketing Manager-AI, NVIDIA Transformer-based…
Scaling-up PyTorch inference: Serving billions of daily NLP inferences with ONNX Runtime
Scale, performance, and efficient deployment of state-of-the-art Deep Learning models are ubiquitous challenges as applied machine learning grows across the…
Supporting efficient large model training on AMD Instinct™ GPUs with DeepSpeed
This post was co-authored by Jithun Nair and Aswin Mathews, members of technical staff at AMD. In recent years, large-scale…
Getting Linux based eBPF programs to run with eBPF for Windows
In our previous blog, we spoke about the progress we have made for the eBPF for Windows project. A key…