Content type: Tutorials and demos

•
•
5 min read

Improve BERT inference speed by combining the power of Optimum, OpenVINO™, ONNX Runtime, and Azure 

  • By Cassie Breviu, Senior Technical Program Manager, ONNX Runtime, AI Frameworks—Microsoft
  • Akhila Vidiyala, Cloud Software Development Engineer, OpenVINO™ AI Frameworks Architectures—Intel
  • Devang Aggarwal, Product Manager, OpenVINO™ AI Framework Integrations—Intel
  • Sachin Rastogi, Product Manager, OpenVINO™ AI Workflows —Intel

Make large models smaller and faster with OpenVino Execution Provider, NNCF and ONNX Runtime leveraging Azure Machine Learning.

diagram, schematic
•
•
7 min read

Simple steps to create scalable processes to deploy ML models as microservices 

  • By Elena Neroslavskaya, Elena Neroslavskaya is Cloud Solution Architect at Microsoft. She is interested in all things open source and cloud, and is always looking for new ways to help and learn from OSS community and do great things on Azure or Cloud Foundry. When she’s not working, she’s usually learning, watching stars or hanging out with her family.

This post was co-authored by Alejandro Saucedo, Director of Machine Learning Engineering at Seldon Technologies. About the co-author:…