{"id":98898,"date":"2026-11-05T14:00:00","date_gmt":"2026-11-05T22:00:00","guid":{"rendered":"https:\/\/opensource.microsoft.com\/blog\/?p=98898"},"modified":"2026-11-05T08:39:37","modified_gmt":"2026-11-05T16:39:37","slug":"accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage","status":"publish","type":"post","link":"https:\/\/opensource.microsoft.com\/blog\/2026\/11\/05\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\/","title":{"rendered":"Accelerate data access for inference and training with the open-source distributed accelerator for cloud storage"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">Microsoft is open-sourcing distributed accelerator for cloud storage (DACS): a caching system for AI workloads. It leverages the local NVMe or SSD storage in the GPU nodes of a <a href=\"https:\/\/azure.microsoft.com\/en-us\/products\/kubernetes-service\/\" target=\"_blank\" rel=\"noopener noreferrer\">Kubernetes<\/a> cluster to bring data closer to GPUs, while <a href=\"https:\/\/azure.microsoft.com\/en-us\/products\/storage\/blobs\" target=\"_blank\" rel=\"noopener noreferrer\">Azure Blob Storage<\/a> remains the durable source of truth.<\/p>\n\n\n\n<div class=\"wp-block-buttons is-content-justification-center is-layout-flex wp-container-core-buttons-is-layout-a89b3969 wp-block-buttons-is-layout-flex\">\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link wp-element-button\" href=\"https:\/\/github.com\/Azure\/dacs\" target=\"_blank\" rel=\"noopener noreferrer\">Explore the DACS repository<\/a><\/div>\n<\/div>\n\n\n<figure data-wp-context=\"{&quot;imageId&quot;:&quot;6aed687e65cb5&quot;}\" data-wp-interactive=\"core\/image\" data-wp-key=\"6aed687e65cb5\" class=\"wp-block-image size-large wp-lightbox-container\"><img decoding=\"async\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2026\/11\/dacs-architecture-20261104-outlined-1024x640.webp\" alt=\"Architecture flowchart for Distributed Acceleration of Cloud Storage.\" class=\"wp-image-98913 webp-format\" srcset=\"https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2026\/11\/dacs-architecture-20261104-outlined-1024x640.webp 1024w, https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2026\/11\/dacs-architecture-20261104-outlined-388x243.webp 388w, https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2026\/11\/dacs-architecture-20261104-outlined-768x480.webp 768w, https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2026\/11\/dacs-architecture-20261104-outlined-1536x960.webp 1536w, https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2026\/11\/dacs-architecture-20261104-outlined-2048x1280.webp 2048w\" data-orig-src=\"https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2026\/11\/dacs-architecture-20261104-outlined-1024x640.webp\"><button\n\t\t\tclass=\"lightbox-trigger\"\n\t\t\ttype=\"button\"\n\t\t\taria-haspopup=\"dialog\"\n\t\t\taria-label=\"Enlarge\"\n\t\t\tdata-wp-init=\"callbacks.initTriggerButton\"\n\t\t\tdata-wp-on--click=\"actions.showLightbox\"\n\t\t\tdata-wp-style--right=\"state.imageButtonRight\"\n\t\t\tdata-wp-style--top=\"state.imageButtonTop\"\n\t\t>\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewBox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\" \/>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"introducing-dacs\">Introducing DACS<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">DACS is Kubernetes native and cluster local. A supported client requests reading a blob chunk of an artifact. If the blob chunk is already cached, then DACS serves it from cache storage. If it is missing, the client reads it from Azure Blob Storage and hydrates the cache for later reads. This read-path suits large, immutable or versioned artifacts, including model weights, datasets, and checkpoint snapshots.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"why-microsoft-is-open-sourcing-dacs\">Why Microsoft is open-sourcing DACS<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">This technology is <a href=\"https:\/\/azure.microsoft.com\/en-us\/blog\/enterprise-ai-transformation-relies-on-the-end-to-end-platform-azure-was-built-for-this-moment\/\" target=\"_blank\" rel=\"noopener noreferrer\">powering AI workloads at scale within Microsoft<\/a>. Open source lets others inspect the design, try it in their own environments, and help shape what comes next. It also gives the community a shared starting point for addressing repeated data reads, without asking each team to build its own cache.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Training context<\/strong>: In one large-scale audio-training evaluation, reading from a warm cache reduced long-tail dataset-loading delays and helped a previously unstable workload complete a training run. The share of dataset-loading operations that stalled for at least five seconds fell from 14% to 0.1%.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Inference context<\/strong>: At startup, AI inference jobs load model weights into accelerator memory. When multiple jobs start concurrently, each may fetch the same weights from <a href=\"https:\/\/azure.microsoft.com\/en-us\/products\/storage\/blobs\" target=\"_blank\" rel=\"noopener noreferrer\">Azure Blob Storage<\/a>, increasing network traffic, triggering throttling, and delaying startup while accelerators remain idle. A distributed cache like DACS lets readers reuse the model weight already brought into the Kubernetes cluster, reducing accelerator wait times for model load prior to the first inference request.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">These examples show why we are sharing DACS: to help teams spend less time waiting for data and more time making progress. The goal is simple: reduce repeated reads without replacing the durable storage for all AI workloads.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"what-you-can-use-today\">What you can use today<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The initial release includes the cache server, a native C\/C++ client, and Python and Rust client wrappers. It also includes Helm charts and Kubernetes controller for deployment, Ethernet and InfiniBand transport, health probes, and Prometheus metrics. Current storage integrations use Azure Blob Storage; other providers are opportunities for future contributions.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Start with a trusted <a href=\"https:\/\/azure.microsoft.com\/en-us\/products\/kubernetes-service\/\" target=\"_blank\" rel=\"noopener noreferrer\">Kubernetes<\/a> cluster containing eligible nodes with local NVMe or SSD storage and then use DACS client for integration. The release does not isolate mutually untrusted tenants. Consult the repository\u2019s README for compatibility, configuration, and deployment guidance.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"start-with-a-real-workload\">Start with a real workload<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Visit the DACS repository<\/strong>: <a href=\"https:\/\/github.com\/Azure\/dacs\">https:\/\/github.com\/Azure\/dacs<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Begin with the README, Helm charts, and deployment examples, including static and node-aware scaling. Choose a workload with repeated artifact reads. Compare its data-load latency and training or serving behavior before and after enabling DACS. Record whether the cache is cold or warm. Share your setup and findings so that others can reproduce them.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"what-comes-next-for-dacs\">What comes next for DACS<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Potential future areas include integration with Azure Kubernetes Service and <a href=\"https:\/\/learn.microsoft.com\/en-us\/azure\/storage\/blobs\/blobfuse2-what-is\" target=\"_blank\" rel=\"noopener noreferrer\">BlobFuse<\/a>, additional framework integrations, and support for more storage providers. These areas are under consideration and are not available in the initial release.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Try DACS with a workload that repeatedly reads large artifacts, and share your measurements, feedback, and issues in the GitHub repository. Community contributions to framework integrations, storage backends, clients, and documentation can help shape future releases.<\/p>\n\n\n\n<div class=\"is-style-inline wp-block-bloginabox-theme-promotional\">\n\t\n<div class=\"promotional promotional--has-media promotional--media-right\">\n\t<div class=\"promotional__wrapper\">\n\t\t<div class=\"promotional__content-wrapper\">\n\t\t\t<div class=\"promotional__content\">\n\t\t\t\t\n\n<h2 class=\"wp-block-heading\" id=\"distributed-accelerator-for-cloud-storage\">Distributed accelerator for cloud storage<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">A caching system for AI workloads.<\/p>\n\n\n\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex\">\n<div class=\"wp-block-button\"><a aria-label=\"Explore the repository: Distributed accelerator for cloud storage\" data-bi-an=\"Global CTA\" data-bi-ct=\"cta link\" data-bi-id=\"cta-block\" class=\"wp-block-button__link wp-element-button\" href=\"https:\/\/github.com\/Azure\/dacs\" target=\"_blank\" rel=\"noopener noreferrer\">Explore the repository<\/a><\/div>\n<\/div>\n\n\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<div class=\"promotional__media-wrapper\">\n\t\t\t\t<div class=\"promotional__media\">\n\t\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"2560\" height=\"1707\" src=\"https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2025\/10\/CLO20b_Sylvie_Sabien_work_outside_office_001-scaled.jpg\" class=\"attachment-full size-full\" alt=\"People sitting and walking outside office.\" loading=\"lazy\" srcset=\"https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2025\/10\/CLO20b_Sylvie_Sabien_work_outside_office_001-scaled.jpg 2560w, https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2025\/10\/CLO20b_Sylvie_Sabien_work_outside_office_001-388x259.jpg 388w, https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2025\/10\/CLO20b_Sylvie_Sabien_work_outside_office_001-1024x683.jpg 1024w, https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2025\/10\/CLO20b_Sylvie_Sabien_work_outside_office_001-768x512.jpg 768w, https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2025\/10\/CLO20b_Sylvie_Sabien_work_outside_office_001-1536x1024.jpg 1536w, https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2025\/10\/CLO20b_Sylvie_Sabien_work_outside_office_001-2048x1365.jpg 2048w, https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2025\/10\/CLO20b_Sylvie_Sabien_work_outside_office_001-450x300.jpg 450w, https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2025\/10\/CLO20b_Sylvie_Sabien_work_outside_office_001-650x433.jpg 650w\" sizes=\"auto, (max-width: 2560px) 100vw, 2560px\" \/>\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t\t<\/div>\n<\/div>\n<\/div>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\" \/>\n\n\n\n<p class=\"wp-block-paragraph\"><em>DACS is a collaboration between Azure AI Platform and Azure Storage. We thank the engineers, reviewers, and early adopters.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>The goal is simple: reduce repeated reads without replacing the durable storage for all AI workloads.<\/p>\n","protected":false},"author":6266,"featured_media":98903,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_classifai_error":"","_classifai_text_to_speech_error":"","_alt_title":"","ms-ems-related-posts":[],"footnotes":""},"tags":[308,136,143],"programming-languages":[],"content-type":[346],"job-role":[],"topic":[2238,2241],"coauthors":[2655,2656],"class_list":["post-98898","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","tag-azure-kubernetes-service","tag-github","tag-helm","content-type-news","topic-ai-machine-learning","topic-cloud","review-flag-1593580428-734","review-flag-1593580419-521","review-flag-1-1593580432-963"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Accelerate data access for inference and training with the open-source distributed accelerator for cloud storage | Microsoft Open Source Blog<\/title>\n<meta name=\"description\" content=\"Learn how the distributed accelerator for cloud storage can help teams spend less time waiting for data and more time making progress.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/opensource.microsoft.com\/blog\/2026\/11\/05\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Accelerate data access for inference and training with the open-source distributed accelerator for cloud storage | Microsoft Open Source Blog\" \/>\n<meta property=\"og:description\" content=\"Learn how the distributed accelerator for cloud storage can help teams spend less time waiting for data and more time making progress.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/opensource.microsoft.com\/blog\/2026\/11\/05\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\/\" \/>\n<meta property=\"og:site_name\" content=\"Microsoft Open Source Blog\" \/>\n<meta property=\"article:published_time\" content=\"2026-11-05T22:00:00+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2026\/11\/Azure-DevTools-Light-3-scaled.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"1440\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Maneesh Sah, Vipul Modi\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2026\/11\/Azure-DevTools-Light-3-scaled.jpg\" \/>\n<meta name=\"twitter:creator\" content=\"@OpenAtMicrosoft\" \/>\n<meta name=\"twitter:site\" content=\"@OpenAtMicrosoft\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Maneesh Sah, Vipul Modi\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/2026\\\/11\\\/05\\\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/2026\\\/11\\\/05\\\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\\\/\"},\"author\":[{\"@id\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/author\\\/maneesh-sah\\\/\",\"@type\":\"Person\",\"@name\":\"Maneesh Sah\"},{\"@id\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/author\\\/vipul-modi\\\/\",\"@type\":\"Person\",\"@name\":\"Vipul Modi\"}],\"headline\":\"Accelerate data access for inference and training with the open-source distributed accelerator for cloud storage\",\"url\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/2026\\\/11\\\/05\\\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\\\/\",\"description\":\"Learn how the distributed accelerator for cloud storage can help teams spend less time waiting for data and more time making progress.\",\"datePublished\":\"2026-11-05T22:00:00+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/2026\\\/11\\\/05\\\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\\\/\"},\"wordCount\":612,\"publisher\":{\"@id\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/2026\\\/11\\\/05\\\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/Azure-DevTools-Light-3-scaled.jpg\",\"keywords\":[\"Azure Kubernetes Service\",\"GitHub\",\"Helm\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/2026\\\/11\\\/05\\\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\\\/\",\"url\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/2026\\\/11\\\/05\\\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\\\/\",\"name\":\"Accelerate data access for inference and training with the open-source distributed accelerator for cloud storage | Microsoft Open Source Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/2026\\\/11\\\/05\\\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/2026\\\/11\\\/05\\\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/Azure-DevTools-Light-3-scaled.jpg\",\"datePublished\":\"2026-11-05T22:00:00+00:00\",\"description\":\"Learn how the distributed accelerator for cloud storage can help teams spend less time waiting for data and more time making progress.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/2026\\\/11\\\/05\\\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/2026\\\/11\\\/05\\\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/2026\\\/11\\\/05\\\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\\\/#primaryimage\",\"url\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/Azure-DevTools-Light-3-scaled.jpg\",\"contentUrl\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/Azure-DevTools-Light-3-scaled.jpg\",\"width\":2560,\"height\":1440},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/2026\\\/11\\\/05\\\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Accelerate data access for inference and training with the open-source distributed accelerator for cloud storage\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/\",\"name\":\"Microsoft Open Source Blog\",\"description\":\"Open dialogue about openness at Microsoft \u2013 open source, standards, interoperability\",\"publisher\":{\"@id\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/#organization\",\"name\":\"Microsoft Open Source Blog\",\"url\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/wp-content\\\/uploads\\\/2019\\\/08\\\/Microsoft-Logo.png\",\"contentUrl\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/wp-content\\\/uploads\\\/2019\\\/08\\\/Microsoft-Logo.png\",\"width\":259,\"height\":194,\"caption\":\"Microsoft Open Source Blog\"},\"image\":{\"@id\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/x.com\\\/OpenAtMicrosoft\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/#\\\/schema\\\/person\\\/8e37242d6fdd99b60bafc751cbaf07be\",\"name\":\"garryguseltsev\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/83a74bb3ab966350e715f8643c1a8f9f3a83a0efa041588812dbb016511a7ced?s=96&d=microsoft&r=g5bf756705bcc7abab6614ffa2cb11cbd\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/83a74bb3ab966350e715f8643c1a8f9f3a83a0efa041588812dbb016511a7ced?s=96&d=microsoft&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/83a74bb3ab966350e715f8643c1a8f9f3a83a0efa041588812dbb016511a7ced?s=96&d=microsoft&r=g\",\"caption\":\"garryguseltsev\"},\"url\":\"https:\\\/\\\/opensource.microsoft.com\\\/blog\\\/author\\\/garryguseltsev\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Accelerate data access for inference and training with the open-source distributed accelerator for cloud storage | Microsoft Open Source Blog","description":"Learn how the distributed accelerator for cloud storage can help teams spend less time waiting for data and more time making progress.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/opensource.microsoft.com\/blog\/2026\/11\/05\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\/","og_locale":"en_US","og_type":"article","og_title":"Accelerate data access for inference and training with the open-source distributed accelerator for cloud storage | Microsoft Open Source Blog","og_description":"Learn how the distributed accelerator for cloud storage can help teams spend less time waiting for data and more time making progress.","og_url":"https:\/\/opensource.microsoft.com\/blog\/2026\/11\/05\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\/","og_site_name":"Microsoft Open Source Blog","article_published_time":"2026-11-05T22:00:00+00:00","og_image":[{"width":2560,"height":1440,"url":"https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2026\/11\/Azure-DevTools-Light-3-scaled.jpg","type":"image\/jpeg"}],"author":"Maneesh Sah, Vipul Modi","twitter_card":"summary_large_image","twitter_image":"https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2026\/11\/Azure-DevTools-Light-3-scaled.jpg","twitter_creator":"@OpenAtMicrosoft","twitter_site":"@OpenAtMicrosoft","twitter_misc":{"Written by":"Maneesh Sah, Vipul Modi","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/opensource.microsoft.com\/blog\/2026\/11\/05\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\/#article","isPartOf":{"@id":"https:\/\/opensource.microsoft.com\/blog\/2026\/11\/05\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\/"},"author":[{"@id":"https:\/\/opensource.microsoft.com\/blog\/author\/maneesh-sah\/","@type":"Person","@name":"Maneesh Sah"},{"@id":"https:\/\/opensource.microsoft.com\/blog\/author\/vipul-modi\/","@type":"Person","@name":"Vipul Modi"}],"headline":"Accelerate data access for inference and training with the open-source distributed accelerator for cloud storage","url":"https:\/\/opensource.microsoft.com\/blog\/2026\/11\/05\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\/","description":"Learn how the distributed accelerator for cloud storage can help teams spend less time waiting for data and more time making progress.","datePublished":"2026-11-05T22:00:00+00:00","mainEntityOfPage":{"@id":"https:\/\/opensource.microsoft.com\/blog\/2026\/11\/05\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\/"},"wordCount":612,"publisher":{"@id":"https:\/\/opensource.microsoft.com\/blog\/#organization"},"image":{"@id":"https:\/\/opensource.microsoft.com\/blog\/2026\/11\/05\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\/#primaryimage"},"thumbnailUrl":"https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2026\/11\/Azure-DevTools-Light-3-scaled.jpg","keywords":["Azure Kubernetes Service","GitHub","Helm"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/opensource.microsoft.com\/blog\/2026\/11\/05\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\/","url":"https:\/\/opensource.microsoft.com\/blog\/2026\/11\/05\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\/","name":"Accelerate data access for inference and training with the open-source distributed accelerator for cloud storage | Microsoft Open Source Blog","isPartOf":{"@id":"https:\/\/opensource.microsoft.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/opensource.microsoft.com\/blog\/2026\/11\/05\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\/#primaryimage"},"image":{"@id":"https:\/\/opensource.microsoft.com\/blog\/2026\/11\/05\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\/#primaryimage"},"thumbnailUrl":"https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2026\/11\/Azure-DevTools-Light-3-scaled.jpg","datePublished":"2026-11-05T22:00:00+00:00","description":"Learn how the distributed accelerator for cloud storage can help teams spend less time waiting for data and more time making progress.","breadcrumb":{"@id":"https:\/\/opensource.microsoft.com\/blog\/2026\/11\/05\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/opensource.microsoft.com\/blog\/2026\/11\/05\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/opensource.microsoft.com\/blog\/2026\/11\/05\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\/#primaryimage","url":"https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2026\/11\/Azure-DevTools-Light-3-scaled.jpg","contentUrl":"https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2026\/11\/Azure-DevTools-Light-3-scaled.jpg","width":2560,"height":1440},{"@type":"BreadcrumbList","@id":"https:\/\/opensource.microsoft.com\/blog\/2026\/11\/05\/accelerate-data-access-for-inference-and-training-with-the-open-source-distributed-accelerator-for-cloud-storage\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/opensource.microsoft.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Accelerate data access for inference and training with the open-source distributed accelerator for cloud storage"}]},{"@type":"WebSite","@id":"https:\/\/opensource.microsoft.com\/blog\/#website","url":"https:\/\/opensource.microsoft.com\/blog\/","name":"Microsoft Open Source Blog","description":"Open dialogue about openness at Microsoft \u2013 open source, standards, interoperability","publisher":{"@id":"https:\/\/opensource.microsoft.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/opensource.microsoft.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/opensource.microsoft.com\/blog\/#organization","name":"Microsoft Open Source Blog","url":"https:\/\/opensource.microsoft.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/opensource.microsoft.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2019\/08\/Microsoft-Logo.png","contentUrl":"https:\/\/opensource.microsoft.com\/blog\/wp-content\/uploads\/2019\/08\/Microsoft-Logo.png","width":259,"height":194,"caption":"Microsoft Open Source Blog"},"image":{"@id":"https:\/\/opensource.microsoft.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/OpenAtMicrosoft"]},{"@type":"Person","@id":"https:\/\/opensource.microsoft.com\/blog\/#\/schema\/person\/8e37242d6fdd99b60bafc751cbaf07be","name":"garryguseltsev","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/83a74bb3ab966350e715f8643c1a8f9f3a83a0efa041588812dbb016511a7ced?s=96&d=microsoft&r=g5bf756705bcc7abab6614ffa2cb11cbd","url":"https:\/\/secure.gravatar.com\/avatar\/83a74bb3ab966350e715f8643c1a8f9f3a83a0efa041588812dbb016511a7ced?s=96&d=microsoft&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/83a74bb3ab966350e715f8643c1a8f9f3a83a0efa041588812dbb016511a7ced?s=96&d=microsoft&r=g","caption":"garryguseltsev"},"url":"https:\/\/opensource.microsoft.com\/blog\/author\/garryguseltsev\/"}]}},"bloginabox_animated_featured_image":null,"bloginabox_display_generated_audio":true,"distributor_meta":false,"distributor_terms":false,"distributor_media":false,"distributor_original_site_name":"Microsoft Open Source Blog","distributor_original_site_url":"https:\/\/opensource.microsoft.com\/blog","push-errors":false,"_links":{"self":[{"href":"https:\/\/opensource.microsoft.com\/blog\/wp-json\/wp\/v2\/posts\/98898","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/opensource.microsoft.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/opensource.microsoft.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/opensource.microsoft.com\/blog\/wp-json\/wp\/v2\/users\/6266"}],"replies":[{"embeddable":true,"href":"https:\/\/opensource.microsoft.com\/blog\/wp-json\/wp\/v2\/comments?post=98898"}],"version-history":[{"count":8,"href":"https:\/\/opensource.microsoft.com\/blog\/wp-json\/wp\/v2\/posts\/98898\/revisions"}],"predecessor-version":[{"id":98916,"href":"https:\/\/opensource.microsoft.com\/blog\/wp-json\/wp\/v2\/posts\/98898\/revisions\/98916"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/opensource.microsoft.com\/blog\/wp-json\/wp\/v2\/media\/98903"}],"wp:attachment":[{"href":"https:\/\/opensource.microsoft.com\/blog\/wp-json\/wp\/v2\/media?parent=98898"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/opensource.microsoft.com\/blog\/wp-json\/wp\/v2\/tags?post=98898"},{"taxonomy":"programming-languages","embeddable":true,"href":"https:\/\/opensource.microsoft.com\/blog\/wp-json\/wp\/v2\/programming-languages?post=98898"},{"taxonomy":"content-type","embeddable":true,"href":"https:\/\/opensource.microsoft.com\/blog\/wp-json\/wp\/v2\/content-type?post=98898"},{"taxonomy":"job-role","embeddable":true,"href":"https:\/\/opensource.microsoft.com\/blog\/wp-json\/wp\/v2\/job-role?post=98898"},{"taxonomy":"topic","embeddable":true,"href":"https:\/\/opensource.microsoft.com\/blog\/wp-json\/wp\/v2\/topic?post=98898"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/opensource.microsoft.com\/blog\/wp-json\/wp\/v2\/coauthors?post=98898"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}