DAOS Foundation Launches to Broaden Governance and Development of the Distributed Asynchronous Object Storage Project

November 9, 2023

SAN FRANCISCO, Nov. 9, 2023 — The Linux Foundation is excited to announce the launch of the DAOS Foundation, an initiative aimed at advancing the governance and development of the Distributed Asynchronous Object Storage (DAOS) project.

Featuring broad support from founding members Argonne National Laboratory (ANL), Enakta Labs, Google Cloud, Hewlett Packard Enterprise (HPE), and Intel, this significant milestone represents a major step toward accelerating next-generation High Performance Computing (HPC), and Artificial Intelligence and Machine Learning (AI/ML), with unprecedented performance.

The Distributed Asynchronous Object Storage (DAOS) is a high performance open source storage system that has redefined performance for a wide spectrum of HPC and AI workloads. DAOS has achieved this feat through the creation of a fully distributed key-value storage architecture that successfully mitigates the data and metadata bottlenecks commonly associated with traditional POSIX-based HPC storage systems. By harnessing the power of commodity hardware, DAOS optimizes both performance and cost, supporting file, block and object semantics and a diverse range of application interfaces, including TensorFlow, HDF5 and MPI-IO. Advanced features such as data protection with self-healing, end-to-end data integrity, and fine-grained access control have made DAOS an industry leader.

Starting in 2012, Intel Corporation has been a key contributor to DAOS source code, which has since grown into an established open source community spanning various hardware and software on-prem and cloud vendors. To provide a broader governance to the project and to foster future development and growth, the DAOS Foundation has launched as a project under the umbrella of the Linux Foundation. This will ensure the continuous development of DAOS as an open source project and will enable other participants to engage in architectural and development decisions. Intel Corporation will donate the DAOS source code to the DAOS Foundation and will remain one of the main contributors to the future development of the project.

“The DAOS storage system stack provides the core high-performance storage system for Argonne Leadership Computing Facilities latest supercomputer, Aurora,” said Kevin Harms, ALCF-4 Technical Director at Argonne National Laboratory. “DAOS has performance 20x greater than our current file systems and will provide better performance across a broad range of I/O workload allowing application science codes to achieve high performance with less effort.”

“Enakta Labs takes great pride in its role as a founding member of the DAOS Foundation,” said Denis Nuja, CEO at Enakta Labs. “We consider it a privilege to actively contribute and collaborate with the open source community in advancing next-generation storage technology. DAOS serves as the foundation for the Enakta Platform, and we are excited to introduce this cutting-edge, high performance storage system to the market.”

“Google Cloud is delighted to be a founding member of the DAOS Foundation,” said Sameet Agarwal, Storage VP/GM, Google Cloud. “This world record-setting technology underpins our new storage service, Parallelstore, and we are extremely excited to accelerate the growth of HPC and AI/ML workloads in the cloud.”

“HPE is honored to be a founding member of the DAOS Foundation and have this opportunity to contribute to a community that values open standards,” said Andrew Wheeler, HPE Fellow, Vice President and Director of Hewlett Packard Labs. “HPE has been closely engaged with Intel on Argonne National Laboratory’s exascale deployment of DAOS and continues to contribute to the community. We support the DAOS architecture, which we believe will advance emerging supercomputing and technical computing use cases.”

“Intel is taking a pivotal step forward, solidifying our dedication to open source technology,” said Hillarie Prestopine, Intel Vice President of System Software, Data Center AI Solutions. “As a founding member of the DAOS Foundation, we are reinforcing our commitment to open source software and providing a platform for the expansion of software development surrounding DAOS. The DAOS Foundation will drive innovation in storage software, delivering what is essential for AI and high performance computing.”

The DAOS Foundation is open to anyone willing to contribute to the project. The Foundation offers Premier, General, and Associate membership levels, each providing a different level of participation in governing board and technical working groups. To learn more about the DAOS Foundation, including how to become a member and join their community, please visit the DAOS Foundation website at https://foundation.daos.io/.

About The Linux Foundation

The Linux Foundation is the world’s leading home for collaboration on open source software, hardware, standards, and data. Linux Foundation projects are critical to the world’s infrastructure including Linux, Kubernetes, Node.js, ONAP, PyTorch, RISC-V, SPDX, OpenChain, and more. The Linux Foundation focuses on leveraging best practices and addressing the needs of contributors, users, and solution providers to create sustainable models for open collaboration. For more information, please visit us at linuxfoundation.org.


Source: Linux Foundation

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

NIST Q&A: Getting Ready for the Post Quantum Cryptography Threat? You Should be.

June 3, 2024

With the National Institute of Standards and Technology (NIST) set to publish the first Post Quantum Cryptography (PQC) Standards in a few weeks, attention is shifting to how to put the new quantum-resistant algorithms i Read more…

Weekly Wire Roundup: May 27-May 31, 2024

May 31, 2024

ISC 2024 has come and gone, but that doesn't mean the headlines have disappeared. News relating to quantum computing led the charge this week with the governor of Colorado signing a quantum industry bill, aiming to boost Read more…

Everyone Except Nvidia Forms Ultra Accelerator Link (UALink) Consortium

May 30, 2024

Consider the GPU. An island of SIMD greatness that makes light work of matrix math. Originally designed to rapidly paint dots on a computer monitor, it was then found to be quite useful in large numbers by HPC practition Read more…

Intel Labs Fights Silent Data Corruption with Computational Storage

May 30, 2024

Artificial Intelligence (AI) Large Language Models and other forms of Deep Learning already require enormous amounts of training data. The data volumes are expected to grow as more organizations implement AI. This situat Read more…

Natcast/NSTC Issues Roadmap to Implement CHIPS and Science Act

May 29, 2024

Yesterday, CHIPS for America and Natcast, the operator of the National Semiconductor Technology Center (NSTC), released a roadmap of early steps for implementing portions of the ambitious $5 billion program. Natcast is t Read more…

Scientists Use GenAI to Uncover New Insights in Materials Science

May 29, 2024

With the help of generative AI, researchers from MIT and the University of Basel in Switzerland have developed a new machine-learning framework that can help uncover new insights about materials science. The findings of Read more…

NIST Q&A: Getting Ready for the Post Quantum Cryptography Threat? You Should be.

June 3, 2024

With the National Institute of Standards and Technology (NIST) set to publish the first Post Quantum Cryptography (PQC) Standards in a few weeks, attention is s Read more…

Everyone Except Nvidia Forms Ultra Accelerator Link (UALink) Consortium

May 30, 2024

Consider the GPU. An island of SIMD greatness that makes light work of matrix math. Originally designed to rapidly paint dots on a computer monitor, it was then Read more…

Intel Labs Fights Silent Data Corruption with Computational Storage

May 30, 2024

Artificial Intelligence (AI) Large Language Models and other forms of Deep Learning already require enormous amounts of training data. The data volumes are expe Read more…

Scientists Use GenAI to Uncover New Insights in Materials Science

May 29, 2024

With the help of generative AI, researchers from MIT and the University of Basel in Switzerland have developed a new machine-learning framework that can help un Read more…

watsonx

IBM Makes a Push Towards Open-Source Services, Announces New watsonx Updates

May 28, 2024

Today, IBM declared that it is releasing a number of noteworthy changes to its watsonx platform, with the goal of increasing the openness, affordability, and fl Read more…

ISC 2024 Takeaways: Love for Top500, Extending HPC Systems, and Media Bashing

May 23, 2024

The ISC High Performance show is typically about time-to-science, but breakout sessions also focused on Europe's tech sovereignty, server infrastructure, storag Read more…

ISC 2024 — A Few Quantum Gems and Slides from a Packed QC Agenda

May 22, 2024

If you were looking for quantum computing content, ISC 2024 was a good place to be last week — there were around 20 quantum computing related sessions. QC eve Read more…

Atos Outlines Plans to Get Acquired, and a Path Forward

May 21, 2024

Atos – via its subsidiary Eviden – is the second major supercomputer maker outside of HPE, while others have largely dropped out. The lack of integrators and Atos' financial turmoil have the HPC market worried. If Atos goes under, HPE will be the only major option for building large-scale systems. Read more…

Synopsys Eats Ansys: Does HPC Get Indigestion?

February 8, 2024

Recently, it was announced that Synopsys is buying HPC tool developer Ansys. Started in Pittsburgh, Pa., in 1970 as Swanson Analysis Systems, Inc. (SASI) by John Swanson (and eventually renamed), Ansys serves the CAE (Computer Aided Engineering)/multiphysics engineering simulation market. Read more…

Atos Outlines Plans to Get Acquired, and a Path Forward

May 21, 2024

Atos – via its subsidiary Eviden – is the second major supercomputer maker outside of HPE, while others have largely dropped out. The lack of integrators and Atos' financial turmoil have the HPC market worried. If Atos goes under, HPE will be the only major option for building large-scale systems. Read more…

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

Nvidia H100: Are 550,000 GPUs Enough for This Year?

August 17, 2023

The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more…

Choosing the Right GPU for LLM Inference and Training

December 11, 2023

Accelerating the training and inference processes of deep learning models is crucial for unleashing their true potential and NVIDIA GPUs have emerged as a game- Read more…

Nvidia’s New Blackwell GPU Can Train AI Models with Trillions of Parameters

March 18, 2024

Nvidia's latest and fastest GPU, codenamed Blackwell, is here and will underpin the company's AI plans this year. The chip offers performance improvements from Read more…

Some Reasons Why Aurora Didn’t Take First Place in the Top500 List

May 15, 2024

The makers of the Aurora supercomputer, which is housed at the Argonne National Laboratory, gave some reasons why the system didn't make the top spot on the Top Read more…

AMD MI3000A

How AMD May Get Across the CUDA Moat

October 5, 2023

When discussing GenAI, the term "GPU" almost always enters the conversation and the topic often moves toward performance and access. Interestingly, the word "GPU" is assumed to mean "Nvidia" products. (As an aside, the popular Nvidia hardware used in GenAI are not technically... Read more…

Leading Solution Providers

Contributors

The NASA Black Hole Plunge

May 7, 2024

We have all thought about it. No one has done it, but now, thanks to HPC, we see what it looks like. Hold on to your feet because NASA has released videos of wh Read more…

Intel Plans Falcon Shores 2 GPU Supercomputing Chip for 2026  

August 8, 2023

Intel is planning to onboard a new version of the Falcon Shores chip in 2026, which is code-named Falcon Shores 2. The new product was announced by CEO Pat Gel Read more…

Shutterstock 1285747942

AMD’s Horsepower-packed MI300X GPU Beats Nvidia’s Upcoming H200

December 7, 2023

AMD and Nvidia are locked in an AI performance battle – much like the gaming GPU performance clash the companies have waged for decades. AMD has claimed it Read more…

GenAI Having Major Impact on Data Culture, Survey Says

February 21, 2024

While 2023 was the year of GenAI, the adoption rates for GenAI did not match expectations. Most organizations are continuing to invest in GenAI but are yet to Read more…

Everyone Except Nvidia Forms Ultra Accelerator Link (UALink) Consortium

May 30, 2024

Consider the GPU. An island of SIMD greatness that makes light work of matrix math. Originally designed to rapidly paint dots on a computer monitor, it was then Read more…

Q&A with Nvidia’s Chief of DGX Systems on the DGX-GB200 Rack-scale System

March 27, 2024

Pictures of Nvidia's new flagship mega-server, the DGX GB200, on the GTC show floor got favorable reactions on social media for the sheer amount of computing po Read more…

How the Chip Industry is Helping a Battery Company

May 8, 2024

Chip companies, once seen as engineering pure plays, are now at the center of geopolitical intrigue. Chip manufacturing firms, especially TSMC and Intel, have b Read more…

A Big Memory Nvidia GH200 Next to Your Desk: Closer Than You Think

February 22, 2024

Students of the microprocessor may recall that the original 8086/8088 processors did not have floating point units. The motherboard often had an extra socket fo Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire