poster

Cheap & Fast File-aaS for AI by Combining Scale-out Virtiofs, Block layouts and Delegations

Authors:

Sagi Manole,

Amit GolanderAuthors Info & Claims

SYSTOR '24: Proceedings of the 17th ACM International Systems and Storage Conference

Pages 194 - 195

https://doi.org/10.1145/3688351.3689167

Published: 16 September 2024 Publication History

Get Access

Abstract

File service Supply & Demand forces are changing: on the demand side, AI has significantly increased single-tenant File-aaS performance requirements. On the supply side, economic forces are moving the clients from traditional servers to rack-scale computers. Rack-scale computers encourage heterogeneous compute and are equipped with DPUs (Data-Processing Unit, also known as Smart NIC). DPUs offer higher efficiency, but may be over utilized at times. For this reason we would like our software to be flexible and run on general purpose compute when DPU utilization is high.

References

[1]

Stephen Fridella, David L. Black, and Jason Glasgow. Parallel NFS (pNFS) Block/Volume Layout. RFC 5663, January 2010.

Google Scholar

[2]

Peter Jan Gootzen, Jonas Pfefferle, Radu Stoica, and Animesh Trivedi. DPFS: DPU-powered file system virtualization. In SYSTOR '23: Proc. of the 16th ACM Int. Conf. on Systems and Storage, June 2023.

Digital Library

Google Scholar

Index Terms

Cheap & Fast File-aaS for AI by Combining Scale-out Virtiofs, Block layouts and Delegations
1. Information systems
  1. Information storage systems
    1. Storage architectures
      1. Cloud based storage
2. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        File systems management

Recommendations

DPC: DPU-accelerated High-Performance File System Client
ICPP '24: Proceedings of the 53rd International Conference on Parallel Processing

To achieve efficient file access to the file system backend, file system clients employ various intricate optimization techniques, such as local data/metadata caching and direct data access. However, these techniques impose a significant load on the ...
DPFS: DPU-Powered File System Virtualization
SYSTOR '23: Proceedings of the 16th ACM International Conference on Systems and Storage

As we move towards hyper-converged cloud solutions, the efficiency and overheads of distributed file systems at the cloud tenant side (i.e., client) become of paramount importance. Often, the clientside driver of a cloud file system is complex and CPU ...
Adaptive Live VM Migration in Share-Nothing IaaS-Clouds with LiveFS
CLOUDCOM '13: Proceedings of the 2013 IEEE International Conference on Cloud Computing Technology and Science - Volume 02

Live migration is a versatile option when it comes to attain load-balancing in IaaS-cloud architectures. Liveness, reliability and conformance to SLAs may all be achieved by moving a VM that creates excessive work from its current physical machine (PM) ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

SYSTOR '24: Proceedings of the 17th ACM International Systems and Storage Conference

September 2024

212 pages

ISBN:9798400711817

DOI:10.1145/3688351

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

In-Cooperation

Technion: Israel Institute of Technology

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 September 2024

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Conference

SYSTOR '24

Sponsor:

SIGOPS

SYSTOR '24: The 17th ACM International Systems and Storage Conference

September 23 - 24, 2024

Virtual, Israel

Acceptance Rates

SYSTOR '24 Paper Acceptance Rate 14 of 38 submissions, 37%;

Overall Acceptance Rate 108 of 323 submissions, 33%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

0
Total Citations
20
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)3

Reflects downloads up to 14 Jan 2025

Other Metrics

View Author Metrics

Citations

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Index Terms

Recommendations

DPC: DPU-accelerated High-Performance File System Client

DPFS: DPU-Powered File System Virtualization

Adaptive Live VM Migration in Share-Nothing IaaS-Clouds with LiveFS