[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3036331.3050420acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccmsConference Proceedingsconference-collections
research-article

Performance Evaluation of a Remote Block Device with High-Speed Cluster Interconnects

Published: 20 January 2017 Publication History

Abstract

Today's data intensive applications require to process large amount of data on cluster systems that consist of commodity computing nodes with high performance network interconnects. Individual computing nodes in the cluster system have indentical resource specification although applications vary greatly in their resource needs. From imbalance of the amount of memory used different computing nodes, we can consider the use of remote idle memory to alleviate the memory pressure on individual computing nodes. We propose a remote memory block device (RMBD) using remote memory access capabilities provided by both Infiniband and RoCE as one of remote swapping techniques. We evaluates the I/O performance of RMBD with it of the block device using TCP/IP protocols. From performance experiments, we find that RMBD using RDMA is able to improve througput by up to 20 times in read operation and 6 times in write operation compared to it using TCP/IP. We demonstrate that RMBD as swap device can provide performance benefits that is up to 2 times speed up compared to HDD for quick-sorting.

References

[1]
Choi, H.-H., Kim, H., and Bae, C.-J. 2015. A remote memory system for high performance data processing. J. Future Computer and Communication. 4, 1 (February, 2015), 50--54.
[2]
Trevisan, T. S., Costal, V. S., Whately, L., and Amorim, C. L. 2002. Distributed shared memory in kernel mode. In Proceedings of the Computer Architecture and High Performance Computing.
[3]
Frankling, M. J., Carey, M. M., and Livny, M. 1992. Global memory management in client-server dbms architectures. In Proceedings of the 18th VLDB Conference (August, 1992).
[4]
Han, H., Lee, Y. C., Shin, W., and Jung, H. 2012. Cashing in on the cache in the cloud," IEEE Transactions on Parallel and Distributed System. IEEE Transactions on Parallel and Distributed System 23, 7 (August, 2012), 1387--1399.
[5]
Flouris, M. D. and Markatos, E. P. 1999. The network ramdisk: using remote memory on heterogeneous NOWs, 1999. Cluster Computing 2 (October, 1999), 281--293.
[6]
Newhall, T., Finney, S., Ganchew, K. and Spiegel, M. 2003. Nswap: a network swapping module for Linux cluster, In Euro-Par 2003 Parallel Processing (2003), 1160--1169.
[7]
Liang, S., Noronha, R., and Panda, D. K. 2005. Swapping to remote memory over InfiniBand: an approach using a high performance network block device. In Proceedings of IEEE international Conference on Cluster computing (September, 2005).
[8]
Midorikawa, M. Kurokawa, M., Himeno, R., and Sato, M. 2008. DLM: a distributed large memory system using remote memory swapping over cluster nodes. In Proceedings of IEEE international Conference on Cluster computing (2008), 268--273.
[9]
Tezuka, H. Ocarroll, F., Hori, A., and Ishikawa, Y. 1998. Pin-down: a Virtual memory management technique for zero-copy communication. In Proceedings of International Parallel Processing Symposium (March 1998).

Cited By

View all
  • (2023)Memory sharing for handling memory overload on physical machines in cloud data centersJournal of Cloud Computing10.1186/s13677-023-00405-x12:1Online publication date: 28-Feb-2023
  • (2022)A Remote Memory Sharing System for Virtualized Computing InfrastructuresIEEE Transactions on Cloud Computing10.1109/TCC.2020.301808910:3(1532-1542)Online publication date: 1-Jul-2022
  • (2020)Cooperative Memory Expansion via OS Kernel Support for Networked Computing SystemsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2020.2999507(1-1)Online publication date: 2020
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICCMS '17: Proceedings of the 8th International Conference on Computer Modeling and Simulation
January 2017
207 pages
ISBN:9781450348164
DOI:10.1145/3036331
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

  • Central Queensland University
  • University of Canberra: University of Canberra

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 January 2017

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Block Device
  2. I/O
  3. InfiniBand
  4. RDMA
  5. Remote Memory
  6. RoCE

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ICCMS '17

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)7
  • Downloads (Last 6 weeks)0
Reflects downloads up to 12 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Memory sharing for handling memory overload on physical machines in cloud data centersJournal of Cloud Computing10.1186/s13677-023-00405-x12:1Online publication date: 28-Feb-2023
  • (2022)A Remote Memory Sharing System for Virtualized Computing InfrastructuresIEEE Transactions on Cloud Computing10.1109/TCC.2020.301808910:3(1532-1542)Online publication date: 1-Jul-2022
  • (2020)Cooperative Memory Expansion via OS Kernel Support for Networked Computing SystemsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2020.2999507(1-1)Online publication date: 2020
  • (2019)A Performance Comparison of Container Networking AlternativesIEEE Network10.1109/MNET.2019.180014133:4(178-185)Online publication date: Jul-2019
  • (2019)Remote Memory Swapping for Virtual Machines in Commercial Infrastructure-as-a-Service2019 4th International Conference on Computing, Communications and Security (ICCCS)10.1109/CCCS.2019.8888069(1-8)Online publication date: Oct-2019
  • (2019)Vertelas - Automated User-Controlled Vertical Elasticity in Existing Commercial Clouds2019 4th International Conference on Computing, Communications and Security (ICCCS)10.1109/CCCS.2019.8888039(1-8)Online publication date: Oct-2019

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media