More Web Proxy on the site http://driver.im/

research-article

Multi-GPU volume rendering using MapReduce

Authors:

Jeff A. Stuart,

Cheng-Kai Chen,

John D. OwensAuthors Info & Claims

HPDC '10: Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing

Pages 841 - 848

https://doi.org/10.1145/1851476.1851597

Published: 21 June 2010 Publication History

Abstract

In this paper we present a multi-GPU parallel volume rendering implemention built using the MapReduce programming model. We give implementation details of the library, including specific optimizations made for our rendering and compositing design. We analyze the theoretical peak performance and bottlenecks for all tasks required and show that our system significantly reduces computation as a bottleneck in the ray-casting phase. We demonstrate that our rendering speeds are adequate for interactive visualization (our system is capable of rendering a 1024³ floating-point sampled volume in under one second using 8 GPUs), and that our system is capable of delivering both in-core and out-of-core visualizations. We argue that a multi-GPU MapReduce library is a good fit for parallel volume renderering because it is easy to program for, scales well, and eliminates the need to focus on I/O algorithms thus allowing the focus to be on visualization algorithms instead. We show that our system scales with respect to the size of the volume, and (given enough work) the number of GPUs.

References

[1]

}}J. Ahrens, B. Geveci, and C. Law. Paraview: An end-user tool for large data visualization. In C. Hansen and C. Johnson, editors, The Visualization Handbook. Academic Press, Dec. 2004.

[2]

}}B. Catanzaro, N. Sundaram, and K. Keutzer. A Map Reduce framework for programming graphics processors. In Third Workshop on Software Tools for MultiCore Systems, Apr. 2008.

[3]

}}H. Childs, E. Brugger, K. Bonnell, J. Meredith, M. Miller, B. Whitlock, and N. Max. A contract based system for large data visualization. In VIS '05: Proceedings of the 16th IEEE Visualization Conference, pages 190--198, Oct. 2005.

[4]

}}J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. In Proceedings of the 6th Symposium on Operating Systems Design & Implementation, pages 137--150, Dec. 2004.

Digital Library

[5]

}}J. Ekanayake and G. Fox. High performance parallel computing with clouds and cloud technologies. In Proceedings of the First International Conference on Cloud Computing, Oct. 2009.

[6]

}}J. Gao, C. Wang, L. Li, and H.-W. Shen. A parallel multiresolution volume rendering algorithm for large data visualization. Parallel Computing, 31 (2):185--204, Feb. 2005.

Digital Library

[7]

}}L. J. Gosink, J. C. Anderson, E. W. Bethel, and K. I. Joy. Query-driven visualization of time-varying adaptive mesh refinement data. IEEE Transactions on Visualization and Computer Graphics, 14:1715--1722, Nov. 2008.

Digital Library

[8]

}}M. Hadwiger, C. Sigg, H. Scharsach, K. Bühler, and M. H. Gross. Real-time ray-casting and advanced shading of discrete isosurfaces. Computer Graphics Forum, 24(3):303--312, Sept. 2005.

[9]

}}B. He, W. Fang, Q. Luo, N. K. Govindaraju, and T. Wang. Mars: a MapReduce framework on graphics processors. In Proceedings of the 17th International Conference on Parallel Architectures and Compilation Techniques, pages 260--269, Oct. 2008.

Digital Library

[10]

}}T.-J. Hsieh, F. Kuester, and T. C. Hutchison. Visualization of large-scale seismic data records. In Proceedings of the 4th International Conference on Earthquake Geotechnical Engineering (4ICEGE 2007), pages 1--12, June 2007.

[11]

}}R. Kaehler, M. Simon, and H.-C. Hege. Interactive volume rendering of large sparse data sets using adaptive mesh refinement hierarchies. IEEE Transactions on Visualization and Computer Graphics, 9(3):341--351, July--Sept. 2003.

Digital Library

[12]

}}J. Kruger and R. Westermann. Acceleration techniques for GPU-based volume rendering. In VIS '03: Proceedings of the 14th IEEE Visualization Conference, pages 287--292, Washington, DC, USA, Oct. 2003. IEEE Computer Society.

Digital Library

[13]

}}C. Lam. Hadoop in Action (Manning Early Access Program). Manning Publications Co., 2010.

Digital Library

[14]

}}M. Levoy. Display of surfaces from volume data. IEEE Computer Graphics and Applications, 8(3):29--37, May 1988.

Digital Library

[15]

}}D. Luebke. High performance computing with CUDA. IEEE/ACM Supercomputing 2009 Course Notes, Nov. 2009. http://www.gpgpu.org/sc2009/.

[16]

}}K.-L. Ma, J. S. Painter, C. D. Hansen, and M. F. Krogh. Parallel volume rendering using binary-swap compositing. IEEE Computer Graphics and Applications, 14(4):59--68, July 1994.

Digital Library

[17]

}}K.-L. Ma, A. Stompel, J. Bielak, O. Ghattas, and E. J. Kim. Visualizing very large-scale earthquake simulations. In SC '03: Proceedings of the 2003 ACM/IEEE Conference on Supercomputing, page 48, Nov. 2003.

Digital Library

[18]

}}M. W. Martin, M. Kraus, M. Merz, and T. Ertl. Hardware-based ray casting for tetrahedral meshes. In VIS '03: Proceedings of the 14th IEEE Visualization Conference, pages 333--340, Oct. 2003.

Digital Library

[19]

}}K. Moreland, D. Rogers, J. Greenfield, B. Geveci, P. Marion, A. Neundorf, and K. Eschenberg. Large scale visualization on the Cray XT3 Using ParaView. In Cray User Group 2008, May 2008.

[20]

}}U. Neumann. Communication costs for parallel volume-rendering algorithms. IEEE Computer Graphics & Applications, 14(4):49--58, July/Aug. 1994.

Digital Library

[21]

}}J. Nickolls, I. Buck, M. Garland, and K. Skadron. Scalable parallel programming with CUDA. ACM Queue, pages 40--53, Mar./Apr. 2008.

Digital Library

[22]

}}NVIDIA Corporation. NVIDIA CUDA compute unified device architecture programming guide. http://developer.nvidia.com/cuda, Jan. 2007.

[23]

}}T. Peterka, H. Yu, R. Ross, and K.-L. Ma. Parallel volume rendering on the IBM Blue Gene/P. In Proceedings of the Eurographics Parallel Graphics and Visualization Symposium (EGPGV '08), pages 73--80, Apr. 2008.

Digital Library

[24]

}}M. M. Rafique, B. Rose, A. R. Butt, and D. S. Nikolopoulos. CellMR: A framework for supporting MapReduce on asymmetric Cell-based clusters. In Proceedings of the 23rd IEEE International Parallel and Distributed Processing Symposium, May 2009.

Digital Library

[25]

}}C. Ranger, R. Raghuraman, A. Penmetsa, G. Bradski, and C. Kozyrakis. Evaluating MapReduce for multi-core and multiprocessor systems. In Proceedings of the IEEE 13th International Symposium on High Performance Computer Architecture, pages 13--24, Feb. 2007.

Digital Library

[26]

}}M. Strengert, M. Magallon, D. Weiskopf, S. Guthe, and T. Ertl. Hierarchical visualization and compression of large volume datasets using GPU clusters. In Proceedings of the Eurographics Symposium on Parallel Graphics and Visualization (EGPGV '04), pages 41--48, June 2004.

Digital Library

[27]

}}J. E. Vollrath, T. Schafhitzel, and T. Ertl. Employing complex GPU data structures for the interactive visualization of adaptive mesh refinement data. In Proceedings of the International Workshop on Volume Graphics '06, pages 55--58, July 2006.

[28]

}}C. Wang, J. Gao, L. Li, and H.-W. Shen. A multiresolution volume rendering framework for large-scale time-varying data visualization. In Proceedings of the International Workshop on Volume Graphics '05, pages 11--19, June 2005.

Digital Library

[29]

}}H. Yu, K.-L. Ma, and J. Welling. A parallel visualization pipeline for terascale earthquake simulations. In SC '04: Proceedings of the 2004 ACM/IEEE Conference on Supercomputing, page 49, Nov. 2004.

Digital Library

[30]

}}H. Yu, C. Wang, and K.-L. Ma. Massively parallel volume rendering using 2--3 swap image compositing. In SC '08: Proceedings of the 2008 ACM/IEEE Conference on Supercomputing, page 48, Nov. 2008.

Digital Library

Cited By

Mazza SPatel DViola I(2021)Homomorphic-Encrypted Volume RenderingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.303043627:2(635-644)Online publication date: Feb-2021
https://doi.org/10.1109/TVCG.2020.3030436
Hong SChoi JJeong W(2021)Distributed Interactive Visualization Using GPU-Optimized SparkIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.299089427:9(3670-3684)Online publication date: 1-Sep-2021
https://doi.org/10.1109/TVCG.2020.2990894
KASAHARA SOKUBO K(2019)EFFICIENT PARALLEL ALGORITHM FOR SUPER HIGH SPEED COMPUTER GRAPHICS RENDERING USING GPGPUGPGPUを活用した超高速CGレンダリングのための効率的並列化アルゴリズムJournal of Environmental Engineering (Transactions of AIJ)10.3130/aije.84.54384:759(543-552)Online publication date: 2019
https://doi.org/10.3130/aije.84.543
Show More Cited By

Index Terms

Multi-GPU volume rendering using MapReduce

Recommendations

Accelerating MapReduce framework on multi-GPU systems

Graphics processors evolve rapidly and promise to support power-efficient, cost, differentiated price-performance, and scalable high performance computing. MapReduce is a well-known distributed programming model to ease the development of applications ...
Scaling up MapReduce-based Big Data Processing on Multi-GPU systems

MapReduce is a popular data-parallel processing model encompassed with recent advances in computing technology and has been widely exploited for large-scale data analysis. The high demand on MapReduce has stimulated the investigation of MapReduce ...
A timeenergy performance analysis of MapReduce on heterogeneous systems with GPUs

Motivated by the explosion of Big Data analytics, performance improvements in low-power (wimpy) systems and the increasing energy efficiency of GPUs, this paper presents a timeenergy performance analysis of MapReduce on heterogeneous systems with GPUs. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HPDC '10: Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing

June 2010

911 pages

ISBN:9781605589428

DOI:10.1145/1851476

General Chairs:
Salim Hariri
University of Arizona
,
Kate Keahey
University of Chicago

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

University of Arizona: University of Arizona
SIGARCH: ACM Special Interest Group on Computer Architecture

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 June 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

HPDC '10

Sponsor:

University of Arizona
SIGARCH

HPDC '10: The 19th International Symposium on High Performance Distributed Computing

June 21 - 25, 2010

Illinois, Chicago

Acceptance Rates

Overall Acceptance Rate 166 of 966 submissions, 17%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

42
Total Citations
View Citations
827
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)2

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Mazza SPatel DViola I(2021)Homomorphic-Encrypted Volume RenderingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.303043627:2(635-644)Online publication date: Feb-2021
https://doi.org/10.1109/TVCG.2020.3030436
Hong SChoi JJeong W(2021)Distributed Interactive Visualization Using GPU-Optimized SparkIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.299089427:9(3670-3684)Online publication date: 1-Sep-2021
https://doi.org/10.1109/TVCG.2020.2990894
KASAHARA SOKUBO K(2019)EFFICIENT PARALLEL ALGORITHM FOR SUPER HIGH SPEED COMPUTER GRAPHICS RENDERING USING GPGPUGPGPUを活用した超高速CGレンダリングのための効率的並列化アルゴリズムJournal of Environmental Engineering (Transactions of AIJ)10.3130/aije.84.54384:759(543-552)Online publication date: 2019
https://doi.org/10.3130/aije.84.543
Huang GWang DGuo SChen XLiao M(2018)A novel generated method for high quality images2018 Tenth International Conference on Advanced Computational Intelligence (ICACI)10.1109/ICACI.2018.8377602(175-180)Online publication date: Mar-2018
https://doi.org/10.1109/ICACI.2018.8377602
Gao XShi XZhang GLin JLiao MLi KLi C(2018)Progressive Image Retrieval With Quality Guarantee Under MapReduce FrameworkIEEE Access10.1109/ACCESS.2018.28427966(44685-44697)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2842796
Chang CTsai CHsu WChen JLiao YSheen YHong JLin MTjiu JHuang S(2017)Segmentation of nucleus and cytoplasm of a single cell in three-dimensional tomogram using optical coherence tomographyJournal of Biomedical Optics10.1117/1.JBO.22.3.03600322:3(036003)Online publication date: 2-Mar-2017
https://doi.org/10.1117/1.JBO.22.3.036003
Kim IKim JPark JEom Y(2017)Software-based single-node multi-GPU systems for interactive display wallIEEE Transactions on Consumer Electronics10.1109/TCE.2017.01482263:2(101-108)Online publication date: May-2017
https://doi.org/10.1109/TCE.2017.014822
Marrinan TInsley JRizzi STessier FPapka M(2017)Automated Dynamic Data Redistribution2017 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)10.1109/IPDPSW.2017.17(1208-1215)Online publication date: May-2017
https://doi.org/10.1109/IPDPSW.2017.17
Wu HWang C(2017)Generalization of Large-Scale Data Processing in One MapReduce Job for Coarse-Grained ParallelismInternational Journal of Parallel Programming10.1007/s10766-016-0444-345:4(797-826)Online publication date: 1-Aug-2017
https://dl.acm.org/doi/10.1007/s10766-016-0444-3
Watanabe TAbe MKonno K(2016)Real-Time Rendering Technique for Visual Expression of Arbitrary-Shaped Energy WaveThe Journal of the Society for Art and Science10.3756/artsci.15.9815:2(98-110)Online publication date: 15-Jun-2016
https://doi.org/10.3756/artsci.15.98
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents