More Web Proxy on the site http://driver.im/

research-article

Interactive Sand Art Drawing Using Kinect

Authors:

Sai-Keung WongAuthors Info & Claims

VINCI '14: Proceedings of the 7th International Symposium on Visual Information Communication and Interaction

Pages 78 - 87

https://doi.org/10.1145/2636240.2636846

Published: 05 August 2014 Publication History

Abstract

In this paper, we present an interactive sand art drawing system using Kinect. Our system adopts a vision-based bare hand detection method which effectively detects the hand position and recognizes the hand gestures. Then, the corresponding sand manipulation actions are performed. Our system supports the common sand drawing functions, such as sand erosion, sand sand spilling, and sand leaking. To use hands to draw virtual sand on a drawing plane, we design four key gestures which enable drawing manipulation actions for sand. The basic idea is that the gesture of one hand controls the drawing action. The motion and gesture of the other hand controls the drawing position. Our preliminary experimental results show that our system enables sand drawing with bare hands using Kinect. A user study indicates our system is useful to sand art drawing.

References

[1]

Adobe. Photoshop. From World Wide Web, http://www.adobe.com/tw/products/photoshop.html, 2014.

[2]

A. Barczak and F. Dadgostar. Real-time hand tracking using a set of cooperative classifiers based on haar-like features. Res. Lett. Inf. Math. Sci., 7:29--42, 2005.

[3]

B. Baxter, V. Scheib, M. C. Lin, and D. Manocha. Dab: interactive haptic painting with 3d virtual brushes. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques, pages 461--468, 2001.

Digital Library

[4]

N. Bell, Y. Yu, and P. J. Mucha. Particle-based simulation of granular materials. In Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation, pages 77--86, 2005.

Digital Library

[5]

K.-C. Chen, P.-S. Chen, and S.-K. Wong. A Heuristic Approach to the Simulation of Water Drops and Flows on Glass Panes. Computers & Graphics, 37(8):963--973, 2013.

Digital Library

[6]

P.-Y. Chen and S.-K. Wong. Real-time auto stylized sand art drawing. In International Conference on Computer-Aided Design and Computer Graphics (CAD/Graphics), pages 439--440, 2013.

Digital Library

[7]

Q. Chen, N. D. Georganas, and E. M. Petriu. Real-time vision-based hand gesture recognition using haar-like features. In Instrumentation and Measurement Technology Conference Proceedings, 2007. IMTC 2007. IEEE, pages 1--6, 2007.

[8]

D. Dave, A. Chowriappa, and T. Kesavadas. Gesture interface for 3d cad modeling using kinect. Computer-Aided Design and Applications, 10(4):663--669, 2013.

[9]

Z. Feng, S. Xu, X. Zhang, L. Jin, Z. Ye, and W. Yang. Real-time fingertip tracking and detection using kinect depth sensor for a new writing-in-the air system. In Proceedings of the 4th International Conference on Internet Multimedia Computing and Service, pages 70--74, 2012.

Digital Library

[10]

S. Ghosh, J. Zheng, W. Chen, J. Zhang, and Y. Cai. Real-time 3d markerless multiple hand detection and tracking for human computer interaction applications. In Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry, pages 323--330, 2010.

Digital Library

[11]

G. Hackenberg, R. McCall, and W. Broll. Lightweight palm and finger tracking for real-time 3d gesture control. In IEEE Virtual Reality Conference (VR), pages 19--26, 2011.

Digital Library

[12]

J. Han, S. Heo, H.-E. Lee, and G. Lee. The irpen: A 6-dof pen for interaction with tablet computers. IEEE Computer Graphics and Applications, 34(3):22--29, 2014.

[13]

K. Iwasaki, H. Uchida, Y. Dobashi, and T. Nishita. Fast Particle-based Visual Simulation of Ice Melting. Computer Graphics Forum, 29:2215--2223, 2010.

[14]

H. M. Jaeger, S. R. Nagel, and R. P. Behringer. Granular solids, liquids, and gases. Reviews of Modern Physics, 68(4):1259--1273, 1996.

[15]

Y. Jia, S. Li, and Y. Liu. Tracking pointing gesture in 3d space for wearable visual interfaces. In Proceedings of the international workshop on Human-centered multimedia, pages 23--30, 2007.

Digital Library

[16]

R. E. Kalman. A new approach to linear filtering and prediction problems. Journal of basic Engineering, 82(1):35--45, 1960.

[17]

R. H. Kazi, K. C. Chua, S. Zhao, R. Davis, and K.-L. Low. Sandcanvas: A multi-touch art medium inspired by sand animation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 1283--1292, 2011.

Digital Library

[18]

E. Keogh, L. Wei, X. Xi, S.-H. Lee, and M. Vlachos. Lb_keogh supports exact indexing of shapes under rotation invariance with arbitrary representations and distance measures. In Proceedings of the 32nd international conference on Very large data bases, pages 882--893, 2006.

Digital Library

[19]

S.-Y. Lii and S.-K. Wong. Ice Melting Simulation with Water Flow Handling. The Visual Computer, 30:531--538, 2014.

[20]

S. Malassiotis, N. Aifanti, and M. G. Strintzis. A gesture recognition system using 3d data. In 3D Data Processing Visualization and Transmission, 2002. Proceedings. First International Symposium on, pages 190--193, 2002.

[21]

K. T. McDonnell, H. Qin, and R. A. Wlodarczyk. Virtual clay: A real-time sculpting system with haptic toolkits. In Proceedings of the 2001 symposium on Interactive 3D graphics, pages 179--190, 2001.

Digital Library

[22]

J. M. Moshell, X. Li, C. E. Hughes, B. Blau, and B. F. Goldiez. Nap-of-earth flight and the real-time simulation of dynamic terrain. In Cockpit Displays and Visual Simulation, pages 118--129. International Society for Optics and Photonics, 1990.

[23]

K. Onoue and T. Nishita. Virtual sandbox. In Proceedings of 11th Pacific Conference on Computer Graphics and Applications, pages 252--259, 2003.

Digital Library

[24]

M. Piccardi. Background subtraction techniques: a review. In IEEE International Conference on Systems, man and cybernetics, volume 4, pages 3099--3104, 2004.

[25]

K. Ramani, K. Lee Jr, R. Jasti, et al. zpots: a virtual pottery experience with spatial interactions using the leap motion device. In CHI'14 Extended Abstracts on Human Factors in Computing Systems, pages 371--374, 2014.

Digital Library

[26]

J. Shi, M. Zhang, and Z. Pan. A real-time bimanual 3d interaction method based on bare-hand tracking. In Proceedings of the 19th ACM international conference on Multimedia, pages 1073--1076, 2011.

Digital Library

[27]

P. Song, H. Yu, and S. Winkler. Vision-based 3d finger interactions for mixed reality games with physics simulation. In Proceedings of The 7th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry, page 7, 2008.

Digital Library

[28]

V. Vezhnevets, V. Sazonov, and A. Andreeva. A survey on pixel-based skin color detection techniques. In Proceedings of Graphicon, volume 3, pages 85--92, 2003.

[29]

C. Von Hardenberg and F. Bérard. Bare-hand human-computer interaction. In Proceedings of the 2001 workshop on Perceptive user interfaces, pages 1--8, 2001.

Digital Library

[30]

S. Wu, Y. Zhang, S. Zhang, X. Ye, Y. Cai, J. Zheng, S. Ghosh, W. Chen, and J. Zhang. 2d motion detection bounded hand 3d trajectory tracking and gesture recognition under complex background. In Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry, pages 311--318, 2010.

Digital Library

[31]

H.-S. Yeo, B.-G. Lee, and H. Lim. Hand tracking and gesture recognition system for human-computer interaction using low-cost hardware. Multimedia Tools and Applications, pages 1--29, 2013.

[32]

B. Zhu and X. Yang. Animating sand as a surface flow. Eurographics 2010, Short Paper, 2010.

[33]

Y. Zhu and R. Bridson. Animating sand as a fluid. In ACM Transactions on Graphics, volume 24, pages 965--972, 2005.

Digital Library

Cited By

Zhu MYang MMeng WLi P(2023)Sand painting conversion based on detail preservationComputers & Graphics10.1016/j.cag.2023.07.012115(371-381)Online publication date: Oct-2023
https://doi.org/10.1016/j.cag.2023.07.012
Zhu KHe XLi SWang HWang G(2021)Shallow Sand Equations: Real-Time Height Field Simulation of Dry Granular FlowsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2019.294417227:3(2073-2084)Online publication date: 1-Mar-2021
https://doi.org/10.1109/TVCG.2019.2944172
Tseng YWong S(2020)Transferring video to dynamic relief structures with water interactionComputer Animation and Virtual Worlds10.1002/cav.196131:4-5Online publication date: 2-Sep-2020
https://doi.org/10.1002/cav.1961
Show More Cited By

Index Terms

Interactive Sand Art Drawing Using Kinect
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Interest point and salient region detections
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interactive systems and tools

Recommendations

Multi-scenario gesture recognition using Kinect
CGAMES '12: Proceedings of the 2012 17th International Conference on Computer Games: AI, Animation, Mobile, Interactive Multimedia, Educational & Serious Games (CGAMES)

Hand gesture recognition (HGR) is an important research topic because some situations require silent communication with sign languages. Computational HGR systems assist silent communication, and help people learn a sign language. In this article, a ...
Real-Time Auto Stylized Sand Art Drawing
CADGRAPHICS '13: Proceedings of the 2013 International Conference on Computer-Aided Design and Computer Graphics

We propose a new method for auto stylized sand art drawing. Our system is built on top of our sand drawing system which is mixed with a particle system and a height map. An image is input and the patterns of the image is analyzed. The contours of the ...
Kinect-based Taiwanese sign-language recognition system

Gesture-recognition is an important component for many intelligent human---computer interaction applications. For example, a realtime sign-language recognition system would detect and interpret hand gestures. Many vision-based sign-language recognition ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

VINCI '14: Proceedings of the 7th International Symposium on Visual Information Communication and Interaction

August 2014

262 pages

ISBN:9781450327657

DOI:10.1145/2636240

Editor:
Tony Huang,
General Chairs:
Tomasz Bednarz,
Weidong Huang,
Program Chairs:
Quang Vinh Nguyen,
Yingcai Wu

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 August 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

VINCI '14

VINCI '14: The 7th International Symposium on Visual Information Communication and Interaction

August 5 - 8, 2014

Sydney NSW, Australia

Acceptance Rates

VINCI '14 Paper Acceptance Rate 21 of 62 submissions, 34%;

Overall Acceptance Rate 71 of 193 submissions, 37%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
416
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)5

Reflects downloads up to 30 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhu MYang MMeng WLi P(2023)Sand painting conversion based on detail preservationComputers & Graphics10.1016/j.cag.2023.07.012115(371-381)Online publication date: Oct-2023
https://doi.org/10.1016/j.cag.2023.07.012
Zhu KHe XLi SWang HWang G(2021)Shallow Sand Equations: Real-Time Height Field Simulation of Dry Granular FlowsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2019.294417227:3(2073-2084)Online publication date: 1-Mar-2021
https://doi.org/10.1109/TVCG.2019.2944172
Tseng YWong S(2020)Transferring video to dynamic relief structures with water interactionComputer Animation and Virtual Worlds10.1002/cav.196131:4-5Online publication date: 2-Sep-2020
https://doi.org/10.1002/cav.1961
Chen HWong SHuang PChang YCai YThalmann D(2016)A two-dimensional editing system based on hand gestures and real object manipulation using RGB-D sensorProceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 110.1145/3013971.3013975(119-128)Online publication date: 3-Dec-2016
https://dl.acm.org/doi/10.1145/3013971.3013975
Chen TWong SItoh TBottoni PTakahashi S(2015)Digital Artwork Creation Using Water and Sand on a Two-Dimensional SurfaceProceedings of the 8th International Symposium on Visual Information Communication and Interaction10.1145/2801040.2801046(52-60)Online publication date: 24-Aug-2015
https://dl.acm.org/doi/10.1145/2801040.2801046
Pei-Shan Chen Sai-Keung Wong Wen-Chieh Lin (2015)Two-dimensional digital water art creation on a non-absorbent hydrophilic surface2015 IEEE International Conference on Multimedia and Expo (ICME)10.1109/ICME.2015.7177466(1-6)Online publication date: Jun-2015
https://doi.org/10.1109/ICME.2015.7177466

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents