More Web Proxy on the site http://driver.im/

research-article

JOLED: A Mid-air Display based on Electrostatic Rotation of Levitated Janus Objects

Authors:

Deepak Ranjan Sahoo,

Takuto Nakamura,

Michihiro Asakawa,

Sriram SubramanianAuthors Info & Claims

UIST '16: Proceedings of the 29th Annual Symposium on User Interface Software and Technology

Pages 437 - 448

https://doi.org/10.1145/2984511.2984549

Published: 16 October 2016 Publication History

Abstract

We present JOLED, a mid-air display for interactive physical visualization using Janus objects as physical voxels. The Janus objects have special surfaces that have two or more asymmetric physical properties at different areas. In JOLED, they are levitated in mid-air and controllably rotated to reveal their different physical properties. We made voxels by coating the hemispheres of expanded polystyrene beads with different materials, and applied a thin patch of titanium dioxide to induce electrostatic charge on them. Transparent indium tin oxide electrodes are used around the levitation volume to create a tailored electric field to control the orientation of the voxels. We propose a novel method to control the angular position of individual voxels in a grid using electrostatic rotation and their 3D position using acoustic levitation. We present a display in which voxels can be flipped independently, and two mid-air physical games with a voxel as the playable character that moves in 3D across other physical structures and rotates to reflect its status in the games. We demonstrate a voxel update speed of 37.8 ms/flip, which is video-rate.

Supplementary Material

suppl.mov (uist3084-file3.mp4)

Supplemental video

Download
80.27 MB

MP4 File (p437-sahoo.mp4)

Download
250.51 MB

References

[1]

Sankyo International, Reed relay. http://www.sankyointernational.co.jp/ denshibuhin/reed_relay/02.html.

[2]

9613--1:1993, I. Acoustics -- attenuation of sound during propagation outdoors -- part 1: Calculation of the absorption of sound by the atmosphere, 2015.

[3]

9613--2:1996, I. Acoustics -- attenuation of sound during propagation outdoors -- part 2: General method of calculation, 2012.

[4]

Barnum, P. C., Narasimhan, S. G., and Kanade, T. A multi-layered display with water drops. ACM Trans. Graph. 29, 4 (July 2010), 76:1--76:7.

Digital Library

[5]

Demierre, N., Braschler, T., Linderholm, P., Seger, U., van Lintel, H., and Renaud, P. Characterization and optimization of liquid electrodes for lateral dielectrophoresis. Lab Chip 7 (2007), 355--365.

[6]

Eitoku, S., Tanikawa, T., and Suzuki, Y. Display composed of water drops for filling space with materialized virtual three-dimensional objects. In Virtual Reality Conference, 2006 (March 2006), 159--166.

Digital Library

[7]

Foresti, D., Nabavi, M., Klingauf, M., Ferrari, A., and Poulikakos, D. Acoustophoretic contactless transport and handling of matter in air. Proceedings of the National Academy of Sciences 110, 31 (2013), 12549--12554.

[8]

Grossman, T., and Wigdor, D. Going deeper: a taxonomy of 3d on the tabletop. In Horizontal Interactive Human-Computer Systems, 2007. TABLETOP '07. Second Annual IEEE International Workshop on (Oct 2007), 137--144.

[9]

Hilliges, O., Kim, D., Izadi, S., Weiss, M., and Wilson, A. Holodesk: Direct 3d interactions with a situated see-through display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '12, ACM (New York, NY, USA, 2012), 2421--2430.

Digital Library

[10]

Hong, J., Yoon, D. S., Kim, S. K., Kim, T. S., Kim, S., Pak, E. Y., and No, K. Ac frequency characteristics of coplanar impedance sensors as design parameters. Lab Chip 5 (2005), 270--279.

[11]

Howard, M. E., Richley, E. A., Sprague, R., and Sheridon, N. K. Gyricon electric paper. Journal of the Society for Information Display 6, 4 (1998), 215--217.

[12]

Jansen, Y., Dragicevic, P., Isenberg, P., Alexander, J., Karnik, A., Kildal, J., Subramanian, S., and Hornbæk, K. Opportunities and challenges for data physicalization. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI '15, ACM (New York, NY, USA, 2015), 3227--3236.

Digital Library

[13]

Kimura, H., Asano, A., Fujishiro, I., Nakatani, A., and Watanabe, H. True 3d display. In ACM SIGGRAPH 2011 Emerging Technologies, SIGGRAPH '11, ACM (New York, NY, USA, 2011), 20:1--20:1.

Digital Library

[14]

Lawton, B. W. Damage to human hearing by airborne sound of very high frequency or ultrasonic frequency, 2001.

[15]

Lee, C., DiVerdi, S., and Hollerer, T. Depth-fused 3d imagery on an immaterial display. IEEE Transactions on Visualization and Computer Graphics 15, 1 (Jan 2009), 20--33.

Digital Library

[16]

Lee, J., Post, R., and Ishii, H. Zeron: Mid-air tangible interaction enabled by computer controlled magnetic levitation. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, UIST '11, ACM (New York, NY, USA, 2011), 327--336.

Digital Library

[17]

Long, B., Seah, S. A., Carter, T., and Subramanian, S. Rendering volumetric haptic shapes in mid-air using ultrasound. ACM Transactions on Graphics (TOG) 33, 6 (2014), 181.

Digital Library

[18]

Martinez Plasencia, D., Joyce, E., and Subramanian, S. Mistable: Reach-through personal screens for tabletops. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems, CHI '14, ACM (New York, NY, USA, 2014), 3493--3502.

Digital Library

[19]

Marzo, A., Seah, S. A., Drinkwater, B. W., Sahoo, D. R., Long, B., and Subramanian, S. Holographic acoustic elements for manipulation of levitated objects. Nature Communications 6, 8661 (October 2015).

[20]

Matoba, Y., Tokui, T., Sato, R., Sato, T., and Koike, H. Splashdisplay. In Proceedings of the 2012 Virtual Reality International Conference, VRIC '12, ACM (New York, NY, USA, 2012), 27:1--27:4.

Digital Library

[21]

Nakamura, M., Inaba, G., Tamaoki, J., Shiratori, K., and Hoshino, J. Mounting and application of bubble display system: Bubble cosmos. In Proceedings of the 2006 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, ACE '06, ACM (New York, NY, USA, 2006).

Digital Library

[22]

Nash, S. G., and Nocedal, J. A numerical study of the limited memory bfgs method and the truncated-newton method for large scale optimization. SIAM Journal on Optimization 1, 3 (1991), 358--372.

[23]

NIST. EEEL Safety rules for moderate and high voltages, 2008.

[24]

Ochiai, Y., Hoshi, T., and Rekimoto, J. Pixie dust: Graphics generated by levitated and animated objects in computational acoustic-potential field. ACM Trans. Graph. 33, 4 (July 2014), 85:1--85:13.

Digital Library

[25]

Ochiai, Y., Kumagai, K., Hoshi, T., Rekimoto, J., Hasegawa, S., and Hayasaki, Y. Fairy lights in femtoseconds: Aerial and volumetric graphics rendered by focused femtosecond laser combined with computational holographic fields. ACM Trans. Graph. 35, 2 (Feb. 2016), 17:1--17:14.

Digital Library

[26]

Ochiai, Y., Oyama, A., Hoshi, T., and Rekimoto, J. Poppable display: A display that enables popping, breaking, and tearing interactions with people. In Consumer Electronics (GCCE), 2013 IEEE 2nd Global Conference on (Oct 2013), 124--128.

[27]

Omirou, T., Marzo, A., Seah, S. A., and Subramanian, S. Levipath: Modular acoustic levitation for 3d path visualisations. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI '15, ACM (New York, NY, USA, 2015), 309--312.

Digital Library

[28]

Omirou, T., Marzo, A., Subramanian, S., and Roudaut, A. Floating charts: Data plotting using free-floating acoustically levitated representations. In 3D User Interfaces (3DUI), 2016 IEEE Symposium on (March 2016), 1--4.

[29]

Perlin, K., and Han, J. Y. Volumetric display with dust as the participating medium. Retrieved from US Patent 6,997,558, Feb 2006.

[30]

Rakkolainen, I. How feasible are star wars mid-air displays. In Information Visualization, 2007. IV '07. 11th International Conference (July 2007), 935--942.

Digital Library

[31]

Sahoo, D. R., Martinez Plasencia, D., and Subramanian, S. Control of non-solid diffusers by electrostatic charging. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI '15, ACM (New York, NY, USA, 2015), 11--14.

Digital Library

[32]

Saito, H., Kimura, H., Shimada, S., Naemura, T., Kayahara, J., Jarusirisawad, S., Nozick, V., Ishikawa, H., Murakami, T., Aoki, J., Asano, A., Kimura, T., Kakehata, M., Sasaki, F., Yashiro, H., Mori, M., Torizuka, K., and Ino, K. Laser-plasma scanning 3d display for putting digital contents in free space. vol. 6803 (2008), 680309-680309'10.

[33]

Seah, S. A., Martinez Plasencia, D., Bennett, P. D., Karnik, A., Otrocol, V. S., Knibbe, J., Cockburn, A., and Subramanian, S. Sensabubble: A chrono-sensory mid-air display of sight and smell. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems, CHI '14, ACM (New York, NY, USA, 2014), 2863--2872.

Digital Library

[34]

Tokuda, Y., Hiyama, A., Hirose, M., and Yamamoto, H. R2d2 w/ airr: Real time & real space double-layered display with aerial imaging by retro-reflection. In SIGGRAPH Asia 2015 Emerging Technologies, SA '15, ACM (New York, NY, USA, 2015), 20:1--20:3.

Digital Library

[35]

Whymark, R. Acoustic field positioning for containerless processing. Ultrasonics 13, 6 (1975), 251--261.

[36]

Xiang, Y. The electrostatic capacitance of an inclined plate capacitor. Journal of Electrostatics 64, 1 (2006), 29--34.

[37]

Xiang, Y. Further study on electrostatic capacitance of an inclined plate capacitor. Journal of Electrostatics 66, 78 (2008), 366--368.

[38]

Yagi, A., Imura, M., Kuroda, Y., and Oshiro, O. 360degreee fog projection interactive display. In SIGGRAPH Asia 2011 Emerging Technologies, SA '11, ACM (New York, NY, USA, 2011), 19:1--19:1.

Digital Library

Cited By

Min TXia CYamamoto TSugiura Y(2023)Seeing the Wind: An Interactive Mist Interface for Airflow InputProceedings of the ACM on Human-Computer Interaction10.1145/36264807:ISS(398-419)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1145/3626480
Montano-Murillo RHirayama RMartinez Plasencia D(2023)OpenMPD: A Low-Level Presentation Engine for Multimodal Particle-Based DisplaysACM Transactions on Graphics10.1145/357289642:2(1-13)Online publication date: 11-Apr-2023
https://dl.acm.org/doi/10.1145/3572896
Neate TMaffra SFrier WYou ZWilson S(2023)Using Mid-Air Haptics to Guide Mid-Air InteractionsHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42280-5_3(43-64)Online publication date: 25-Aug-2023
https://doi.org/10.1007/978-3-031-42280-5_3
Show More Cited By

Index Terms

JOLED: A Mid-air Display based on Electrostatic Rotation of Levitated Janus Objects
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

TableHop: An Actuated Fabric Display Using Transparent Electrodes
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

We present TableHop, a tabletop display that provides controlled self-actuated deformation and vibro-tactile feedback to an elastic fabric surface while retaining the ability for high-resolution visual projection. The surface is made of a highly ...
Fabrication of functional structures on thin silicon nitride membranes

A process to fabricate functional polysilicon structures above large (4 × 4 mm²) thin (200 nm), very flat LPCVD silicon rich nitride membranes was developed. Key features of this fabrication process are the use of low-stress LPCVD silicon nitride, ...
Lighting sensitive display

Although display devices have been used for decades, they have functioned without taking into account the illumination of their environment. We present the concept of a lighting sensitive display (LSD)---a display that measures the incident illumination ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '16: Proceedings of the 29th Annual Symposium on User Interface Software and Technology

October 2016

908 pages

ISBN:9781450341899

DOI:10.1145/2984511

General Chairs:
Jun Rekimoto
The University of Tokyo
,
Takeo Igarashi
The University of Tokyo
,
Program Chairs:
Jacob O. Wobbrock
University of Washington
,
Daniel Avrahami
FXPAL

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

European Commission's 7th Framework Programme FET Open Scheme
European Research Council's Starting Grant

Conference

UIST '16

Sponsor:

UIST '16: The 29th Annual ACM Symposium on User Interface Software and Technology

October 16 - 19, 2016

Tokyo, Japan

Acceptance Rates

UIST '16 Paper Acceptance Rate 79 of 384 submissions, 21%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

36
Total Citations
View Citations
979
Total Downloads

Downloads (Last 12 months)45
Downloads (Last 6 weeks)5

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Min TXia CYamamoto TSugiura Y(2023)Seeing the Wind: An Interactive Mist Interface for Airflow InputProceedings of the ACM on Human-Computer Interaction10.1145/36264807:ISS(398-419)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1145/3626480
Montano-Murillo RHirayama RMartinez Plasencia D(2023)OpenMPD: A Low-Level Presentation Engine for Multimodal Particle-Based DisplaysACM Transactions on Graphics10.1145/357289642:2(1-13)Online publication date: 11-Apr-2023
https://dl.acm.org/doi/10.1145/3572896
Neate TMaffra SFrier WYou ZWilson S(2023)Using Mid-Air Haptics to Guide Mid-Air InteractionsHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42280-5_3(43-64)Online publication date: 25-Aug-2023
https://doi.org/10.1007/978-3-031-42280-5_3
Fushimi TOchiai Y(2023)Acoustic Levitation and Acoustic HologramsAcoustic Technologies in Biology and Medicine10.1002/9783527841325.ch8(217-242)Online publication date: 6-Oct-2023
https://doi.org/10.1002/9783527841325.ch8
Hirayama RSubramanian S(2022)Magical multi-modal displays using acoustophoresisXRDS: Crossroads, The ACM Magazine for Students10.1145/355819529:1(54-58)Online publication date: 6-Oct-2022
https://dl.acm.org/doi/10.1145/3558195
Paneva VFleig APlasencia DFaulwasser TMüller J(2022)OptiTrap: Optimal Trap Trajectories for Acoustic Levitation DisplaysACM Transactions on Graphics10.1145/351774641:5(1-14)Online publication date: 26-Oct-2022
https://dl.acm.org/doi/10.1145/3517746
Engert SKlamka KPeetz ADachselt R(2022)STRAIDE: A Research Platform for Shape-Changing Spatial Displays based on Actuated StringsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517462(1-16)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517462
Bae SZheng CWest MDo EHuron SSzafir D(2022)Making Data Tangible: A Cross-disciplinary Design Space for Data PhysicalizationProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501939(1-18)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501939
Hirayama RChristopoulos GMartinez Plasencia DSubramanian S(2022)High-speed acoustic holography with arbitrary scattering objectsScience Advances10.1126/sciadv.abn76148:24Online publication date: 17-Jun-2022
https://doi.org/10.1126/sciadv.abn7614
Fender AMartinez Plasencia DSubramanian SKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)ArticuLev: An Integrated Self-Assembly Pipeline for Articulated Multi-Bead Levitation PrimitivesProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445342(1-12)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445342
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents