More Web Proxy on the site http://driver.im/

research-article

XICE windowing toolkit: Seamless display annexation

Authors:

Richard Arthur,

Dan R. Olsen, Jr.Authors Info & Claims

ACM Transactions on Computer-Human Interaction (TOCHI), Volume 18, Issue 3

Article No.: 14, Pages 1 - 46

https://doi.org/10.1145/1993060.1993064

Published: 08 August 2011 Publication History

Abstract

Users are increasingly nomadic, carrying computing power with them. To gain rich input and output, users could annex displays and input devices when available, but annexing via VGA cable is insufficient. This article introduces XICE, which uses wireless networks to connect portable devices to display servers. Network connections eliminate cables, allow multiple people to share a display, and ease input annexation. XICE mitigates potentially malicious input, and facilitates comfortable viewing on a variety of displays via view-independent coordinates. The XICE-distributed graphics model greatly reduces portable device CPU usage and extends portable device battery life.

References

[1]

Adobe Systems. 1996. Adobe Flash. http://get.adobe.com/flashplayer/(accessed 6/11).

[2]

ANSI. 1984. GKS. ANSIX3.124-1985.

[3]

Apple Computer. 2010a. iPhone. http://www.apple.com/iphone/(accessed 6/10).

[4]

Apple Computer. 2010b. Bonjour. http://www.apple.com/support/bonjour/(accessed 6/10).

[5]

Apple Computer. 2010c. Cocoa. http://developer.apple.com/technologies/mac/cocoa.htmh (accessed 7/10).

[6]

Argue, R. 2007. Advanced multi-display configuration and connectivity. MS dissertation. Dalhousie Univ.

[7]

Bartels Media GMBH. 2011. MaxiVista. http://www.maxivista.com/(accessed 1/11).

[8]

Baudisch, P., Cutrell, E., Hinckley, K., and Gruen, R. 2004. Mouse ether: Accelerating the acquisition of targets across multi-monitor displays. In Proceedings of Extended Abstracts on Human Factors in Computing Systems (CHI'04). ACM press, 1379--1382.

Digital Library

[9]

Bederson, B. B., Grosjean, J., and Meyer, J. 2004. Toolkit design for interactive structured graphics. IEEE Softw. Engin. 535--546.

Digital Library

[10]

Berger, S., Kjeldsen, R., Narayanaswami, C., Pinhanez, C., Podlaseck, M., and Raghunath, M. 2005. Using symbiotic displays to view sensitive information in public. In Proceedings of the 3rd IEEE International Conference on Pervasive Computing and Communications (PerCom'05). IEEE Computer Society, 139--148.

Digital Library

[11]

Bharat, K. and Cardelli, L. 1997. Migratory applications. In Lecture Notes in Computer Science. Springer Berlin, 131--148.

Digital Library

[12]

Biehl, J. T., Baker, W. T., Bailey, B. P., Tan, D. S., Inkpen, K. M., and Czerwinski, M. 2008. Impromptu: A new interaction framework for supporting collaboration in multiple display environments and its field evaluation for co-located software development. In Proceeding of the 26th Annual SIGCHI Conference on Human Factors in Computing Systems (CHI'08). ACM, New York, 939--948.

Digital Library

[13]

Canonical, Ltd., 2011. Ubuntu 10.10, http://www.ubuntu.com/. (accessed 1/11).

[14]

Chapuis, O. and Roussel, N. 2005. Metisse is not a 3D desktop&excl; In Proceedings of the User Interface Software and Conference Technology (UIST'05). ACM, 13--22.

Digital Library

[15]

Cisco Systems Inc. 1997. WebEx, http://www.webex.com/. (accessed 1/11).

[16]

Citrix Systems, Inc. 1997. Citrix Online, http://www.citrixonline.com/. (accessed 1/11).

[17]

Edwards, W. K., Newman, M. W., Sedivy, J., Smith, T., and Izadi, S. 2002. Challenge: Recombinant computing and the speakeasy approach. In Proceedings of the 8th Annual international Conference on Mobile Computing and Networking (MobiCom'02). ACM, New York, 279--286.

Digital Library

[18]

Equalizer Graphics. 2008. http://www.equalizergraphics.com/(accessed 1/11).

[19]

Flanagan, D. 2006. JavaScript: The Definitive Guide. O'Reilly Media, Inc.

Digital Library

[20]

Google, Inc. 2011. Android, http://www.android.com/. (accessed 8/11).

[21]

Gosling, J., Joy, B., Steele, G., and Bracha, G. 2011. Java Language Specification, 2nd Ed. The Java Series. Addison-Wesley Longman Publishing Co., Inc.

[22]

Gosling, J., Rosenthal, D., and Arden, M. 1989. The NeWS Book: An Introduction to the Networked Extensible Window System, Sun Microsystems.

Digital Library

[23]

Howard, M. and LeBlanc, D. 2003. Writing Secure Code, 2nd Ed. Microsoft Press.

Digital Library

[24]

Hutterer, P., and Thomas, B. H. 2007. 'Groupware support in the windowing system. In Proceedings of the 8th Australasian Conference on User Interface (AUIC'07). Australian Computer Society, Inc., 39--46.

Digital Library

[25]

International Business Machines Corp., 2011. NMON performance: Nigel's Monitor. http://www.ibm.com/developerworks/aix/library/au-analyze_aix/. (accessed 1/11).

[26]

Izadi, S., Brignull, H., Rodden, T., Rogers, Y., and Underwood, M. 2003. Dynamo: A public interactive surface supporting the cooperative sharing and exchange of media. In Proceedings of the User Interface Software and Technology Conference (UIST'03). ACM, 159--168.

Digital Library

[27]

Jiang, H., Wigdor, D., Forlines, C., Borkin, M., Kauffmann, J., and Shen, C. 2008. LivOlay: Interactive ad-hoc registration and overlapping of applications for collaborative visual exploration. In Proceeding of the 26th Annual SIGCHI Conference on Human Factors in Computing Systems (CHI'08). ACM, 1357--1360.

Digital Library

[28]

Johanson, B., Fox, A., and Winograd, T. 2002. The interactive workspaces project: Experiences with ubiquitous computing rooms. IEEE Pervasive Comput. 1, 2, 67--74.

Digital Library

[29]

Liu, Z. 2007. Lacome: A cross-platform multi-user collaboration system for a shared large display. Computer Science, University of British Columbia. http://hdl.handle.net/2429/378.

[30]

Microsoft Corporation. 2011a. Kinect, http://www.xbox.com/en-US/kinect. (accessed 1/11).

[31]

Microsoft Corporation. 2011b. logman, http://technet.microsoft.com/en-us/library/bb490956.aspx. (accessed 1/11).

[32]

Microsoft Corporation. 2011c. NET Framework http://www.microsoft.com/net/. (accessed 6/11).

[33]

Microsoft Corporation. 2011d. Network Projectors. Microsoft Corporation. http://msdn.microsoft.com/en-us/library/aa934598.aspx. (accessed 6/11).

[34]

Microsoft Corporation. 2011e. Silverlight, http://www.microsoft.com/silverlight/. (accessed 6/11).

[35]

Microsoft Corporation. 2011f. Windows Phone 7 Series, http://www.windowsphone7.com/. (accessed 6/11).

[36]

Microsoft Corporation. 2011g. Visual C&num;, http://msdn.microsoft.com/en-us/vcsharp/default.aspx, 2000.

[37]

Myers, B. A. 2001. Using handhelds and PCs together. Comm. ACM 44, 11, 34--41.

Digital Library

[38]

Naef, M., Lamboray, E., Staadt, O., and Gross, M. 2003. The blue-c distributed scene graph. In Proceedings of the Workshop on Virtual Environments (EGVE'03). ACM, 125--133.

Digital Library

[39]

Nichols, J., Myers, B. A., and Rothrock, B. 2006. UNIFORM: Automatically generating consistent remote control user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'06). ACM, 611--620.

Digital Library

[40]

Nintendo Co., Ltd. 2011. Wii, http://www.wii.com/. (accessed 1/11).

[41]

Olsen, D. R. 1999. Interacting in chaos. Interactions, 42--54.

Digital Library

[42]

Olsen, D. R., Clement, J., and Pace, A. 2007. Spilling: Expanding hand held interaction to touch table displays. In Proceedings of TABLETOP '07. IEEE Computer Society. 163--170.

[43]

Olsen, D. R., Hudson, S. E., Verratti, T., Heiner, J. M., and Phelps, M. 1999. Implementing interface attachments based on surface representations. In Proceedings of the Symposium on Human Factors in Computing Systems (CHI'99). ACM, 191--198.

Digital Library

[44]

Olsen, D. R., Nielsen, S. T., and Parslow, D. 2001. Join and capture: A model for nomadic interaction. In Proceedings of the User Interface Software and Technology Conference (UIST'01). ACM, 131--140.

Digital Library

[45]

Oprea, A., Balfanz, D., Durfee, G., and Smetters, D. K. 2004. “Securing a remote terminal application with a mobile trusted device. In Proceedings of the 20th Annual Computer Security Applications Conference. 438--447.

Digital Library

[46]

Oracle Corporation. 2011a. Java documents on DataOutputStream, Oracle Corporation, http://download.oracle.com/javase/6/docs/api/java/io/DataOutputStream.html. (accessed 1/11).

[47]

Oracle Corporation. 2011b. Java media framework, Oracle Corporation, http://java.sun.com/javase/technologies/desktop/media/jmf/. (accessed 1/11).

[48]

Oracle Corporation. 2011c. OpenJDK, Oracle Corporation, http://openjdk.java.net/. (accessed 1/11).

[49]

Paek, T., Agrawala, M., Basu, S., Drucker, S., Kristjansson, T., Logan, R., Toyama, K., and Wilson, A. 2004. Toward universal mobile interaction for shared displays. In Proceedings of the Computer Supported Cooperative Work Conference (CSCW'04), ACM, 266--269.

Digital Library

[50]

Perlin, K. and Fox, D. 1993. Pad: An alternative approach to the computer interface. In Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'93). ACM, 57--64.

Digital Library

[51]

Petzold, C. 2006. Applications = Code + Markup: A Guide to the Microsoft Windows Presentation Foundation, Microsoft Press.

Digital Library

[52]

Pierce, J. S. and Mahaney, H. E. 2004. Opportunistic annexing for handheld devices: Opportunities and challenges. In Proceedings of HCIC (HCIC'04).

[53]

RealVNC Ltd. 2011. RealVNC, http://realvnc.com/. (accessed 1/11).

[54]

Richardson, T., Stafford-Fraser, Q., Wood, K. R., and Hopper, A. 1998. Virtual Network Computing. IEEE Internet Comput. 2, 1.

Digital Library

[55]

Scheifler, R. W. and Gettys, J. 1986. The X window system. ACM Trans. Graph. 5, 2, 79--109.

Digital Library

[56]

Sharp, R., Madhavapeddy, A., Want, R., and Pering, T. 2008. Enhancing web browsing security on public terminals using mobile composition. In Proceeding of the 6th International Conference on Mobile Systems, Applications, and Services (MobiSys'08). ACM, 94--105.

Digital Library

[57]

Sharp, R., Scott, J., and Beresford, A. R. 2006. Secure mobile computing via public terminals. In Proceedings of the International Conference on Pervasive Computing (PerCom'06). IEEE Computer Society, 238--253.

Digital Library

[58]

Shen, C., Vernier, F. D., Forlines, C., and Ringel, R. 2004. DiamondSpin: An extensible toolkit for around-the-table interaction. In Proceedings of the Symposium on Human Factors in Computing Systems (CHI'04). ACM, 167--174.

Digital Library

[59]

Schilit, B. N. and Sengupta, U. 2004. Device ensembles. Computer 37, 12, 56--64.

Digital Library

[60]

Shuey, D., Bailey, D., and Morrissey, T. P. 1986. PHIGS: A standard, dynamic, interactive graphics interface. Comput. Graph. Appl. 6, 8, 50--57.

Digital Library

[61]

Synergy. 2011. http://synergy-foss.org/. (accessed 1/11).

[62]

Tarasewich, P., Gong, J., and Conlan, R. 2006. Protecting private data in public. In Proceedings of CHI'06 Extended Abstracts on Human Factors in Computing Systems. ACM, 1409--1414.

Digital Library

[63]

Tan, D. S., Meyers, B., and Czerwinski, M. 2004. WinCuts: Manipulating arbitrary window regions for more effective use of screen space. In Proceedings of CHI'04 Extended Abstracts on Human Factors in Computing Systems. ACM, 1525--1528.

Digital Library

[64]

TightVNC Group. 2011. TightVNC, http://tightvnc.com/. (accessed 1/11).

[65]

Thota, C. 2005. Programming MapPoint in .NET, O'Reilly Media, Inc.

Digital Library

[66]

Tritsch, B. 2003. Microsoft Windows Server 2003 Terminal Services, Microsoft Press.

Digital Library

[67]

Want, R., Perins, T., Danneels, G., Kumar, M., Sundar, M., and Light, J. 2002. The personal server: Changing the way we think about ubiquitous computing. In Proceedings of the Ubiquitous Computing Conference (UbiComp'02).

Digital Library

[68]

Yuan, F. 2000. Windows Graphics Programming: Win32 GDI and DirectDraw. Prentice-Hall.

[69]

Yue, C. and Wang, H. 2009. SessionMagnifier: A simple approach to secure and convenient kiosk browsing. In Proceedings of the 11th International Conference on Ubiquitous Computing (Ubicomp '09). ACM, 125--134.

Digital Library

Cited By

Lachand-Pascal VMichel CSerna ATabard A(2023)Challenges and Opportunities for Multi-Device Management in ClassroomsACM Transactions on Computer-Human Interaction10.1145/351902529:6(1-27)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3519025
McGill MWilliamson JBrewster SOlivier PWright PBartindale TObrist MCesar PBasapur S(2014)Mirror, mirror, on the wallProceedings of the ACM International Conference on Interactive Experiences for TV and Online Video10.1145/2602299.2602319(87-94)Online publication date: 25-Jun-2014
https://dl.acm.org/doi/10.1145/2602299.2602319
Yang JWigdor DJones MPalanque PSchmidt AGrossman T(2014)PanelramaProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2556288.2557199(2783-2792)Online publication date: 26-Apr-2014
https://dl.acm.org/doi/10.1145/2556288.2557199
Show More Cited By

Index Terms

XICE windowing toolkit: Seamless display annexation
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Graphical user interfaces

Recommendations

Mobile Journalist Toolkit: a field study on producing news articles with a mobile device
MindTrek '09: Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era

Today's handheld mobile devices with advanced multimedia capabilities and wireless broadband connectivity have emerged as potential new tools for journalists to produce news articles. It is envisioned that they could enable faster, more authentic, and ...
Machine learning algorithms for improving security on touch screen devices: a survey, challenges and new perspectives
Abstract
Mobile phone touch screen devices are equipped with high processing power and high memory. This led to users not only storing photos or videos but stored sensitive application such as banking applications. As a result of that the security system ...
Management of security policies for mobile devices
InfoSecCD '07: Proceedings of the 4th annual conference on Information security curriculum development

This paper discusses management of security policies for mobile devices. The increasing use of mobile devices in the workplace is covered, as well as new software applications that allow employees to use their mobile devices to increase their ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Computer-Human Interaction

ACM Transactions on Computer-Human Interaction Volume 18, Issue 3

July 2011

208 pages

ISSN:1073-0516

EISSN:1557-7325

DOI:10.1145/1993060

Issue’s Table of Contents

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 August 2011

Accepted: 01 March 2011

Revised: 01 February 2011

Received: 01 August 2010

Published in TOCHI Volume 18, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
713
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)1

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lachand-Pascal VMichel CSerna ATabard A(2023)Challenges and Opportunities for Multi-Device Management in ClassroomsACM Transactions on Computer-Human Interaction10.1145/351902529:6(1-27)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3519025
McGill MWilliamson JBrewster SOlivier PWright PBartindale TObrist MCesar PBasapur S(2014)Mirror, mirror, on the wallProceedings of the ACM International Conference on Interactive Experiences for TV and Online Video10.1145/2602299.2602319(87-94)Online publication date: 25-Jun-2014
https://dl.acm.org/doi/10.1145/2602299.2602319
Yang JWigdor DJones MPalanque PSchmidt AGrossman T(2014)PanelramaProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2556288.2557199(2783-2792)Online publication date: 26-Apr-2014
https://dl.acm.org/doi/10.1145/2556288.2557199
Houben SNielsen SEsbensen MBardram JKranz MSynnes KBoring SLaerhoven K(2013)NooSphereProceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia10.1145/2541831.2541856(1-10)Online publication date: 2-Dec-2013
https://dl.acm.org/doi/10.1145/2541831.2541856
Negulescu MLi YIzadi SQuigley APoupyrev IIgarashi T(2013)Open projectProceedings of the 26th annual ACM symposium on User interface software and technology10.1145/2501988.2502030(281-290)Online publication date: 8-Oct-2013
https://dl.acm.org/doi/10.1145/2501988.2502030
Sicard LTabard AHincapié-Ramos JBardram J(2013)TIDE: Lightweight Device Composition for Enhancing Tabletop Environments with Smartphone ApplicationsHuman-Computer Interaction – INTERACT 201310.1007/978-3-642-40498-6_13(177-194)Online publication date: 2013
https://doi.org/10.1007/978-3-642-40498-6_13
Bardram JGueddana SHouben SNielsen SKonstan JChi EHöök K(2012)ReticularSpacesProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2207676.2208689(2845-2854)Online publication date: 5-May-2012
https://dl.acm.org/doi/10.1145/2207676.2208689
Arthur ROlsen D(2012)Privacy-aware shared UI toolkit for nomadic environmentsSoftware—Practice & Experience10.1002/spe.108542:5(601-628)Online publication date: 1-May-2012
https://dl.acm.org/doi/10.1002/spe.1085

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents