More Web Proxy on the site http://driver.im/

research-article

Public Access

Towards a Practical Ecosystem of Specialized OS Kernels

Authors:

Kyle C. HaleAuthors Info & Claims

ROSS '19: Proceedings of the 9th International Workshop on Runtime and Operating Systems for Supercomputers

Pages 3 - 9

https://doi.org/10.1145/3322789.3328742

Published: 17 June 2019 Publication History

Abstract

Specialized operating systems have enjoyed a recent revival driven both by a pressing need to rethink the system software stack in several domains and by the convenience and flexibility that on-demand infrastructure and virtual execution environments offer. Several barriers exist which curtail the widespread adoption of such highly specialized systems, but perhaps the most consequential of them is that these systems are simply difficult to use. In this paper we discuss the challenges faced by specialized OSes, both for HPC and more broadly, and argue that what is needed to make them practically useful is a reasonable development and deployment model that will form the foundation for a kernel ecosystem that allows intrepid developers to discover, experiment with, contribute to, and write programs for available kernel frameworks while safely ignoring complexities such as provisioning, deployment, cross-compilation, and interface compatibility. We argue that such an ecosystem would allow more developers of highly tuned applications to reap the performance benefits of specialized kernels.

References

[1]

G. Ammons, J. Appavoo, M. Butrico, D. Da Silva, D. Grove, K. Kawachiya, O. Krieger, B. Rosenburg, E. Van Hensbergen, and R. W. Wisniewski. Libra: A library operating system for a JVM in a virtualized execution environment. In Proceedings of the 3rd International Conference on Virtual Execution Environments, VEE '07, pages 44--54, June 2007.

Digital Library

[2]

T. E. Anderson. The case for application-specific operating systems. In Proceedings of the 3rd Workshop on Workstation Operating Systems, Apr. 1992.

[3]

A. Baumann, P. Barham, P. E. Dagand, T. Harris, R. Isaacs, S. Peter, T. Roscoe, A. Schüpbach, and A. Singhania. The Multikernel: A new OS architecture for scalable multicore systems. In Proceedings of the 22nd ACM Symposium on Operating Systems Principles, SOSP '09, pages 29--44, Oct. 2009.

Digital Library

[4]

P. Beckman. Argo: An exascale operating system. http://www.mcs.anl.gov/project/argo-exascale-operating-system.

[5]

F. Bellard. QEMU, a fast and portable dynamic translator. In Proceedings of 2005 USENIX Annual Technical Conference, USENIX ATC'05, pages 41--46, Apr. 2005.

Digital Library

[6]

B. N. Bershad, S. Savage, P. Pardyak, E. G. Sirer, M. E. Fiuczynski, D. Becker, C. Chambers, and S. Eggers. Extensibility, safety and performance in the SPIN operating system. In Proceedings of the 15th ACM Symposium on Operating Systems Principles, SOSP '95, pages 267--283, Dec. 1995.

Digital Library

[7]

S. Boyd-Wickizer, H. Chen, R. Chen, Y. Mao, F. Kaashoek, R. Morris, A. Pesterev, L. Stein, M. Wu, Y. Dai, Y. Zhang, and Z. Zhang. Corey: An operating system for many cores. In Proceedings of the 8th USENIX Conference on Operating Systems Design and Implementation, OSDI'08, pages 43--57, Dec. 2008.

Digital Library

[8]

D. R. Engler, M. F. Kaashoek, and J. O'Toole, Jr. Exokernel: An operating system architecture for application-level resource management. In Proceedings of the 15th ACM Symposium on Operating Systems Principles, SOSP '95, pages 251--266, Dec. 1995.

Digital Library

[9]

N. Evans, K. Pedretti, B. Kocoloski, J. Lange, M. Lang, and P. G. Bridges. A cross-enclave composition mechanism for exascale system software. In Proceedings of the 6th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS '16, June 2016.

Digital Library

[10]

K. B. Ferreira, P. Bridges, and R. Brightwell. Characterizing application sensitivity to OS interference using kernel-level noise injection. In Proceedings of Supercomputing, SC '08, Nov. 2008.

Digital Library

[11]

A. Gara, M. A. Blumrich, D. Chen, G. L.-T. Chiu, P. Coteus, M. E. Giampapa, R. A. Haring, P. Heidelberger, D. Hoenicke, G. V. Kopcsay, T. A. Liebsch, M. Ohmacht, B. D. Steinmacher-Burow, T. Takken, and P. Vranas. Overview of the Blue Gene/L system architecture. IBM Journal of Research and Development, 49(2):195--212, Mar. 2005.

Digital Library

[12]

B. Gerofi, M. Takagi, A. Hori, G. Nakamura, T. Shirasawa, and Y. Ishikawa. On the scalability, performance isolation and device driver transparency of the IHK/McKernel hybrid lightweight kernel. In Proceedings of the 30th IEEE International Parallel and Distributed Processing Symposium, IPDPS '16, pages 1041--1050, May 2016.

[13]

M. Giampapa, T. Gooding, T. Inglett, and R. W. Wisniewski. Experiences with a lightweight supercomputer kernel: Lessons learned from Blue Gene's CNK. In Proceedings of Supercomputing, SC '10, Nov. 2010.

Digital Library

[14]

R. Gioiosa, R. W. Wisniewski, R. Murty, and T. Inglett. Analyzing system calls in multi-OS hierarchical environments. In Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS '15, June 2015.

Digital Library

[15]

K. C. Hale and P. A. Dinda. A case for transforming parallel runtimes into operating system kernels. In Proceedings of the 24th ACM Symposium on High-performance Parallel and Distributed Computing, HPDC '15, June 2015.

Digital Library

[16]

K. C. Hale and P. A. Dinda. Enabling hybrid parallel runtimes through kernel and virtualization support. In Proceedings of the 12th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments, VEE'16, pages 161--175, Apr. 2016.

Digital Library

[17]

K. C. Hale, C. Hetland, and P. A. Dinda. Multiverse: Easy conversion of runtime systems into os kernels via automatic hybridization. In Proceedings of the 14th IEEE International Conference on Autonomic Computing, ICAC'17, July 2017.

[18]

T. Hoefler, T. Schneider, and A. Lumsdaine. Characterizing the influence of system noise on large-scale applications by simulation. In Proceedings of Supercomputing, SC '10, Nov. 2010.

Digital Library

[19]

G. C. Hunt and J. R. Larus. Singularity: Rethinking the software stack. SIGOPS Operating Systems Review, 41(2):37--49, Apr. 2007.

Digital Library

[20]

K. Keahey, P. Riteau, D. Stanzione, T. Cockerill, J. Mambretti, P. Rad, and P. Ruth. Chameleon: a scalable production testbed for computer science research. In J. Vetter, editor, Contemporary High Performance Computing: From Petascale toward Exascale, volume 3 of Chapman & Hall/CRC Computational Science, chapter 5. CRC Press, 1 edition, 2018.

[21]

S. M. Kelly and R. Brightwell. Software architecture of the light weight kernel, Catamount. In Proceedings of the 2005 Cray User Group Meeting, CUG'05, May 2005.

[22]

A. Kivity, Y. Kamay, D. Laor, U. Lublin, and A. Liguori. kvm: the Linux virtual machine monitor. In Proceedings of the Linux Symposium, pages 225--230, June 2007.

[23]

A. Kivity, D. Laor, G. Costa, P. Enberg, N. HartextquoterightEl, D. Marti, and V. Zolotarov. OSvtextemdashoptimizing the operating system for virtual machines. In Proceedings of the 2014 USENIX Annual Technical Conference, USENIX ATC'14, June 2014.

Digital Library

[24]

B. Kocoloski and J. Lange. Better than native: Using virtualization to improve compute node performance. In Proceedings of the 2nd International Workshop on Runtime and Operating Systems for Supercomputers, ROSS '12, June 2012.

Digital Library

[25]

B. Kocoloski and J. Lange. XEMEM: Efficient shared memory for composed applications on multi-os/r exascale systems. In Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing, HPDC '15, pages 89--100, June 2015.

Digital Library

[26]

B. Kocoloski, J. Lange, H. Abbasi, D. E. Bernholdt, T. R. Jones, J. Dayal, N. Evans, M. Lang, J. Lofstead, K. Pedretti, and P. G. Bridges. System-level support for composition of applications. In Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS '15, June 2015.

Digital Library

[27]

R. Koller and D. Williams. Will serverless end the dominance of linux in the cloud? In Proceedings of the 16th Workshop on Hot Topics in Operating Systems, HotOS '17, pages 169--173, May 2017.

Digital Library

[28]

J. Lange, K. Pedretti, T. Hudson, P. Dinda, Z. Cui, L. Xia, P. Bridges, A. Gocke, S. Jaconette, M. Levenhagen, and R. Brightwell. Palacios and kitten: New high performance operating systems for scalable virtualized and native supercomputing. In Proceedings of the 24th IEEE International Parallel and Distributed Processing Symposium, IPDPS'10, Apr. 2010.

[29]

S. Lankes, S. Pickartz, and J. Breitbart. HermitCore: A unikernel for extreme scale computing. In Proceedings of the 6th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS'16, June 2016.

Digital Library

[30]

A. Madhavapeddy, T. Leonard, M. Skjegstad, T. Gazagnaire, D. Sheets, D. Scott, R. Mortier, A. Chaudhry, B. Singh, J. Ludlam, J. Crowcroft, and I. Leslie. Jitsu: Just-in-time summoning of unikernels. In 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 15), pages 559--573, Oakland, CA, 2015.

Digital Library

[31]

A. Madhavapeddy, R. Mortier, C. Rotsos, D. Scott, B. Singh, T. Gazagnaire, S. Smith, S. Hand, and J. Crowcroft. Unikernels: Library operating systems for the cloud. In Proceedings of the 18th International Conference on Architectural Support for Programming Languages and Operating Systems, ASPLOS'13, pages 461--472, Mar. 2013.

Digital Library

[32]

K. S. McKinley. The yin and yang of hardware heterogeneity: Can software survive? In Proceedings of the Companion Publication for the ACM SIGPLAN Conference on Systems, Programming, Languages, and Applications: Software for Humanity (Keynote), SPLASH '13, pages 1--2, Oct. 2013.

Digital Library

[33]

A. B. Montz, D. Mosberger, S. W. O'Malley, L. L. Peterson, and T. A. Proebsting. Scout: A communications-oriented operating system. In Proceedings of the 5th Workshop on Hot Topics in Operating Systems, HotOS '95, pages 58--61, May 1995.

Digital Library

[34]

A. Morari, R. Gioiosa, R. W. Wisniewski, F. J. Cazorla, and M. Valero. A quantitative analysis of os noise. In Proceedings of the 25th IEEE International Parallel and Distributed Processing Symposium, IPDPS '11, pages 852--863, May 2011.

Digital Library

[35]

T. Nowatzki, V. Gangadhan, K. Sankaralingam, and G. Wright. Pushing the limits of accelerator efficiency while retaining programmability. In Proceedings of the 22nd IEEE International Symposium on High Performance Computer Architecture, HPCA '16, pages 27--39, Mar. 2016.

[36]

K. Ousterhout, C. Canel, M. Wolffe, S. Ratnasamy, and S. Shenker. Performance clarity as a first-class design principle. In Proceedings of the 16th Workshop on Hot Topics in Operating Systems, HotOS '17, pages 1--6, May 2017.

Digital Library

[37]

K. Ousterhout, A. Panda, J. Rosen, S. Venkataraman, R. Xin, S. Ratnasamy, S. Shenker, and I. Stoica. The case for tiny tasks in compute clusters. In Proceedings of the 14th Workshop on Hot Topics in Operating Systems, HotOS '13, May 2013.

Digital Library

[38]

J. Ouyang, B. Kocoloski, J. R. Lange, and K. Pedretti. Achieving performance isolation with lightweight co-kernels. In Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing, HPDC '15, pages 149--160, June 2015.

Digital Library

[39]

S. Peter and T. Anderson. Arrakis: A case for the end of the empire. In Proceedings of the 14th Workshop on Hot Topics in Operating Systems, HotOS '13, May 2013.

Digital Library

[40]

D. E. Porter, S. Boyd-Wickizer, J. Howell, R. Olinsky, and G. C. Hunt. Rethinking the library OS from the top down. In Proceedings of the 16th International Conference on Architectural Support for Programming Languages and Operating Systems, ASPLOS'11, pages 291--304, Mar. 2011.

Digital Library

[41]

G. Prekas, M. Kogias, and E. Bugnion. ZygOS: Achieving low tail latency for microsecond-scale networked tasks. In Proceedings of the 26th Symposium on Operating Systems Principles, SOSP '17, pages 325--341, Oct. 2017.

Digital Library

[42]

D. Schatzberg, J. Cadden, H. Dong, O. Krieger, and J. Appavoo. EbbRT: A framework for building per-application library operating systems. In Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation, OSDI '16, pages 671--688, Oct. 2016.

Digital Library

[43]

R. Sun, D. E. Porter, D. Oliveira, and M. Bishop. The case for less predictable operating system behavior. In Proceedings of the 15th Workshop on Hot Topics in Operating Systems, HotOS '15, May 2015.

Digital Library

[44]

N. Vasilakis, B. Karel, and J. M. Smith. From lone dwarfs to giant superclusters: Rethinking operating system abstractions for the cloud. In Proceedings of the 15th Workshop on Hot Topics in Operating Systems, HotOS '15, May 2015.

[45]

A. Venkat and D. M. Tullsen. Harnessing ISA diversity: Design of a heterogeneous-ISA chip multiprocessor. In Proceedings of the 41st Annual International Symposium on Computer Architecuture, ISCA '14, pages 121--132, June 2014.

Digital Library

[46]

M. Wilde, I. Foster, K. Iskra, P. Beckman, Z. Zhang, A. Espinosa, M. Hategan, B. Clifford, and I. Raicu. Parallel scripting for applications at the petascale and beyond. IEEE Computer, 42(11):50--60, Nov. 2009.

Digital Library

[47]

R. W. Wisniewski, T. Inglett, P. Keppel, R. Murty, and R. Riesen. mOS: An architecture for extreme-scale operating systems. In Proceedings of the 4th International Workshop on Runtime and Operating Systems for Supercomputers (ROSS 2014), pages 2:1--2:8, June 2014.

Digital Library

[48]

M. Zahran. Heterogeneous computing: Here to stay. ACM Queue, 14(6), Dec. 2016.

Digital Library

Cited By

Moebius FPfandzelter TBermbach D(2024)Are Unikernels Ready for Serverless on the Edge?2024 IEEE International Conference on Cloud Engineering (IC2E)10.1109/IC2E61754.2024.00022(133-143)Online publication date: 24-Sep-2024
https://doi.org/10.1109/IC2E61754.2024.00022
Wanninger NBowden JShetty KGarg AHale KBromberg YKermarrec AKozyrakis C(2022)Isolating functions at the hardware limit with virtinesProceedings of the Seventeenth European Conference on Computer Systems10.1145/3492321.3519553(644-662)Online publication date: 28-Mar-2022
https://dl.acm.org/doi/10.1145/3492321.3519553

Index Terms

Towards a Practical Ecosystem of Specialized OS Kernels
1. Software and its engineering
  1. Software notations and tools
    1. Development frameworks and environments
  2. Software organization and properties
    1. Contextual software domains
      1. Operating systems
      2. Software infrastructure
        Virtual machines
    2. Software system structures
      1. Software architectures

Recommendations

Experiences teaching operating systems using virtual platforms and Linux

Operating system courses teach students much more when they provide hands-on kernel-level project experience with a real operating system. However, enabling a large class of students to do kernel development can be difficult. To address this problem, we ...
Experiences teaching operating systems using virtual platforms and linux

Operating system courses teach students much more when they provide hands-on kernel-level project experience with a real operating system. However, enabling a large class of students to do kernel development can be difficult. To address this problem, we ...
Experiences teaching operating systems using virtual platforms and linux
SIGCSE '05: Proceedings of the 36th SIGCSE technical symposium on Computer science education

Operating system courses teach students much more when they provide hands-on kernel-level project experience with a real operating system. However, enabling a large class of students to do kernel development can be difficult. To address this problem, we ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ROSS '19: Proceedings of the 9th International Workshop on Runtime and Operating Systems for Supercomputers

June 2019

38 pages

ISBN:9781450367554

DOI:10.1145/3322789

General Chairs:
Torsten Hoefler
ETH Zurich, Switzerland
,
Kamil Iskra
Argonne National Laboratory, USA

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

University of Arizona: University of Arizona
SIGHPC: ACM Special Interest Group on High Performance Computing, Special Interest Group on High Performance Computing
SIGARCH: ACM Special Interest Group on Computer Architecture

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

NSF

Conference

HPDC '19

Sponsor:

University of Arizona
SIGHPC
SIGARCH

HPDC '19: The 28th International Symposium on High-Performance Parallel and Distributed Computing

June 25, 2019

AZ, Phoenix, USA

Acceptance Rates

ROSS '19 Paper Acceptance Rate 22 of 106 submissions, 21%;

Overall Acceptance Rate 58 of 169 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
341
Total Downloads

Downloads (Last 12 months)116
Downloads (Last 6 weeks)9

Reflects downloads up to 13 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Moebius FPfandzelter TBermbach D(2024)Are Unikernels Ready for Serverless on the Edge?2024 IEEE International Conference on Cloud Engineering (IC2E)10.1109/IC2E61754.2024.00022(133-143)Online publication date: 24-Sep-2024
https://doi.org/10.1109/IC2E61754.2024.00022
Wanninger NBowden JShetty KGarg AHale KBromberg YKermarrec AKozyrakis C(2022)Isolating functions at the hardware limit with virtinesProceedings of the Seventeenth European Conference on Computer Systems10.1145/3492321.3519553(644-662)Online publication date: 28-Mar-2022
https://dl.acm.org/doi/10.1145/3492321.3519553

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents