[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.5555/1029824.1029852guideproceedingsArticle/Chapter ViewAbstractPublication PagesConference Proceedingsacm-pubtype
Article

The Brave Little Toaster Meets Usenet

Published: 04 October 1996 Publication History

Abstract

Usenet volume has been growing exponentially for many years; this growth places ever-increasing demands on the resources of a netnews server, particularly disk space - and file system performance - for the article spool area. Keeping up with this demand became substantially more difficult when it could no longer be satisfied by a single disk, and since netnews is incidental to SLAC's research mission, we wanted to find a solution that could easily scale to meet future growth while requiring minimal system administration effort. In the process of evaluating the various solutions that were proposed, we developed benchmarks to measure performance for this specialized application, and were surprised to find that some of our beliefs and intuition were not supported by the facts.
The alternatives considered by SLAC are described, as are the benchmarks developed to evaluate the alternatives, and the results of those benchmarks. While netnews is the application we examined, our experience will hopefully provide inspiration for others to more carefully evaluate their applications instead of using stock benchmarks that may not correlate well with the intended use. Our results may also break down some biases and encourage the reader to consider alternatives which might otherwise have been ignored.

References

[1]
Karl L. Swartz, "Forecasting Disk Resource Requirements for a Usenet Server," Proceedings of the 7th USENIX Large Installation System Administration Conference (LISA VII), pp. 101-108, Monterey, California, November 1993. Also published as SLAC-PUB-6353.]]
[2]
Karl L. Swartz, "Usenet Growth Graphs," http://www.chicago.com/~kls/newsgrowth.html.]]
[3]
Rick Adams, Usenet post, c. September 1993.]]
[4]
OnLine: DiskSuite Reference Manual, Sun Microsystems, Mountain View, California, 1991.]]
[5]
D. Patterson, G. Gibson, and R. Katz, "A Case for Redundant Arrays of Inexpensive Disks (RAID)," ACM SIGMOD 88, pp. 109-116, Chicago, June 1988.]]
[6]
Marshall Kirk McKusick, William N. Joy, Samuel J. Leffler, and Robert S. Fabry, "A Fast File System for UNIX," in 4.4BSD System Manager's Manual, O'Reilly & Associates, Sebastopol, California, April 1994.]]
[7]
V. Jacobson, "Compressing TCP/IP Headers for Low-Speed Serial Links," RFC 1144, February 1990. Footnote 29.]]
[8]
Solstice DiskSuite 4.0 Administration Guide, Sun Microsystems, Mountain View, California, March 1995.]]
[9]
Byron Rakitzis and Andy Watson, Accelerated Performance for Large Directories, Technical Report 3006, Network Appliance, Mountain View, California, February 1996.]]
[10]
Samuel J. Leffler, Marshall Kirk McKusick, Michael J. Karels, and John S. Quarterman, The Design and Implementation of the 4.3BSD UNIX Operating System, Addison-Wesley, Reading, Massachusetts, 1989.]]
[11]
Mark Wittle and Bruce E. Keith, "LADDIS: The Next Generation in NFS File Server Benchmarking," Proceedings of the 1993 Summer USENIX Technical Conference, pp. 111-128, Cincinnati, Ohio, June 1993.]]
[12]
Rich Salz, "InterNetNews: Usenet transport for Internet sites," Proceedings of the 1992 Summer USENIX Technical Conference, pp. 93-98, San Antonio, Texas, June 1992.]]
[13]
David Lawrence, private conversation, January 1996.]]
[14]
Dave Hitz, James Lau, and Michael Malcolm, "File System Design for an NFS File Server Appliance," Proceedings of the 1994 Winter USENIX Technical Conference, pp. 235-245, San Francisco, January 1994. Also published as Network Appliance Technical Report 3002.]]
[15]
Brian Kantor and Phil Lapsley, "Network News Transfer Protocol," RFC 977, February 1986.]]
[16]
Margo Seltzer, Keith Bostic, Marshall Kirk McKusick, and Carl Staelin, "An Implementation of a Log-Structured File System for UNIX," Proceedings of the 1993 Winter USENIX Technical Conference, pp. 307-326, San Diego, California, January 1993.]]
[17]
Margo Seltzer, Keith A. Smith, Hari Balakrishnan, Jacqueline Chang, Sara McMains, and Venkata Padmanabhan, "File System Logging versus Clustering: A Performance Comparison," Proceedings of the 1995 Winter USENIX Technical Conference, pp. 249-264, New Orleans, Louisiana, January 1995.]]
[18]
Helen Custer, Inside the Windows NT File System, Microsoft Press, Redmond, Washington, 1994.]]
[19]
Thomas M. Disch, The Brave Little Toaster, Doubleday & Company, Garden City, New York, 1986. The full-length animated movie of the same title, based on this novella, inspired the title of this paper.]]

Cited By

View all
  • (2008)A nine year study of file system and storage benchmarkingACM Transactions on Storage10.1145/1367829.13678314:2(1-56)Online publication date: 28-May-2008
  • (2003)Semantically-smart disk systemsProceedings of the 2nd USENIX conference on File and storage technologies10.5555/1973355.1973361(6-6)Online publication date: 31-Mar-2003

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings
LISA '96: Proceedings of the 10th USENIX conference on System administration
October 1996
279 pages

Publisher

USENIX Association

United States

Publication History

Published: 04 October 1996

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 06 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2008)A nine year study of file system and storage benchmarkingACM Transactions on Storage10.1145/1367829.13678314:2(1-56)Online publication date: 28-May-2008
  • (2003)Semantically-smart disk systemsProceedings of the 2nd USENIX conference on File and storage technologies10.5555/1973355.1973361(6-6)Online publication date: 31-Mar-2003

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media