[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
Long Term Distributed File Reference Tracing: Implementation and ExperienceNovember 1994
1994 Technical Report
Publisher:
  • Carnegie Mellon University
  • Schenley Park Pittsburgh, PA
  • United States
Published:01 November 1994
Reflects downloads up to 06 Jan 2025Bibliometrics
Skip Abstract Section
Abstract

DFSTrace is a system to collect and analyze long-term file reference data in a distributed UNIX workstation environment. The design of DFSTrace is unique in that it pays particular attention to efficiency, extensibility, and the logistics of long-term trace data collection in a distributed environment. The components of DFSTrace are a set of kernel hooks, a kernel buffer mechanism, a data extraction agent, a set of collection servers, and post-processing tools. Our experience with DFSTrace has been highly positive. Tracing has been virtually unnoticeable, degrading performance 3-7%, depending on the level of detail of tracing. We have collected file reference traces from approximately 30 workstations continuously for over two years. We have implemented a post-processing library to provide a convenient programmer interface to the traces, and have created an on-line database of results from a suite of analysis programs to aid trace selection. Our data has been used for a wide variety of purposes, including file system studies, performance measurement and tuning, and debugging. Extensions of DFSTrace have enabled its use in applications such as field reliability testing and determining disk geometry. This paper presents the design, implementation, and evaluation of DFSTrace and associated tools, and describes how they have been used.

Cited By

  1. ACM
    Pereira T, Brasileiro F and Sampaio L A study on the errors and uncertainties of file system trace capture methods Proceedings of the 9th ACM International on Systems and Storage Conference, (1-11)
  2. Patra P, Sahu M, Mohapatra S and Samantray R (2010). File access prediction using neural networks, IEEE Transactions on Neural Networks, 21:6, (869-882), Online publication date: 1-Jun-2010.
  3. ACM
    Traeger A, Zadok E, Joukov N and Wright C (2008). A nine year study of file system and storage benchmarking, ACM Transactions on Storage (TOS), 4:2, (1-56), Online publication date: 11-May-2008.
  4. Joukov N, Wong T and Zadok E Accurate and efficient replaying of file system traces Proceedings of the 4th conference on USENIX Conference on File and Storage Technologies - Volume 4, (25-25)
  5. ACM
    Pâris J, Amer A and Long D A stochastic approach to file access prediction Proceedings of the international workshop on Storage network architecture and parallel I/Os, (36-40)
  6. Whittle G, Pâris J, Amer A, Long D and Burns R Using Multiple Predictors to Improve the Accuracy of File Access Predictions Proceedings of the 20 th IEEE/11 th NASA Goddard Conference on Mass Storage Systems and Technologies (MSS'03)
  7. ACM
    Satyanarayanan M and Ellis C (1996). Adaptation, ACM Computing Surveys (CSUR), 28:4es, (211-es), Online publication date: 1-Dec-1996.
  8. Bosch P and Mullender S Cut-and-paste file-systems Proceedings of the 1996 annual conference on USENIX Annual Technical Conference, (25-25)
  9. ACM
    Moore A, McGregor A and Breen J (1996). A comparison of system monitoring methods, passive network monitoring and kernel instrumentation, ACM SIGOPS Operating Systems Review, 30:1, (16-38), Online publication date: 1-Jan-1996.
  10. ACM
    Mummert L, Ebling M and Satyanarayanan M (1995). Exploiting weak connectivity for mobile file access, ACM SIGOPS Operating Systems Review, 29:5, (143-155), Online publication date: 3-Dec-1995.
  11. ACM
    Mummert L, Ebling M and Satyanarayanan M Exploiting weak connectivity for mobile file access Proceedings of the fifteenth ACM symposium on Operating systems principles, (143-155)
  12. ACM
    Noble B and Satyanarayanan M (2019). A research status report on adaptation for mobile data access, ACM SIGMOD Record, 24:4, (10-15), Online publication date: 1-Dec-1995.
Contributors
  • Intel Corporation
  • Carnegie Mellon University
Please enable JavaScript to view thecomments powered by Disqus.

Recommendations