[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

Van Gemmeren et al., 2012 - Google Patents

I/O strategies for multicore processing in ATLAS

Van Gemmeren et al., 2012

View PDF
Document ID
16581094678797115669
Author
Van Gemmeren P
Binet S
Calafiura P
Lavrijsen W
Malon D
Tsulaia V
Publication year
Publication venue
Journal of Physics: Conference Series

External Links

Snippet

A critical component of any multicore/manycore application architecture is the handling of input and output. Even in the simplest of models, design decisions interact both in obvious and in subtle ways with persistence strategies. When multiple workers handle I/O …
Continue reading at iopscience.iop.org (PDF) (other versions)

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for programme control, e.g. control unit
    • G06F9/06—Arrangements for programme control, e.g. control unit using stored programme, i.e. using internal store of processing equipment to receive and retain programme
    • G06F9/46—Multiprogramming arrangements
    • G06F9/48—Programme initiating; Programme switching, e.g. by interrupt
    • G06F9/4806—Task transfer initiation or dispatching
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for programme control, e.g. control unit
    • G06F9/06—Arrangements for programme control, e.g. control unit using stored programme, i.e. using internal store of processing equipment to receive and retain programme
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for programme control, e.g. control unit
    • G06F9/06—Arrangements for programme control, e.g. control unit using stored programme, i.e. using internal store of processing equipment to receive and retain programme
    • G06F9/46—Multiprogramming arrangements
    • G06F9/54—Interprogramme communication; Intertask communication
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/30—Information retrieval; Database structures therefor; File system structures therefor
    • G06F17/30067—File systems; File servers
    • G06F17/30129—Details of further file system functionalities
    • G06F17/3015—Redundancy elimination performed by the file system
    • G06F17/30153—Redundancy elimination performed by the file system using compression, e.g. sparse files
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/30—Information retrieval; Database structures therefor; File system structures therefor
    • G06F17/30286—Information retrieval; Database structures therefor; File system structures therefor in structured data stores
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/30—Information retrieval; Database structures therefor; File system structures therefor
    • G06F17/30017—Multimedia data retrieval; Retrieval of more than one type of audiovisual media
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for programme control, e.g. control unit
    • G06F9/06—Arrangements for programme control, e.g. control unit using stored programme, i.e. using internal store of processing equipment to receive and retain programme
    • G06F9/30—Arrangements for executing machine-instructions, e.g. instruction decode
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from or digital output to record carriers, e.g. RAID, emulated record carriers, networked record carriers
    • G06F3/0601—Dedicated interfaces to storage systems
    • G06F3/0628—Dedicated interfaces to storage systems making use of a particular technique
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Error detection; Error correction; Monitoring responding to the occurence of a fault, e.g. fault tolerance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F2209/00—Indexing scheme relating to G06F9/00

Similar Documents

Publication Publication Date Title
US9619430B2 (en) Active non-volatile memory post-processing
Floratou et al. Column-oriented storage techniques for MapReduce
Bende et al. Dealing with small files problem in hadoop distributed file system
US9122700B2 (en) Parallel log structured file system collective buffering to achieve a compact representation of scientific and/or dimensional data
US9684512B2 (en) Adaptive Map-Reduce pipeline with dynamic thread allocations
Abbasi et al. Extending i/o through high performance data services
Tan et al. An approach for fast and parallel video processing on Apache Hadoop clusters
CA2997061C (en) Method and system for parallelization of ingestion of large data sets
TW201227519A (en) Converting desktop applications to web applications
CN103049533A (en) Method for quickly loading data into database
Jin et al. The mapreduce programming model and implementations
Mitchell et al. Visio: Enabling interactive visualization of ultra-scale, time series data via high-bandwidth distributed i/o systems
CN108255966A (en) A kind of data migration method and storage medium
Soumagne et al. Accelerating hdf5 i/o for exascale using daos
CN116185308B (en) Data set processing method, device, equipment, medium and model training system
Cheng et al. Accelerating end-to-end deep learning workflow with codesign of data preprocessing and scheduling
Liu et al. The research and analysis of efficiency of hardware usage base on HDFS
Schmidt et al. An approach for processing large and non-uniform media objects on mapreduce-based clusters
Van Gemmeren et al. I/O strategies for multicore processing in ATLAS
Zheng et al. Software-defined storage for fast trajectory queries using a deltafs indexed massive directory
AU2018350897B2 (en) Memory allocation in a data analytics system
Ruan et al. Hymr: a hybrid mapreduce workflow system
Nowak et al. ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3
Shi et al. Performance evaluation and tuning of biopig for genomic analysis
Zhang et al. A large-scale images processing model based on Hadoop platform