More Web Proxy on the site http://driver.im/

research-article

Design and Implementation of a CSV Validation System

Authors:

Abdulrazaq Hassan Abba,

Mohammed HassanAuthors Info & Claims

ICAIT'2018: Proceedings of the 3rd International Conference on Applications in Information Technology

Pages 111 - 116

https://doi.org/10.1145/3274856.3274879

Published: 01 November 2018 Publication History

Abstract

The need for error checking is essential in our daily activities, as the saying goes "to err is human". This issue becomes problematic when it involves hidden errors. Depending on the hidden errors, in critical systems this can lead to a tragedy or disaster. There are two possible solutions, either preventing the error or detecting and correcting the error. In the case of file system detection and correction is more effective. In this work we consider the later case of error detection and correction, here we develop a scalable tabular technique for detecting errors in a file system. We apply the technique on a CSV file system with developing an application. The application detects and corrects errors in a CSV file. Scalability is one of the strength that differentiate this work from other related work. This scalability of the application provides an easy way for expanding the scope of possible errors that can be detected and corrected. The work contributes in illustrating a technique that improves confidence in the well-known legacy file CSV. This is very important considering the role of CSV file in transmission and processing of data, especially in data migration. The result of this work indicates a promising scalable approach for error detection and correction on a file system like CSV file.

References

[1]

Nada Amin, Tiark Rompf, and Martin Odersky. 2014. Foundations of path-dependent types. In Acm Sigplan Notices, Vol. 49. ACM, 233--249.

Digital Library

[2]

Henri Binsztok and Adam Koprowski. 2012. System and method for creating a parser generator and associated computer program. US Patent App. 13/384,326.

[3]

Roger S Bivand. 2014. 14 GeoComputation and Open-Source Software. In GeoComputation. CRC Press, 329.

[4]

John Frederick Chionglo. {n. d.}. A Reply to âĂIJWould an IDEâĂę be practical?âĂİ. ({n. d.}).

[5]

Grune Dick and H Ceriel. 1990. Parsing techniques, a practical guide. Technical Report. Technical Report, Tech. Rep.

[6]

Denis Firsov and Tarmo Uustalu. 2014. Certified CYK parsing of context-free languages. Journal of Logical and Algebraic Methods in Programming 83, 5-6 (2014), 459--468.

[7]

Jeffrey EF Friedl. 2002. Mastering regular expressions. "O'Reilly Media, Inc.".

Digital Library

[8]

Jeffrey EF Friedl. 2006. Mastering Regular Expressions: Understand Your Data and Be More Productive. "O'Reilly Media, Inc.".

Digital Library

[9]

Samuel Goëta and Tim Davies. 2016. The daily shaping of state transparency: Standards, machine-readability and the configuration of open government data policies. Science & Technology Studies (2016).

[10]

Terence Parr. 2013. The definitive ANTLR 4 reference. Pragmatic Bookshelf.

Digital Library

[11]

J Repici. 2010. The comma separated value (CSV) file format. Creativyst Inc (2010).

[12]

Tom Ridge. 2011. Simple, functional, sound and complete parsing for all context-free grammars. In International Conference on Certified Programs and Proofs. Springer, 103--118.

Digital Library

[13]

Susie M Stephens, Jake Y Chen, Marcel G Davidson, Shiby Thomas, and Barry M Trute. 2005. Oracle database 10 g: a platform for BLAST search and regular expression pattern matching in life sciences. Nucleic Acids Research 33, suppl_1 (2005), D675--D679.

[14]

Menno Van Zaanen et al. 1997. Error correction using dop. Master's thesis, Vrije Universiteit, Amsterdam (1997).

[15]

Ruben Verborgh and Max De Wilde. 2013. Using OpenRefine. Packt Publishing Ltd.

Digital Library

Cited By

Bhukya HSadanandam M(2023)RoughSet based Feature Selection for Prediction of Breast CancerWireless Personal Communications10.1007/s11277-023-10378-4130:3(2197-2214)Online publication date: 30-Mar-2023
https://doi.org/10.1007/s11277-023-10378-4
Egwom OHassan MTanimu JHamada MOgar O(2022)An LDA–SVM Machine Learning Model for Breast Cancer ClassificationBioMedInformatics10.3390/biomedinformatics20300222:3(345-358)Online publication date: 26-Jun-2022
https://doi.org/10.3390/biomedinformatics2030022
Mistry BParekh HDesai KShah N(2022)Online Examination System with Measures for Prevention of Cheating along with Rapid Assessment and Automatic Grading2022 5th International Conference on Advances in Science and Technology (ICAST)10.1109/ICAST55766.2022.10039552(28-34)Online publication date: 2-Dec-2022
https://doi.org/10.1109/ICAST55766.2022.10039552
Show More Cited By

Recommendations

ToT for CSV: accessing open data CSV files through SQL
iiWAS2019: Proceedings of the 21st International Conference on Information Integration and Web-based Applications & Services

Recently, the push for open data has been very strong, and more and more sources, such as governments are sharing data such as weather records or demographic statistics. The Remote Table Access (RTA) system allows the easy publication of data from a ...
A new random-error-correction code

A new random-error-correction code presented here is one of the most efficient two-error-correction codes. The new code can correct 2-bit random errors within twelve (12) consecutive bits while (15, 7) BCH code [1] corrects two errors within fifteen (15)...
Implementation and Performance Analysis of Two Error Detection and Correction Techniques: CRC and Hamming Code

In computer communication and telecommunication applications, error detection and correction techniques must be employed to ensure a reliable data transmission from the source to the destination. Two of the most prevailing techniques, Cyclic Redundancy ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICAIT'2018: Proceedings of the 3rd International Conference on Applications in Information Technology

November 2018

171 pages

ISBN:9781450365161

DOI:10.1145/3274856

Copyright © 2018 ACM.

Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

In-Cooperation

University of Aizu: University of Aizu

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ICAIT'2018

ICAIT'2018: The 3rd International Conference on Applications in Information Technology

November 1 - 3, 2018

Aizu-Wakamatsu, Japan

Acceptance Rates

ICAIT'2018 Paper Acceptance Rate 33 of 56 submissions, 59%;

Overall Acceptance Rate 122 of 207 submissions, 59%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
125
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)1

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bhukya HSadanandam M(2023)RoughSet based Feature Selection for Prediction of Breast CancerWireless Personal Communications10.1007/s11277-023-10378-4130:3(2197-2214)Online publication date: 30-Mar-2023
https://doi.org/10.1007/s11277-023-10378-4
Egwom OHassan MTanimu JHamada MOgar O(2022)An LDA–SVM Machine Learning Model for Breast Cancer ClassificationBioMedInformatics10.3390/biomedinformatics20300222:3(345-358)Online publication date: 26-Jun-2022
https://doi.org/10.3390/biomedinformatics2030022
Mistry BParekh HDesai KShah N(2022)Online Examination System with Measures for Prevention of Cheating along with Rapid Assessment and Automatic Grading2022 5th International Conference on Advances in Science and Technology (ICAST)10.1109/ICAST55766.2022.10039552(28-34)Online publication date: 2-Dec-2022
https://doi.org/10.1109/ICAST55766.2022.10039552
Zarytskyi OKostenko OBulaienko M(2022)Formalization of Converting Processes and it Validation in Spatial Data InfrastructureSmart Technologies in Urban Engineering10.1007/978-3-031-20141-7_1(3-13)Online publication date: 29-Nov-2022
https://doi.org/10.1007/978-3-031-20141-7_1
Jessica EHamada MYusuf SHassan M(2021)The Role of Linear Discriminant Analysis for Accurate Prediction of Breast Cancer2021 IEEE 14th International Symposium on Embedded Multicore/Many-core Systems-on-Chip (MCSoC)10.1109/MCSoC51149.2021.00057(340-344)Online publication date: Dec-2021
https://doi.org/10.1109/MCSoC51149.2021.00057

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents