More Web Proxy on the site http://driver.im/

research-article

GIS navigation boosted by column stores

Editors: Chen Li, Volker Markl Authors:

Foteini Alvanaki,

Romulo Goncalves,

Milena Ivanova,

Martin Kersten,

Kostis KyzirakosAuthors Info & Claims

Proceedings of the VLDB Endowment, Volume 8, Issue 12

Pages 1956 - 1959

https://doi.org/10.14778/2824032.2824110

Published: 01 August 2015 Publication History

Abstract

Earth observation sciences, astronomy, and seismology have large data sets which have inherently rich spatial and geospatial information. In combination with large collections of semantically rich objects which have a large number of thematic properties, they form a new source of knowledge for urban planning, smart cities and natural resource management.

Modeling and storing these properties indicating the relationships between them is best handled in a relational database. Furthermore, the scalability requirements posed by the latest 26-attribute light detection and ranging (LIDAR) data sets are a challenge for file-based solutions.

In this demo we show how to query a 640 billion point data set using a column store enriched with GIS functionality. Through a lightweight and cache conscious secondary index called Imprints, spatial queries performance on a flat table storage is comparable to traditional file-based solutions. All the results are visualised in real time using QGIS.

References

[1]

http://www.asprs.org/a/society/committees/lidar/lidar\_format.html.

[2]

http://www.laszip.org.

[3]

http://www.arcgis.com.

[4]

http://www.ahn.nl.

[5]

http://rapidlasso.com.

[6]

http://www.qgis.org.

[7]

http://www.openstreetmap.org.

[8]

http://www.eea.europa.eu/data-and-maps/data/urban-atlas.

[9]

Open Geospatial Consortium. OpenGIS Implementation Specification for Geographic information - Simple feature access - Part 2: SQL option. OpenGIS Implementation Standard, 2010.

[10]

P. A. Boncz and M. L. Kersten. MIL primitives for querying a fragmented world. VLDB J., 1999.

[11]

P. A. Boncz, S. Manegold, and M. L. Kersten. Database architecture evolution: Mammals flourished long before dinosaurs became extinct. PVLDB, 2009.

[12]

S. Manegold, P. A. Boncz, and M. L. Kersten. Optimizing main-memory join on modern hardware. IEEE TKDE, 2002.

[13]

O. Martinez-Rubi et al. A column-store meets the point cloud. FOSS4G-Europe, 2014.

[14]

S. Ottens. Loading AHN2 into PostgreSQL pointcloud. http://www.geodan.nl/loading-ahn2-into-postgresql-pointcloud/, 2014.

[15]

H. Sagan. Hilbert's space-filling curve. In Space-Filling Curves, pages 9--30. Springer New York, 1994.

[16]

L. Sidirourgos and M. L. Kersten. Column imprints: a secondary index structure. In SIGMOD, 2013.

[17]

M. Stonebraker et al. C-store: A column-oriented DBMS. In VLDB, 2005.

[18]

P. van Oosterom et al. Massive point cloud data management: design, implementation and execution of a point cloud benchmark. Computer Graphics, 2015.

[19]

P. van Oosterom and T. Vijlbrief. The spatial location code. SDH, 1996.

Cited By

Pavlovic MBastian KGildhoff HAilamaki A(2019)Dictionary Compression in Point Cloud Data ManagementACM Transactions on Spatial Algorithms and Systems10.1145/32997705:1(1-25)Online publication date: 6-Jun-2019
https://dl.acm.org/doi/10.1145/3299770
Pavlovic MBastian KGildhoff HAilamaki A(2017)Dictionary Compression in Point Cloud Data ManagementProceedings of the 25th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems10.1145/3139958.3139969(1-10)Online publication date: 7-Nov-2017
https://dl.acm.org/doi/10.1145/3139958.3139969
Zheng KGu DFang FZhang MZheng KLi Q(2017)Data storage optimization strategy in distributed column-oriented database by considering spatial adjacencyCluster Computing10.1007/s10586-017-1081-320:4(2833-2844)Online publication date: 1-Dec-2017
https://dl.acm.org/doi/10.1007/s10586-017-1081-3
Show More Cited By

GIS navigation boosted by column stores
1. Information systems
  1. Data management systems
  2. Information systems applications

Recommendations

Column-stores vs. row-stores: how different are they really?
SIGMOD '08: Proceedings of the 2008 ACM SIGMOD international conference on Management of data

There has been a significant amount of excitement and recent work on column-oriented database systems ("column-stores"). These database systems have been shown to perform more than an order of magnitude better than traditional row-oriented database ...
Modern Column Stores for Big Data Processing
Big Data Analytics
Abstract
The advent of MapReduce/Hadoop and NoSQL databases undermined the primacy of SQL relational databases for data processing. Pioneering work by researchers on MonetDB and C-Store opened up the world of column stores that retain the SQL model but use ...
Biodiversity conservation GIS: using geographic information systems to support conservation management decisions
COM.Geo '11: Proceedings of the 2nd International Conference on Computing for Geospatial Research & Applications

Global changes threaten natural ecosystems that are collapsing and even completely disappearing. Their conservation is a priority to halt the biodiversity loss, and is currently assured by conventions and programmes that aim at maintaining and restoring ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the VLDB Endowment

Proceedings of the VLDB Endowment Volume 8, Issue 12

Proceedings of the 41st International Conference on Very Large Data Bases, Kohala Coast, Hawaii

August 2015

728 pages

ISSN:2150-8097

Editors:
Chen Li
University of California, Irvine
,
Volker Markl
TU Berlin

Issue’s Table of Contents

Publisher

VLDB Endowment

Publication History

Published: 01 August 2015

Published in PVLDB Volume 8, Issue 12

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
84
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Pavlovic MBastian KGildhoff HAilamaki A(2019)Dictionary Compression in Point Cloud Data ManagementACM Transactions on Spatial Algorithms and Systems10.1145/32997705:1(1-25)Online publication date: 6-Jun-2019
https://dl.acm.org/doi/10.1145/3299770
Pavlovic MBastian KGildhoff HAilamaki A(2017)Dictionary Compression in Point Cloud Data ManagementProceedings of the 25th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems10.1145/3139958.3139969(1-10)Online publication date: 7-Nov-2017
https://dl.acm.org/doi/10.1145/3139958.3139969
Zheng KGu DFang FZhang MZheng KLi Q(2017)Data storage optimization strategy in distributed column-oriented database by considering spatial adjacencyCluster Computing10.1007/s10586-017-1081-320:4(2833-2844)Online publication date: 1-Dec-2017
https://dl.acm.org/doi/10.1007/s10586-017-1081-3
Kyzirakos KAlvanaki FKersten M(2016)In memory processing of massive point clouds for multi-core systemsProceedings of the 12th International Workshop on Data Management on New Hardware10.1145/2933349.2933356(1-10)Online publication date: 26-Jun-2016
https://dl.acm.org/doi/10.1145/2933349.2933356

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents