More Web Proxy on the site http://driver.im/

research-article

The Sloan Digital Sky Survey and beyond

Author:

Alexander S. SzalayAuthors Info & Claims

ACM SIGMOD Record, Volume 37, Issue 2

Pages 61 - 66

https://doi.org/10.1145/1379387.1379407

Published: 01 June 2008 Publication History

Abstract

Our collaboration with Jim Gray has created some of the world's largest astronomy databases, and has enabled us to test many avant-garde ideas in practice. The astronomers have been very receptive to these and embraced Jim as a 'card carrying member' of their community. Jim's contributions have made a permanent mark on astronomy, and eScience in general.

Supplementary Material

JPG File (eecs_20080531b3.jpg)

Download
13.86 KB

Audio Only (23088.mp3)

Download
41.44 MB

MP4 File (eecs_20080531b3.mp4)

Download
339.10 MB

References

[1]

Thakar, A., Szalay, A., Kunszt, P. and Gray. J.: Migrating a Multiterabyte Archive from Object to Relational Databases, Computing in Science and Engineering, 5, 16 (2003).

Digital Library

[2]

Szalay, A. S., Kunszt, P. Thakar, A., Gray, J., Slutz, D. and Brunner, R.: Designing and Mining Multi-Terabyte Astronomy Archives: The Sloan Digital Sky Survey, Proc. SIGMOD 2000 Conference, 451--462 (2000).

Digital Library

[3]

Budavari, T., Malik, T., Szalay, A. S., Thakar, A., Gray, J.: SkyQuery: a Prototype Distributed Query Web Service for the Virtual Observatory, Proc. ADASS XII, ASP Conference Series, eds: H. Payne, R. I. Jedrzejewski and R. N. Hook, 295, 31 (2003).

[4]

Szalay, A. S., Budavari, T., Malik, T. Gray, J. and Thakar, A.: Web Services for the Virtual Observatory, Proc. SPIE Conference on Advanced Telescope Technologies, 4846, 124 (2002).

[5]

Szalay, A. S., Budavari, T., Connolly, A. J., Gray, J., Matsubara, T., Pope, A. and Szapudi, I: Spatial Clustering of Galaxies in Large Datasets, Proc. SPIE Conference on Advanced Telescope Technologies, 4846, (2002).

[6]

Szalay, A. S., Gray, J., Fekete, G., Kunszt, P., Kukol, P., Thakar, A.: Indexing the Sphere with the Hierarchical Triangular Mesh, MSR-TR-2005-123 (2005).

[7]

Fekete, G., Szalay, A. S., Gray, J.: HTM2: Spatial Toolkit for the Virtual Observatory, Proc. ADASS XIII, ASP

[8]

Gray, J., Szalay, A. S., Fekete, G.: Using Table Valued Functions in SQL Server 2005 To Implement a Spatial Data Library, MSR-TR-2005-122 (2005).

[9]

Gray, J., Szalay, A. S. Fekete, G., O'Mullane, W., Thakar, A. R., Heber, G., Rots, A. H.: There Goes the Neighborhood: Relational Algebra for Spatial Data Search, Microsoft Technical Report, MSR-TR-2004-32, (2004).

[10]

Gray, J., Nieto-Santisteban, M. A., Szalay, A. S.: " The Zones Algorithm for Finding Points-Near-a-Point or Cross-Matching Spatial Datasets," MSR-TR-2006-52, (2006).

[11]

Nieto-Santisteban, M. A., Thakar, A. R., Szalay, A. S., Gray, J.: Large-Scale Query and XMatch, Entering the Parallel Zone, Astronomical Data Analysis Software and Systems XV ASP Conference Series. Eds: C. Gabriel, C. Arviset, D. Ponz, and E. Solano. San Francisco: Astronomical Society of the Pacific, Vol 351, p.493 (2006).

[12]

Gray, J., Szalay, A., Budavári, T., Thakar, A. R., Nieto-Santisteban, M. A., Lupton, R.: Cross-Matching Multiple Spatial Observations and Dealing with Missing Data, Microsoft Technical Report, MSR-TR-2006-175 (2006).

[13]

Szalay, A. S. and Gray, J.: The World-Wide Telescope, Science, 293, 2037--2040 (2001).

[14]

Gray, J., Szalay, A. S.: Where the Rubber Meets the Sky: Bridging the Gap between Databases and Science, IEEE Data Engineering Bulletin, December 2004, Vol. 27.4 (2004), also MSR-TR-2004-110, October 2004.

[15]

Gray, J., Chong, W., Barclay, T., Szalay, A. S., Vandenberg, J.: TeraScale SneakerNet: Using Inexpensive Disks for Backup, Archiving, and Data Exchange, Microsoft Technical Report, MS-TR-2002-54, (2002).

[16]

O'Mullane, W., Gray, J., Li, N., Budavari, T., Nieto Santisteban, M., Szalay, A. S.: Batch Query System with Interactive local storage for SDSS and the VO, Proc. ADASS XIII, ASP Conference Series, eds: F. Ochsenbein, M. Allen and D. Egret, 314, 372 (2004).

[17]

Singh, V., Gray, J., Thakar, A. R., Szalay, A. S., Raddick, J., Boroski, B., Lebedeva, S., Yanny, B.: SkyServer Traffic Report - The First Five Years, Microsoft Technical Report, MSR-TR-2006-190 (2006).

[18]

Gray, J., Liu, D. T., Nieto-Santisteban, M. A., Szalay, A. S., Heber, G., DeWitt, D.: Scientific Data Management in the Coming Decade, MSR-TR-2005-10 (2005).

[19]

Szalay, A. S., Gray, J.: Science in an Exponential World, Nature, 413, 440 (2006).

[20]

Szalay, A. S., Gray, J., Vandenberg, J.: Petabyte Scale Data Mining: Dream or Reality? Proc. SPIE Conference on Advanced Telescope Technologies, 4846, (2002).

[21]

Bell, G., Gray, J., Szalay, A. S.: Petascale Computational Systems, IEEE Computer, 110, 39 (2006).

Digital Library

[22]

Balazinska, M., Deshpande, A., Franklin, M. J., Gibbons, P. B., Gray, J., Hansen, M., Liebhold, M., Nath, S., Szalay, A., Tao, V.: Data Management in the World-Wide Sensor Web, IEEE Pervasive Computing, 6, p.30 (2007).

Digital Library

[23]

Szlavecz, K., Terzis, A., Musǎloiu-E., R., Cogan, J., Small, S., Ozer, S., Burns, R., Gray, J., Szalay, A. S.: Life Under Your Feet: An End-to-End Soil Ecology Sensor Network, Database, Web Server, and Analysis Service, Microsoft Technical Report, MSR-TR-2006-90 (2006).

[24]

Ozer, S., Szalay, A. S., Szlavecz, K., Terzis, T., Musǎloiu-E., R., Cogan, J.: Using Data-Cubes in Science: an Example from Environmental Monitoring of the Soil Ecosystem, Microsoft Technical Report, MSR-TR-2006-134 (2006).

Cited By

Abramson DBetbeder-Matibet LBird SCarroll JFrancis RGoscinski WSoo ASwan GWalsh CWightwick GWilkinson J(2023)Why We Need a Reference Architecture for Research Data2023 IEEE 19th International Conference on e-Science (e-Science)10.1109/e-Science58273.2023.10254825(1-4)Online publication date: 9-Oct-2023
https://doi.org/10.1109/e-Science58273.2023.10254825
Graur DMüller IProffitt MFourny GWatts GAlonso G(2022)Evaluating query languages and systems for high-energy physics dataProceedings of the VLDB Endowment10.14778/3489496.348949815:2(154-168)Online publication date: 4-Feb-2022
https://dl.acm.org/doi/10.14778/3489496.3489498
(2018)ReferencesMaking Databases Work10.1145/3226595.3226642(635-644)Online publication date: 1-Dec-2018
https://dl.acm.org/doi/10.1145/3226595.3226642
Show More Cited By

Index Terms

The Sloan Digital Sky Survey and beyond
1. Applied computing
  1. Physical sciences and engineering
2. Information systems

Recommendations

The Sloan Digital Sky Survey: Drinking from the Fire Hose

The Sloan Digital Sky Survey Science Archive represents a thousand-fold increase in the total amount of data that astronomers have collected to date. The pioneering instrumentation technology that made this possible is matched by groundbreaking tools ...
The sloan digital sky survey

Astronomy is about to undergo a major paradigm shift, with data sets becoming larger and more homogeneous, designed for the first time in a top-down fashion. In a few years, it might be much easier for astronomers to "dial-up" a part of the sky, when they ...
The Sloan Digital Sky Survey Data Archive Server

The Sloan Digital Sky Survey’s Data Archive Server (DAS) provides public access to data files produced by the SDSS data reduction pipeline. This article discusses challenges in public distribution of data of this complexity and how the project addressed ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM SIGMOD Record

ACM SIGMOD Record Volume 37, Issue 2

Tribute to honor Jim Gray

June 2008

79 pages

ISSN:0163-5808

DOI:10.1145/1379387

Issue’s Table of Contents

Copyright © 2008 Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 2008

Published in SIGMOD Volume 37, Issue 2

Check for updates

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

54
Total Citations
View Citations
396
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to 27 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Abramson DBetbeder-Matibet LBird SCarroll JFrancis RGoscinski WSoo ASwan GWalsh CWightwick GWilkinson J(2023)Why We Need a Reference Architecture for Research Data2023 IEEE 19th International Conference on e-Science (e-Science)10.1109/e-Science58273.2023.10254825(1-4)Online publication date: 9-Oct-2023
https://doi.org/10.1109/e-Science58273.2023.10254825
Graur DMüller IProffitt MFourny GWatts GAlonso G(2022)Evaluating query languages and systems for high-energy physics dataProceedings of the VLDB Endowment10.14778/3489496.348949815:2(154-168)Online publication date: 4-Feb-2022
https://dl.acm.org/doi/10.14778/3489496.3489498
(2018)ReferencesMaking Databases Work10.1145/3226595.3226642(635-644)Online publication date: 1-Dec-2018
https://dl.acm.org/doi/10.1145/3226595.3226642
(2018)The collected works of Michael StonebrakerMaking Databases Work10.1145/3226595.3226641(606-633)Online publication date: 1-Dec-2018
https://dl.acm.org/doi/10.1145/3226595.3226641
Stonebraker MWong EKreps PHeld G(2018)The design and implementation of INGRESMaking Databases Work10.1145/3226595.3226640(561-605)Online publication date: 1-Dec-2018
https://dl.acm.org/doi/10.1145/3226595.3226640
Stonebraker MRowe LHirohama M(2018)The implementation of POSTGRESMaking Databases Work10.1145/3226595.3226639(519-559)Online publication date: 1-Dec-2018
https://dl.acm.org/doi/10.1145/3226595.3226639
Stonebraker MAbadi DBatkin AChen XCherniack MFerreira MLau ELin AMadden SO'Neil EO'Neil PRasin ATran NZdonik S(2018)C-storeMaking Databases Work10.1145/3226595.3226638(491-518)Online publication date: 1-Dec-2018
https://dl.acm.org/doi/10.1145/3226595.3226638
Stonebraker MMadden SAbadi DHarizopoulos SHachem NHelland P(2018)The end of an architectural eraMaking Databases Work10.1145/3226595.3226637(463-489)Online publication date: 1-Dec-2018
https://dl.acm.org/doi/10.1145/3226595.3226637
Stonebraker MÇetintemel U(2018)"One size fits all"Making Databases Work10.1145/3226595.3226636(441-462)Online publication date: 1-Dec-2018
https://dl.acm.org/doi/10.1145/3226595.3226636
Harizopoulos SAbadi DMadden SStonebraker M(2018)OLTP through the looking glass, and what we found thereMaking Databases Work10.1145/3226595.3226635(409-439)Online publication date: 1-Dec-2018
https://dl.acm.org/doi/10.1145/3226595.3226635
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents