A Data Intensive Statistical Aggregation Engine: A Case Study for Gridded Climate Records
| dc.contributor.author | Chapman, David | |
| dc.contributor.author | Simon, Tyler A. | |
| dc.contributor.author | Nguyen, Phuong | |
| dc.contributor.author | Halem, Milton | |
| dc.date.accessioned | 2023-10-26T19:14:49Z | |
| dc.date.available | 2023-10-26T19:14:49Z | |
| dc.date.issued | 2013-10-31 | |
| dc.description | 2013 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum, 20-24 May 2013, Cambridge, MA, USA | en_US |
| dc.description.abstract | Satellite derived climate instrument records are often highly structured and conform to the "Data-Cube" topology. However, data scales on the order of tens to hundreds of Terabytes make it more difficult to perform the rigorous statistical aggregation and analytics necessary to investigate how our climate is changing over time and space. It is especially cumbersome to supply the full derivation (provenance) of this analysis, as is increasingly required by scientific conferences and journals. In this paper, we address our approach toward the creation of a 55 Terabyte decadal record of Outgoing Long wave Spectrum (OLS) from the NASA Atmospheric Infrared Sounder (AIRS), and describe our open source data-intensive statistical aggregation engine "Gridderama" intended primarily for climate trend analysis, and may be applicable to other aggregation problems involving large structured datasets. | en_US |
| dc.description.uri | https://ieeexplore.ieee.org/document/6651122 | en_US |
| dc.format.extent | 8 pages | en_US |
| dc.genre | conference papers and proceedings | en_US |
| dc.genre | preprints | en_US |
| dc.identifier | doi:10.13016/m2qyno-f0ky | |
| dc.identifier.citation | Chapman, David, Tyler A. Simon, Phuong Nguyen, and Milton Halem. “A Data Intensive Statistical Aggregation Engine: A Case Study for Gridded Climate Records.” In 2013 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum, 2157–64, 2013. https://doi.org/10.1109/IPDPSW.2013.87. | en_US |
| dc.identifier.uri | https://doi.org/10.1109/IPDPSW.2013.87 | |
| dc.identifier.uri | http://hdl.handle.net/11603/30411 | |
| dc.language.iso | en_US | en_US |
| dc.publisher | IEEE | en_US |
| dc.relation.isAvailableAt | The University of Maryland, Baltimore County (UMBC) | |
| dc.relation.ispartof | UMBC Computer Science and Electrical Engineering Department Collection | |
| dc.relation.ispartof | UMBC Faculty Collection | |
| dc.relation.ispartof | UMBC Student Collection | |
| dc.rights | © 2013 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. | en_US |
| dc.title | A Data Intensive Statistical Aggregation Engine: A Case Study for Gridded Climate Records | en_US |
| dc.type | Text | en_US |
| dcterms.creator | https://orcid.org/0000-0002-4862-8396 | en_US |