Performance Evaluation of Minimum Average Deviance Estimation in High Dimensional Poisson Regression
| dc.contributor.author | Biggs, Ely | |
| dc.contributor.author | Helble, Tessa | |
| dc.contributor.author | Jeffreys, George | |
| dc.contributor.author | Nayak, Amit | |
| dc.contributor.author | Al-Najjar, Elias | |
| dc.contributor.author | Raim, Andrew M. | |
| dc.contributor.author | Adragni, Kofi P. | |
| dc.date.accessioned | 2018-09-25T19:36:35Z | |
| dc.date.available | 2018-09-25T19:36:35Z | |
| dc.date.issued | 2015 | |
| dc.description.abstract | The second most expensive part of the 2010 Decennial Census was Address Canvassing (AdCan), a eld operation to prepare the Master Address File (MAF) for census day. The MAF is a database of households in the United States maintained by the US Census Bureau and is used as a basis for the census and household surveys that it conducts. Motivated by the importance of the MAF and the cost of a large scale AdCan operation, there is an interest to use statistical methodologies to explain MAF errors discovered during canvassing. Ideally, statistical models could be used to predict future errors and assist with updating of the MAF. A major challenge in constructing a MAF error model is that important predictor variables associated with MAF errors are not known. Some recent works at Census Bureau have carried out variable selection using a collection of data sources, treating counts of errors per census block as the outcome. It may be possible to use dimension reduction methodologies to obtain count models with much lower dimensional predictors. Adragni et al. [4] proposed a methodology called Minimum Average Deviance Estimation (MADE), which is based on the concept of local regression and embeds sufficient dimension reduction of the predictors. MADE assumes a forward regression with the response variable following an exponential family distribution, such as Poisson for counts. The goal of this project is to evaluate the performance of MADE on large data sets using simulations. We parallelized several snippets of the MADE source code to improve its performance and compare the speed up of these parallelized snippets with their serial alternatives. Simulated data sets with increasing dimensions are used to evaluate the run time. A limited stress test is performed to determine the extent of problem size that MADE can handle on maya, a high performance computing cluster at UMBC. These tests allow us to evaluate the capabilities of MADE to scale to large data sets, such as the AdCan modeling problem. | en_US |
| dc.description.sponsorship | These results were obtained as part of the REU Site: Interdisciplinary Program in High Performance Computing (hpcreu.umbc.edu) in the Department of Mathematics and Statistics at the University of Maryland, Baltimore County (UMBC) in Summer 2015. This program is funded by the National Science Foundation (NSF), the National Security Agency (NSA), and the Department of Defense (DOD),with additional support from UMBC, the Department of Mathematics and Statistics, the Center for Interdisciplinary Research and Consulting (CIRC), and the UMBC High Performance Computing Facility (HPCF). HPCF is supported by the U.S. National Science Foundation through the MRI program (grant nos. CNS-0821258 and CNS-1228778)and the SCREMS program (grant no. DMS-0821311),with additional substantial support from UMBC. Graduate assistant Elias Al-Najjar was supported during Summer 2015 by UMBC. | en_US |
| dc.description.uri | https://userpages.umbc.edu/~gobbert/papers/REU2015Team1.pdf | en_US |
| dc.format.extent | 13 pages | en_US |
| dc.genre | technical report | en_US |
| dc.identifier | doi:10.13016/M20G3H26M | |
| dc.identifier.uri | http://hdl.handle.net/11603/11375 | |
| dc.language.iso | en_US | en_US |
| dc.relation.isAvailableAt | The University of Maryland, Baltimore County (UMBC) | |
| dc.relation.ispartof | UMBC Mathematics Department Collection | |
| dc.relation.ispartof | UMBC Faculty Collection | |
| dc.relation.ispartof | UMBC Student Collection | |
| dc.relation.ispartofseries | HPCF Technical Report;HPCF-2015-21 | |
| dc.rights | This item is likely protected under Title 17 of the U.S. Copyright Law. Unless on a Creative Commons license, for uses protected by Copyright Law, contact the copyright holder or the author. | |
| dc.subject | Sufficient dimension reduction | en_US |
| dc.subject | local linear regression | en_US |
| dc.subject | parallelization | en_US |
| dc.subject | UMBC High Performance Computing Facility (HPCF) | en_US |
| dc.title | Performance Evaluation of Minimum Average Deviance Estimation in High Dimensional Poisson Regression | en_US |
| dc.type | Text | en_US |