A Modified Minibatch Sampling Method for Parameter Estimation in Hidden Markov Models using Stochastic Variational Bayes
| dc.contributor.author | Majumder, Reetam | |
| dc.contributor.author | Gobbert, Matthias | |
| dc.contributor.author | Neerchal, Nagaraj K. | |
| dc.date.accessioned | 2022-05-03T14:19:07Z | |
| dc.date.available | 2022-05-03T14:19:07Z | |
| dc.date.issued | 2021-12-14 | |
| dc.description.abstract | Parameter estimation using stochastic variatonal Bayes (SVB) under a mean field assumption can be carried out by sampling a single data point at each iteration of the optimization algorithm. However, when latent variables are dependent like in hidden Markov models (HMM), a larger sample is required at each iteration to capture that dependence. We describe a minibatch sampling procedure for HMMs where the emission process can be segmented into independent and identically distributed blocks. Instead of sampling a block and using all elements within it, we divide the block into subgroups and sample subgroups from different blocks using simple random sampling with replacement. Simulation results are provided for an HMM for precipitation data, where each block of 90 days represents 3 months of wet season data. SVB based on the proposed sampling method is shown to provide parameter estimates comparable with existing methods. | en_US |
| dc.description.sponsorship | This work is supported in part by the U.S. National Science Foundation under the CyberTraining (OAC–1730250) and MRI (OAC–1726023) programs. The hardware used in the computational studies is part of the UMBC High Performance Computing Facility (HPCF). Co-author Reetam Majumder was supported as an HPCF RA. | en_US |
| dc.description.uri | https://onlinelibrary.wiley.com/doi/abs/10.1002/pamm.202100203 | en_US |
| dc.format.extent | 2 pages | en_US |
| dc.genre | journal articles | en_US |
| dc.genre | postprints | en_US |
| dc.identifier | doi:10.13016/m24lwh-b2pt | |
| dc.identifier.citation | Majumder, R., Gobbert, M.K. and Neerchal, N.K. (2021), A Modified Minibatch Sampling Method for Parameter Estimation in Hidden Markov Models using Stochastic Variational Bayes. Proc. Appl. Math. Mech., 21: e202100203. https://doi.org/10.1002/pamm.202100203 | en_US |
| dc.identifier.issn | https://doi.org/10.1002/pamm.202100203 | |
| dc.identifier.uri | http://hdl.handle.net/11603/24664 | |
| dc.language.iso | en_US | en_US |
| dc.publisher | Wiley | en_US |
| dc.relation.isAvailableAt | The University of Maryland, Baltimore County (UMBC) | |
| dc.relation.ispartof | UMBC Mathematics Department Collection | |
| dc.relation.ispartof | UMBC Faculty Collection | |
| dc.relation.ispartof | UMBC Student Collection | |
| dc.rights | This is the peer reviewed version of the following article: Majumder, R., Gobbert, M.K. and Neerchal, N.K. (2021), A Modified Minibatch Sampling Method for Parameter Estimation in Hidden Markov Models using Stochastic Variational Bayes. Proc. Appl. Math. Mech., 21: e202100203. https://doi.org/10.1002/pamm.202100203, which has been published in final form at https://doi.org/10.1002/pamm.202100203. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Use of Self-Archived Versions. This article may not be enhanced, enriched or otherwise transformed into a derivative work, without express permission from Wiley or by statutory rights under applicable legislation. Copyright notices must not be removed, obscured or modified. The article must be linked to Wiley’s version of record on Wiley Online Library and any embedding, framing or otherwise making available the article or pages thereof by third parties from platforms, services and websites other than Wiley Online Library must be prohibited. | en_US |
| dc.rights | Access to this item will begin on 12/14/2022 | |
| dc.subject | UMBC High Performance Computing Facility (HPCF) | en_US |
| dc.title | A Modified Minibatch Sampling Method for Parameter Estimation in Hidden Markov Models using Stochastic Variational Bayes | en_US |
| dc.type | Text | en_US |
| dcterms.creator | https://orcid.org/0000-0003-1745-2295 | en_US |