Generating Thermal Human Faces for Physiological Assessment Using Thermal Sensor Auxiliary Labels
| dc.contributor.author | Ordun, Catherine | |
| dc.contributor.author | Raff, Edward | |
| dc.contributor.author | Purushotham, Sanjay | |
| dc.date.accessioned | 2021-07-06T14:13:09Z | |
| dc.date.available | 2021-07-06T14:13:09Z | |
| dc.date.issued | 2021-06-15 | |
| dc.description.abstract | Thermal images reveal medically important physiological information about human stress, signs of inflammation, and emotional mood that cannot be seen on visible images. Providing a method to generate thermal faces from visible images would be highly valuable for the telemedicine community in order to show this medical information. To the best of our knowledge, there are limited works on visible-to-thermal (VT) face translation, and many current works go the opposite direction to generate visible faces from thermal surveillance images (TV) for law enforcement applications. As a result, we introduce favtGAN, a VT GAN which uses the pix2pix image translation model with an auxiliary sensor label prediction network for generating thermal faces from visible images. Since most TV methods are trained on only one data source drawn from one thermal sensor, we combine datasets from faces and cityscapes. These combined data are captured from similar sensors in order to bootstrap the training and transfer learning task, especially valuable because visible-thermal face datasets are limited. Experiments on these combined datasets show that favtGAN demonstrates an increase in SSIM and PSNR scores of generated thermal faces, compared to training on a single face dataset alone. | en_US |
| dc.description.sponsorship | This work is partially supported by grant IIS–1948399 from the US National Science Foundation and grant 80NSSC21M0027 from the National Aeronautics and Space Administration. | en_US |
| dc.description.uri | https://arxiv.org/abs/2106.08091 | en_US |
| dc.format.extent | 5 pages | en_US |
| dc.genre | journal articles preprints | en_US |
| dc.identifier | doi:10.13016/m27zd7-pxwc | |
| dc.identifier.uri | http://hdl.handle.net/11603/21854 | |
| dc.language.iso | en_US | en_US |
| dc.relation.isAvailableAt | The University of Maryland, Baltimore County (UMBC) | |
| dc.relation.ispartof | UMBC Computer Science and Electrical Engineering Department Collection | |
| dc.relation.ispartof | UMBC Faculty Collection | |
| dc.relation.ispartof | UMBC Student Collection | |
| dc.relation.ispartof | UMBC Information Systems Department | |
| dc.rights | This item is likely protected under Title 17 of the U.S. Copyright Law. Unless on a Creative Commons license, for uses protected by Copyright Law, contact the copyright holder or the author. | |
| dc.title | Generating Thermal Human Faces for Physiological Assessment Using Thermal Sensor Auxiliary Labels | en_US |
| dc.type | Text | en_US |