Study of Exploiting Coarse-Grained Parallelism in Block-Oriented Numerical Linear Algebra Routines
| dc.contributor.author | Kroiz, Gerson C. | |
| dc.contributor.author | Bardakoff, Alexandre | |
| dc.contributor.author | Blattner, Timothy | |
| dc.contributor.author | Keyrouz, Walid | |
| dc.date.accessioned | 2020-07-16T16:52:28Z | |
| dc.date.available | 2020-07-16T16:52:28Z | |
| dc.date.issued | 2020-06-17 | |
| dc.description | UMBC High Performance Computing Facility | en_US |
| dc.description.abstract | We have developed streaming implementations of two numerical linear algebra operations that further exploit the block decomposition strategies commonly used in these operations to obtain performance. The implementations formulate algorithms as data flow graphs and use coarse-grained parallelism to (1) emit a block in the result matrix as soon as it becomes available and (2) compute on multiple blocks in parallel. This streaming design benefits data flow graphs consisting of multiple linear algebra operations as it removes synchronization points between successive operations: a result block from an operation can be used immediately in an algorithm’s successor operations without waiting for the full result from the first operation. Early comparisons with OpenBLAS functions on CPUs show comparable performance for computing with large dense matrices and an earliest arrival time of a result block that is up to 50x smaller than the time needed for a full result. More thorough studies can show the impact of such implementations on the performance of systems by chaining multiple linear algebra operations. | en_US |
| dc.description.uri | http://hpcf-files.umbc.edu/research/papers/S17_Kroiz_v1.pdf | en_US |
| dc.format.extent | 2 pages | en_US |
| dc.genre | conference papers and proceedings preprints | en_US |
| dc.identifier | doi:10.13016/m2epyk-le5l | |
| dc.identifier.citation | Gerson C. Kroiz et al., Study of Exploiting Coarse-Grained Parallelism in Block-Oriented Numerical Linear Algebra Routines,Proceedings in Applied Mathematics and Mechanics (2020), http://hpcf-files.umbc.edu/research/papers/S17_Kroiz_v1.pdf | en_US |
| dc.identifier.uri | http://hdl.handle.net/11603/19169 | |
| dc.language.iso | en_US | en_US |
| dc.publisher | UMBC | en_US |
| dc.relation.isAvailableAt | The University of Maryland, Baltimore County (UMBC) | |
| dc.relation.ispartof | UMBC Mathematics Department Collection | |
| dc.relation.ispartof | UMBC Student Collection | |
| dc.rights | This item is likely protected under Title 17 of the U.S. Copyright Law. Unless on a Creative Commons license, for uses protected by Copyright Law, contact the copyright holder or the author. | |
| dc.subject | UMBC High Performance Computing Facility (HPCF) | |
| dc.title | Study of Exploiting Coarse-Grained Parallelism in Block-Oriented Numerical Linear Algebra Routines | en_US |
| dc.type | Text | en_US |