Some Workload Scheduling Alternatives in a High Performance Computing Environment
| dc.contributor.author | Simon, Tyler A. | |
| dc.contributor.author | McGalliard, James | |
| dc.date.accessioned | 2023-10-26T19:14:01Z | |
| dc.date.available | 2023-10-26T19:14:01Z | |
| dc.description.abstract | Clusters of commodity microprocessors have overtaken custom-designed systems as the high performance computing (HPC) platform of choice. The design and optimization of workload scheduling systems for clusters has been an active research area. This paper surveys some examples of workload scheduling methods used in large-scale applications such as Google, Yahoo, and Amazon that use a MapReduce parallel processing framework. It examines a specific MapReduce framework, Hadoop, in some detail. It describes a novel dynamic prioritization, self-tuning workload scheduler, and provides simulation results that suggest the approach will improve performance compared to standard Hadoop scheduling. | en_US |
| dc.description.uri | https://redirect.cs.umbc.edu/~tsimo1/papers/files/simon_cmg13.pdf | en_US |
| dc.format.extent | 12 pages | en_US |
| dc.genre | journal articles | en_US |
| dc.genre | preprints | en_US |
| dc.identifier | doi:10.13016/m2vnyo-elak | |
| dc.identifier.uri | http://hdl.handle.net/11603/30410 | |
| dc.language.iso | en_US | en_US |
| dc.relation.isAvailableAt | The University of Maryland, Baltimore County (UMBC) | |
| dc.relation.ispartof | UMBC Computer Science and Electrical Engineering Department Collection | |
| dc.relation.ispartof | UMBC Faculty Collection | |
| dc.rights | This work was written as part of one of the author's official duties as an Employee of the United States Government and is therefore a work of the United States Government. In accordance with 17 U.S.C. 105, no copyright protection is available for such works under U.S. Law. | en_US |
| dc.rights | Public Domain Mark 1.0 | * |
| dc.rights.uri | http://creativecommons.org/publicdomain/mark/1.0/ | * |
| dc.title | Some Workload Scheduling Alternatives in a High Performance Computing Environment | en_US |
| dc.type | Text | en_US |