Some Workload Scheduling Alternatives in a High Performance Computing Environment
| dc.contributor.author | Simon, Tyler A. | |
| dc.contributor.author | McGalliard, James | |
| dc.date.accessioned | 2023-10-26T19:14:01Z | |
| dc.date.available | 2023-10-26T19:14:01Z | |
| dc.description.abstract | Clusters of commodity microprocessors have overtaken custom-designed systems as the high performance computing (HPC) platform of choice. The design and optimization of workload scheduling systems for clusters has been an active research area. This paper surveys some examples of workload scheduling methods used in large-scale applications such as Google, Yahoo, and Amazon that use a MapReduce parallel processing framework. It examines a specific MapReduce framework, Hadoop, in some detail. It describes a novel dynamic prioritization, self-tuning workload scheduler, and provides simulation results that suggest the approach will improve performance compared to standard Hadoop scheduling. | en |
| dc.description.uri | https://redirect.cs.umbc.edu/~tsimo1/papers/files/simon_cmg13.pdf | en |
| dc.format.extent | 12 pages | en |
| dc.genre | journal articles | en |
| dc.genre | preprints | en |
| dc.identifier | doi:10.13016/m2vnyo-elak | |
| dc.identifier.uri | http://hdl.handle.net/11603/30410 | |
| dc.language.iso | en | en |
| dc.relation.isAvailableAt | The University of Maryland, Baltimore County (UMBC) | |
| dc.relation.ispartof | UMBC Computer Science and Electrical Engineering Department Collection | |
| dc.relation.ispartof | UMBC Faculty Collection | |
| dc.rights | Public Domain Mark 1.0 | * |
| dc.rights | This work was written as part of one of the author's official duties as an Employee of the United States Government and is therefore a work of the United States Government. In accordance with 17 U.S.C. 105, no copyright protection is available for such works under U.S. Law. | en |
| dc.rights.uri | http://creativecommons.org/publicdomain/mark/1.0/ | * |
| dc.title | Some Workload Scheduling Alternatives in a High Performance Computing Environment | en |
| dc.type | Text | en |