Test Validation Pitfalls

Abstract

The principles of test validation are well established, but there has been many a recorded slip between accepted theory and acceptable validation studies, or simply the argument that the selection method is appropriate for the situation. This disconnect has legal consequences when the test is implicated in violations of equal employment opportunity laws and regulations. This chapter discusses more than 50 pitfalls in attempting to reach successful validation, illustrated by situations arising in federal court cases. The sections include general problems, as well as those likely to arise during job analysis, content validation strategy, criterion validation strategy, scoring strategy, use of background information, and generalization of validity across selection situations.