Computer Applications to Ability Testing

Computer-based procedures for implementing the three-paramater logistic model for item selection in tailored testing are described and the results of a comparison of a tailored test with a traditional paper-and-pencil test are compared.

Abstract

Paper-and-pencil tests provide the same set of items for all examinees taking a test and therefore result in some examinees taking items which either are too easy or too difficult for them. Such testing procedures are inefficient and frequently inaccurate, particularly near the limits of the test's range. Tailored testing allows for items to be selected as the process of testing proceeds, with items presented based upon previous responses. Items approximating the ability level of the examinee are selected from a pool of calibrated items, where calibration typically is based upon item difficulty, discrimination, and guessing parameters. This paper describes computer-based procedures for implementing the three-paramater logistic model for item selection in tailored testing and the results of a comparison of a tailored test with a traditional paper-and-pencil test.