IAAP using a Criterion-referenced scoring method which involves a Subject-matter Expert Panel.
Criterion-referenced tests, a type of test introduced by Glaser (1962) and Popham and Husek (1969), are also known as domain referenced tests, competency tests, basic skills tests, mastery tests, performance tests or assessments, authentic assessments, objective-referenced tests, standards-based tests, credentialing exams, etc. These tests determine a candidate’s level of performance in relation to a well-defined domain of content.
Norm-referenced tests determine a candidate’s level of the construct measured by a test in relation to a well-defined reference group of candidates, referred to as the norm group. Criterion-referenced tests permit a candidate’s score to be interpreted in relation to a domain of content, and norm-referenced tests permit a candidate’s score to be interpreted in relation
to a group of examinees. The first interpretation is content-centered, and the second interpretation is examinee centered.
On a criterion-referenced test, every candidate would pass if they meet the expected standard. Alternatively, every candidate could fail if the standard is not met. On criterion-referenced tests it is possible for every person to pass the exam. Criterion-referenced tests have been compared to driver’s license exams, which require achievement of a minimum competency
to earn a license.
IAAP continually updates its exams to set the pace of the changing administrative profession environment. Since criterion-referenced scoring is designed to measure a candidate’s performance against a fixed set of predetermined criteria, this method is commonly used for certification exams that produce new editions of a test. The scores from these editions have the same meaning over time.
The level of exam difficulty may change from time to time. A test equating process assures that candidates must meet the same criterion-standard.