CAT Exams: Development and Scoring
The CAT 2012 test development process was conducted in alignment with the Standards for Educational and Psychological Testing. The exam was designed with two sections: (1) Quantitative Ability & Data Interpretation, (2) Verbal Ability and Logical Reasoning. These two sections are consistent with the knowledge domains historically assessed by the IIMs and are also aligned with the content areas covered in equivalent global admission examinations that measure performance along similar scales.
Content of the examination was developed and confirmed by individuals with high levels of expertise in each of these content domains. Post-administration analysis will be conducted by credentialed psychometricians to confirm the validity of the examination scores and to ensure that every candidate was provided a fair and equal opportunity to display their knowledge.
Prometric employs an industry-standard, psychometrically-sound approach to the scoring process for all IIM candidates. The three-step process is outlined here and is supported by the Standards for Educational and Psychological Testing and the ETS Standards for Quality and Fairness.
Step 1: Raw Score is Calculated
Your raw scores are calculated for each section based on the number of questions you answered correctly, incorrectly, or that you omitted.
|+3 points for questions you answered correctly
||-1 point for questions answered incorrectly
||0 points for questions you did not answer
This scoring methodology ensures that candidates are only awarded points for what they know, while having points deducted for inappropriate random guessing. This is a standard process in the testing industry and is a methodology employed in scoring similar admissions tests such as the Graduate Record Examination (GRE).
Step 2: Raw Score is “Equated”
Equating is a statistical process used to adjust scores on two or more alternate forms of an assessment so that the scores may be used interchangeably. Industry standard processes were used for equating, such as those outlined within the ETS Standards for Quality and Fairness.
Step3: Equated Raw Score is “Scaled”
In order to ensure appropriate interpretation of an equated raw score, the scores must be placed on a common scale or metric. A linear transformation is used for this scaling process, which is an industry standard practice (Kolen & Brennan, 2004).
The IIM scaling model is as follows:
Section Scores = 0 to 225
Total Exam Score = 0 to 450
Three scaled scores are presented for each candidate: an overall scaled score and two separate scaled scores for each section. As the two sections evaluate two distinct sets of knowledge and skills, scores may not correlate across sections. A high score in one section does not guarantee a high score in another section. Percentile rankings are provided for each individual section as well as for the overall exam score.
About Test Difficulty....