Research portal

Psychometric problems with the method of correlated vectors applied to item scores (including some nonsensical results)

Research output: Scientific - peer-reviewArticle

Spearman's hypothesis stating that ethnic group differences on cognitive tests are most pronounced on the most highly g loaded tests has been commonly tested with Jensen's method of correlated vectors (MCV). This paper illustrates and explains why MCV applied to item-level data does not provide a test of measurement invariance and fails to provide accurate information about the role of g in group differences in test scores. I focus on studies that applied MCV to study group differences on items of Raven's Standard Progressive Matrices (SPM). In an empirical illustration of the psychometric problems with this method, I show that MCV applied to 60 SPM items incorrectly yields support for Spearman's hypothesis (so-called Jensen Effects suggesting that the group difference is on g) even when the items in the second group are not from the SPM but rather from a test composed of 60 items measuring either anxiety and anger or the big five personality traits. This shows that MCV applied to item level data does not accurately reflect the degree to which item bias or g plays a role in group differences. I conclude that MCV applied to items lacks both sensitivity and specificity.
Original languageEnglish
Pages (from-to)26–38
JournalIntelligence
Volume60
DOIs
StatePublished - 2017

DOI

Login to Pure (for TiU staff only)