“Anomalies in Implicit Attitudes Research”, Edouard Machery2021-06-15 (; similar)⁠:

[blog] In this review, I provide a pessimistic assessment of the indirect measurement of attitudes by highlighting the persisting anomalies in the science of implicit attitudes, focusing on their validity, reliability, predictive power, and causal efficiency, and I draw some conclusions concerning the validity of the implicit bias construct.

…We do not know what indirect measures measure; indirect measures are unreliable at the individual level, and people’s scores vary from occasion to occasion; indirect measures predict behavior poorly, and we do not know in which contexts they could be more predictive; in any case, the hope of measuring broad traits is not fulfilled by the development of indirect measures; and there is still no reason to believe that they measure anything that makes a causal difference.

These issues would not be too concerning for a budding science; they are anomalies for a 30-year-old research tradition that has been extremely successful at selling itself to policy makers and the public at large. So, should social psychologists pack up and move to other research topics or should they stubbornly try to address the anomalies pointed out in this article? It is unwise to predict the future of science, and the issues presented here could well be resolved by the many psychologists working on indirect measures, but it would also be unwise to dismiss them as mere challenges to be addressed in the course of normal science.

[Keywords: bias, construct validity, implicit attitude, indirect measure]