Increased intelligence is a myth (so far)


Here is an article that clarifies several misconceptions about intelligence, principally the idea that experience and learning of the IQ tests actually increases intelligence. 

Image from pixabay.com
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3950413/


. 2014; 8: 34. 
Published online 2014 Mar 12. doi: 10.3389/fnsys.2014.00034

Richard J Haier

On one hand, intelligence testing is one of the great successes of psychology (Hunt, ). Intelligence test scores predict many real world phenomena and have many well-validated practical uses (Gottfredson, ; Deary et al., ). Intelligence test scores also correlate to structural and functional brain parameters assessed with neuroimaging (Haier et al., ; Jung and Haier, ; Deary et al., ; Penke et al., ; Colom et al., ) and to genes (Posthuma et al., ; Hulshoff Pol et al., ; Chiang et al., , ; Stein et al., ). On the other hand, intelligence test scores are often misunderstood and can be misused. This paper focuses on a basic misunderstanding that permeates many of the recent reports of increased intelligence following short-term cognitive training. Several of these reports have been published in prominent journals and received wide public attention (Jaeggi et al., , ; Mackey et al., ).
The basic misunderstanding is assuming that intelligence test scores are units of measurement like inches or liters or grams. They are not. Inches, liters and grams are ratio scales where zero means zero and 100 units are twice 50 units. Intelligence test scores estimate a construct using interval scales and have meaning only relative to other people of the same age and sex. People with high scores generally do better on a broad range of mental ability tests, but someone with an IQ score of 130 is not 30% smarter then someone with an IQ score of 100. A score of 130 puts the person in the highest 2% of the population whereas a score of 100 is at the 50th percentile. A change from an IQ score from 100 to 103 is not the same as a change from 133 to 136. This makes simple interpretation of intelligence test score changes impossible.
Most recent studies that have claimed increases in intelligence after a cognitive training intervention rely on comparing an intelligence test score before the intervention to a second score after the intervention. If there is an average change score increase for the training group that is statistically significant (using a dependent t-test or similar statistical test), this is treated as evidence that intelligence has increased. This reasoning is correct if one is measuring ratio scales like inches, liters or grams before and after some intervention (assuming suitable and reliable instruments like rulers to avoid erroneous Cold Fusion-like conclusions that apparently were based on faulty heat measurement); it is not correct for intelligence test scores on interval scales that only estimate a relative rank order rather than measure the construct of intelligence. Even though the estimate has considerable predictive value and correlates to brain and genetic measures, it is not a measurement in the same way we measure distance, liquid, or weight even if individual change scores are used in a pre-post design.
SAT scores, for example, are highly correlated to intelligence test scores (Frey and Detterman, ). Imagine a student takes the SATs when quite ill. The scores likely are a bad estimate of the student's ability. If the student retakes the test sometime later when well, does an increase in score mean the student's intelligence has increased, or that the newer score is now just a better estimate? The same is true for score changes following SAT preparatory courses. Many colleges and universities allow applicants to submit multiple SAT scores and the highest score typically carries the most weight; there are many spurious reasons for low scores but far fewer for high scores. Change scores from lowest to highest carry little if any weight. By contrast, change in a person's weight after some intervention is unambiguous.
In studies of the effect of cognitive training on intelligence, it is also important to understand that all intelligence test scores include a certain amount of imprecision or error. This is called the standard error of measurement and can be quantified as an estimate of a “true” score based on observed scores. The standard error of measuring inches or liters is usually zero assuming you have perfectly reliable, standard measurement devices. Intelligence tests generally show high test-retest reliability but they also have a standard error, and the standard error is often larger for higher scores than for lower scores. Any intelligence test score change after an intervention needs to be considered relative to the standard error of the test. Studies that use a single test to estimate intelligence before and after an intervention are using less reliable and more variable scores (bigger standard errors) than studies that combine scores from a battery of tests.
Change scores are never easy to interpret and require sophisticated statistical methods and research designs with appropriate control groups. If you try a training intervention in individuals all of whom have pre-intervention scores below the population mean, for example, re-testing with or without any intervention, may result in higher scores due to the statistical phenomenon of regression to the mean, or due to simple test practice, especially if equivalent alternative forms of the test are not used. Quasi-experimental designs like post-test only with large samples and random assignment do not have all the same interpretation difficulties as pre-post designs. They have promise but most reviewers are more inclined to value pre-post changes. Latent variable techniques also avoid many of the difficulties of pre-post interval scale changes and they have promise in large samples (Ferrer and McArdle, ).
When change scores are used, it is important to identify individual differences even within a group where the average change score statistically increases after an intervention. Imagine a group of 100 students received cognitive training and 100 others received some control intervention. The mean change score in the training group may statistically show a greater increase than the controls. How many of the 100 individuals who received the training actually show an increase? Do they differ in any way from the individuals in the same group who do not show an increase? Does item analysis show whether increased scores are due more to easy test items or hard ones? What about any individuals in the control group that show change score increases as large as shown in the training group? If all 200 participants ultimately get the same training, will the rank order of individuals based on the post-training score be any different than the rank order based on the pre-training scores? If not, what has been accomplished? Most studies do not report such analyses, although newer training studies are addressing issues of multiple measure assessment of intelligence and individual differences (Colom et al., ; Jaeggi et al., ). Burgaleta et al provide a good example of showing IQ changes subject-by-subject (Burgaleta et al., ).
Nonetheless, the main point is that to make the most compelling argument that intelligence increases after an intervention, a ratio scale of intelligence is required. None yet exists and meaningful progress may require a new way of defining intelligence based on measureable brain or information processing variables. For example, gray and white matter density in specific brain regions assessed by imaging and expressed as a profile of standard scores based on a normative group might substitute for intelligence test scores (Haier, ). Work by Engle and colleagues suggests that working memory capacity and perceptual speed are possible ways to assess fluid intelligence (Broadway and Engle, ; Redick et al., ) based on a large body of research that shows faster mental processing speed and increased memory capacity are related to higher intelligence.
Jensen has written extensively about an evolution from psychometrics to mental “chronometrics”—the use of response time in milliseconds to measure information processing in a standard way (Jensen, ). He argued that the construct of intelligence could be replaced in favor of ratio scale measures of speed of information processing assessed during standardized cognitive tasks like the Hick paradigm. Such measures, for example, would help advance research about the underlying neurophysiology of mental speed and might lead to a more advanced definition of intelligence. Jensen concluded his book on chronometry with this call to action: “… chronometry provides the behavioral and brain sciences with a universal absolute scale for obtaining highly sensitive and frequently repeatable measurements of an individual's performance on specially devised cognitive tasks. Its time has come. Let's get to work!” (p. 246).
This is a formidable challenge and a major priority for intelligence researchers. Collaboration among psychometricians and cognitive psychologists will be key. There are now a number of studies that fail to replicate the claims of increased intelligence after short-term memory training and various reasons are proposed (Colom et al., ; Harrison et al., ). Given our narrow focus here, we note one failure to replicate also assessed working memory capacity and perceptual speed; no transfer effects were found (Redick et al., ) and there is reason to suggest that other positive transfer studies may be erroneous (Tidwell et al., ). For now, cognitive training results are more inconsistent than not, especially for putative intelligence increases. Nonetheless, it is encouraging that cognitive researchers are working on these issues despite a pervasive indifference or negativity to intelligence research in Psychology in general and for many funding agencies.
In the broader context, intelligence includes more than one component. However, the construct of interest usually is defined by psychometric methods as a general factor common to all mental abilities called the g-factor (Jensen, ). Fluid intelligence, the focus of several cognitive training studies, is one of several broad intelligence factors and it is highly correlated to g. The g-factor is estimated by intelligence tests but it is not synonymous with IQ or any other test score; some tests are more g-loaded than others. As noted, a score on an intelligence test has little meaning without comparing it to the scores of other people. That is why all intelligence tests require normative groups for comparison and why norm groups need to be updated periodically, as demonstrated by the Flynn Effect of gradual generational increases in intelligence test scores; although whether g shows the Flynn effect is still unsettled (te Nijenhuis and van der Flier, ). Psychometric estimations of g and other intelligence factors have generated strong empirical findings about the nature of intelligence and individual differences, mostly based on correlation studies. These interval assessments, however, are not sufficient to take research to the next step of experimental interventions to increase intelligence.
Speaking about science, Carl Sagan observed that extraordinary claims require extraordinary evidence. So far, we do not have it for claims about increasing intelligence after cognitive training or, for that matter, any other manipulation or treatment, including early childhood education. Small statistically significant changes in test scores may be important observations about attention or memory or some other elemental cognitive variable or a specific mental ability assessed with a ratio scale like milliseconds, but they are not sufficient proof that general intelligence has changed. As in all branches of science, progress depends on ever more sophisticated measurement that drives more precise definitions—think about the evolution of definition for a “gene” or an “atom”. Even with sophisticated interval-based assessment techniques (Ferrer and McArdle, ), until we have better measures, especially ratio scales, we need to acknowledge the basic measurement problem and exercise abundant restraint when reporting putative intelligence increases or decreases.
In the future, there may be strong empirical rationales for spending large sums of money on cognitive training or other interventions aimed at improving specific mental abilities or school achievement (in addition to the compelling moral arguments to do so), but increasing general intelligence is quite difficult to demonstrate with current tests. Increasing intelligence, however, is a worthy goal that might be achieved by interventions based on sophisticated neuroscience advances in DNA analysis, neuroimaging, psychopharmacology, and even direct brain stimulation (Haier, , ; Lozano and Lipsman, ; Santarnecchi et al., ; Legon et al., ). Developing equally sophisticated ratio measurement of intelligence must go hand-in-hand with developing promising interventions.

Acknowledgments

A version of this paper was presented at the annual meeting of the International Society for Intelligence Research, San Antonio, Texas, December 15, 2012 in a symposium on Improving IQ (chaired by S. Jaeggi and R. Colom).

References

  • Broadway J. M., Engle R. W. (2010). Validating running memory span: measurement of working memory capacity and links with fluid intelligence. Behav. Res. Methods 42, 563–570 10.3758/BRM.42.2.563 [PubMed] [CrossRef]
  • Burgaleta M., Johnson W., Waber D. P., Colom R., Karama S. (2014). Cognitive ability changes and dynamics of cortical thickness development in healthy children and adolescents. Neuroimage 84, 810–819 10.1016/j.neuroimage.2013.09.038 [PMC free article] [PubMed] [CrossRef]
  • Chiang M. C., Barysheva M., McMahon K. L., de Zubicaray G. I., Johnson K., Montgomery G. W., et al. (2012). Gene network effects on brain microstructure and intellectual performance identified in 472 twins. J. Neurosci. 32, 8732–8745 10.1523/JNEUROSCI.5993-11.2012 [PMC free article][PubMed] [CrossRef]
  • Chiang M. C., Barysheva M., Shattuck D. W., Lee A. D., Madsen S. K., Avedissian C., et al. (2009). Genetics of brain fiber architecture and intellectual performance. J. Neurosci. 29, 2212–2224 10.1523/JNEUROSCI.4184-08.2009 [PMC free article] [PubMed] [CrossRef]
  • Colom R., Burgaleta M., Roman F. J., Karama S., Alvarez-Linera J., Abad F. J., et al. (2013a). Neuroanatomic overlap between intelligence and cognitive factors: morphometry methods provide support for the key role of the frontal lobes. Neuroimage 72, 143–152 10.1016/j.neuroimage.2013.01.032 [PubMed] [CrossRef]
  • Colom R., Roman F. J., Abad F. J., Shih P. C., Privado J., Froufe M., et al. (2013b). Adaptive n-back training does not improve fluid intelligence at the construct level: gains on individual tests suggest that training may enhance visuospatial processing. Intelligence 41, 712–727 10.1016/j.intell.2013.09.002 [CrossRef]
  • Deary I. J., Penke L., Johnson W. (2010). The neuroscience of human intelligence differences. Nat. Rev. Neurosci. 11, 201–211 10.1038/nrn2793 [PubMed] [CrossRef]
  • Ferrer E., McArdle J. J. (2010). Longitudinal modeling of developmental changes in psychological research. Curr. Dir. Psychol. Sci. 19, 149–154 10.1177/0963721410370300 [CrossRef]
  • Frey M. C., Detterman D. K. (2004). Scholastic assessment or g? The relationship between the scholastic assessment test and general cognitive ability (vol 15, pg 373, 2004). Psychol. Sci. 15, 641 10.1111/j.0956-7976.2004.00687.x [PubMed] [CrossRef]
  • Gottfredson L. S. (1997). Why g matters: the complexity of everyday life. Intelligence 24, 79–132 10.1016/S0160-2896(97)90014-3 [CrossRef]
  • Haier R. J. (2009). Neuro-intelligence, neuro-metrics and the next phase of brain imaging studies. Intelligence 37, 121–123 10.1016/j.intell.2008.12.006 [CrossRef]
  • Haier R. J. (2013). The Intelligent Brain. Chantilly, VA: The Great Courses Company; Available online at: http://www.thegreatcourses.com/tgc/courses/course_detail.aspx?cid=1642
  • Haier R. J., Siegel B. V., Nuechterlein K. H., Hazlett E., Wu J. C., Paek J., et al. (1988). Cortical Glucose metabolic-rate correlates of abstract reasoning and attention studied with positron emission tomography. Intelligence 12, 199–217 10.1016/0160-2896(88)90016-5 [CrossRef]
  • Harrison T. L., Shipstead Z., Hicks K. L., Hambrick D. Z., Redick T. S., Engle R. W. (2013). Working memory training may increase working memory capacity but not fluid intelligence. Psychol. Sci. 24, 2409–2419 10.1177/0956797613492984 [PubMed] [CrossRef]
  • Hulshoff Pol H. E., Schnack H. G., Posthuma D., Mandl R. C. W., Baare W. F., van Oel C., et al. (2006). Genetic contributions to human brain morphology and intelligence. J. Neurosci. 26, 10235–10242 10.1523/JNEUROSCI.1312-06.2006 [PubMed] [CrossRef]
  • Hunt E. B. (2011). Human Intelligence. Cambridge; NY: Cambridge University Press
  • Jaeggi S. M., Buschkuehl M., Jonides J., Perrig W. J. (2008). Improving fluid intelligence with training on working memory. Proc. Natl. Acad. Sci. U.S.A. 105, 6829–6833 10.1073/pnas.0801268105 [PMC free article] [PubMed] [CrossRef]
  • Jaeggi S. M., Buschkuehl M., Jonides J., Shah P. (2011). Short- and long-term benefits of cognitive training. Proc. Natl. Acad. Sci. U.S.A. 108, 10081–10086 10.1073/pnas.1103228108 [PMC free article] [PubMed] [CrossRef]
  • Jaeggi S. M., Buschkuehl M., Shah P., Jonides J. (2013). The role of individual differences in cognitive training and transfer. Mem. Cognit. [Epub ahead of print]. 10.3758/s13421-013-0364-z [PubMed] [CrossRef]
  • Jensen A. R. (1998). The g Factor: The Science of Mental Ability. Westport, CT: Praeger
  • Jensen A. R. (2006). Clocking the Mind: Mental Chronometry and Individual Differences. New York, NY: Elsevier
  • Jung R. E., Haier R. J. (2007). The Parieto-Frontal Integration Theory (P-FIT) of intelligence: converging neuroimaging evidence. Behav. Brain Sci. 30, 135–154 10.1017/S0140525X07001185 [PubMed] [CrossRef]
  • Legon W., Sato T. F., Opitz A., Mueller J., Barbour A., Williams A., et al. (2014). Transcranial focused ultrasound modulates the activity of primary somatosensory cortex in humans. Nat. Neurosci. 17, 322–329 10.1038/nn.3620 [PubMed] [CrossRef]
  • Lozano A. M., Lipsman N. (2013). Probing and regulating dysfunctional circuits using deep brain stimulation. Neuron 77, 406–424 10.1016/j.neuron.2013.01.020 [PubMed] [CrossRef]
  • Mackey A. P., Hill S. S., Stone S. I., Bunge S. A. (2011). Differential effects of reasoning and speed training in children. Dev. Sci. 14, 582–590 10.1111/j.1467-7687.2010.01005.x [PubMed] [CrossRef]
  • Penke L., Maniega S. M., Bastin M. E., Hernandez M. C. V., Murray C., Royle N. A., et al. (2012). Brain white matter tract integrity as a neural foundation for general intelligence. Mol. Psychiatry 17, 1026–1030 10.1038/mp.2012.66 [PubMed] [CrossRef]
  • Posthuma D., De Geus E. J., Baare W. F., Hulshoff Pol H. E., Kahn R. S., Boomsma D. I. (2002). The association between brain volume and intelligence is of genetic origin. Nat. Neurosci. 5, 83–84 10.1038/nn0202-83 [PubMed] [CrossRef]
  • Redick T. S., Shipstead Z., Harrison T. L., Hicks K. L., Fried D. E., Hambrick D. Z., et al. (2013). No evidence of intelligence improvement after working memory training: a randomized, placebo-controlled study. J. Exp. Psychol. Gen. 142, 359–379 10.1037/a0029082 [PubMed] [CrossRef]
  • Redick T. S., Unsworth N., Kelly A. J., Engle R. W. (2012). Faster, smarter? Working memory capacity and perceptual speed in relation to fluid intelligence. J. Cogn. Psychol. 24, 844–854 10.1080/20445911.2012.704359 [CrossRef]
  • Santarnecchi E., Polizzotto N. R., Godone M., Giovannelli F., Feurra M., Matzen L., et al. (2013). Frequency-dependent enhancement of fluid intelligence induced by transcranial oscillatory potentials. Curr. Biol. 23, 1449–1453 10.1016/j.cub.2013.06.022 [PubMed] [CrossRef]
  • Stein J. L., Medland S. E., Vasquez A. A., Hibar D. P., Senstad R. E., Winkler A. M., et al. (2012). Identification of common variants associated with human hippocampal and intracranial volumes. Nat. Genet. 44, 552–561 10.1038/ng.2250 [PMC free article] [PubMed] [CrossRef]
  • te Nijenhuis J., van der Flier H. (2013). Is the Flynn effect on g?: A meta-analysis. Intelligence 41, 802–807 10.1016/j.intell.2013.03.001 [CrossRef]
  • Tidwell J. W., Dougherty M. R., Chrabaszcz J. R., Thomas R. P., Mendoza J. L. (2013). What counts as evidence for working memory training? Problems with correlated gains and dichotomization. Psychon. Bull. Rev. [Epub ahead of print]. 10.3758/s13423-013-0560-7 [PubMed] [CrossRef]
Articles from Frontiers in Systems Neuroscience are provided here courtesy of Frontiers Media SA

Comments

Post a Comment

Popular posts from this blog

AmRen: Illinois Police Officer Begged for Her Life Before Being Shot Dead With Own Firearm

Image
 https://www.amren.com/news/2022/01/illinois-police-officer-begged-for-her-life-before-being-shot-dead-with-own-firearm/ An  Illinois  police sergeant was pleading for her life moments before she was  fatally shot  with her own service weapon by a  gunman in a hotel last week   {snip} “At the time Sullivan fired the fatal shots into Sgt. Rittmanic, Sgt. Rittmanic was pleading with them to just leave, ‘you don’t have to do this, please just go, please don’t please don’t.’ She was desperately pleading for her life,” Kankakee County State’s Attorney Jim Rowe said in court Monday. Bradley Police Sgt. Marlene Rittmanic and Officer Tyler Bailey were shot Dec. 29 while responding to a Comfort Inn Hotel along a highway in Kankakee County regarding barking dogs that were left in a vehicle. {snip} Sgt. Marlene Rittmanic and Officer Tyler Bailey The officers were taken to nearby hospitals, where Rittmanic died and Bailey was listed in critical condition {snip} Ro...
Read more

What happens on America's Subways - Wild Assaults and Murders - Typically Featuring one Demographic

Image
 There are so many, and I mean so many news stories and videos online of assaults, and murders on the subway systems particularly New York. What is one of the common denominators? Well people can point to lots of things like poverty, mental illness, and so forth, but to me it seems like it is Black people.  An old video but still relevant nonetheless. A woman riding the training only to be almost murdered by beating without provocation by a Wakandan prince: The craziness continues: The stabbings: I could go on all day.  How people can enjoy living in a place like that, without having their own private transportation is beyond me. Isn't New York one of the most expensive cities in the world too? Slave your whole life away just to be killed by violent crime...
Read more

Private elite schools teach "wokeness" to kindergarten children

Image
 Ridiculous and unbelievable, rich people are now paying tens of thousands of dollars to send their kids to indoctrination centers where they are taught that all Whites are racist, and everything in their society like math and science is "racist". It's all just so demented.  https://nypost.com/2021/12/19/private-preschools-teaching-the-future-elite-to-be-racist/ Private preschools are teaching the future elite to be racist Wokeness has come to New York City elite private schools. It has infested everything, from social interactions to math. A few weeks ago, teachers at Manhattan’s Brick Church School read “Our Skin: A First Conversation About Race” to several classes. In its lessons on racism, all the racists are, of course, white. One typical line: “A long time ago, way before you were born, a group of white people made up an idea called race.” The idea that people didn’t notice each other’s skin color or features until white people made them is, of course, absurd. “Our ...
Read more