Ceiling effect

This article does not cite any references or sources. Please help improve this article by adding citations to reliable sources. Unverifiable material may be challenged and removed. (June 2007)

This article is missing citations or needs footnotes. Please help add inline citations to guard against copyright violations and factual inaccuracies. (January 2009)

This article may contain original research or unverified claims. Please improve the article by adding references. See the talk page for details. (June 2009)

General problem and simple example

In statistics and the sciences, a ceiling effect is an effect whereby a measurement cannot take on a value higher than some limit or "ceiling", which is imposed not by the phenomenon being measured, but rather by the finite nature of the measuring instrument. As a crude example, measurements of the heights of trees would be compromised if our measuring stick was only 20 meters in length, because there are trees that are much taller than 20 meters. Here, 20 meters is the ceiling. Ceiling effects present statistical problems similar to those of "floor effect". Specifically, the utility of a measurement strategy is compromised by a lack of variability. In the case of a ceiling effect, the majority of scores are at or near the maximum possible for the test or measurement (in the example, we would observe a large clumping of tree heights at or near 20 meters, because the heights of trees taller than that would be credited with the 20 meter maximum score).

Ceiling effect on the statistical mean and variance

Ceiling effects on measurement compromise scientific truth and understanding through a number of related statistical aberrations.

First, ceilings impair the ability of investigators to measure the true mean, or average, of a group measurement (ceilings depress measured averages below their actual, true values). The average is a very important measurement, whether the object being studied is personal income, the height of trees, the flow of rivers, or many others. Second, ceilings create an artificial clustering (as explained above in the tree height example) of values near the ceiling limit, which is closer to the average than the true limit, which may be much higher than the ceiling. This causes a reduction in the measured statistical variance, below its true level. For mathematical reasons beyond the scope of this article (see analysis of variance), this reduced variance reduces the sensitivity of scientific experiments designed to determine if the average of one group is significantly different from the average of another group (for example, a treatment given to one group may produce an effect, but the effect may escape detection because the mean of the treated group won't look different enough from the mean of the untreated group). Thus ceiling effects can result in the waste of entire research programs and a lack of scientific progress.

Some social and economic consequences of the ceiling effect

Ceiling effects may have direct negative consequences on individuals and groups measured by a given instrument. A well known example of this is produced by the ceilings on IQ tests (or more properly, subtests within an IQ test as a whole). Such ceilings produce systematic underestimation of the IQs of intellectually gifted people, disadvantaging the gifted individually and as a group (this is contrary to the notion that the gifted are precisely those who most benefit from IQ tests).

How does this underestimation occur? The ceilings of IQ subtests are imposed by their ranges of progressively more difficult items. An IQ test with a wide range of progressively more difficult questions will have a higher ceiling than one with a narrow range and few difficult items. Ceiling effects result in an inability, first, to distinguish among the gifted (whether moderately gifted, profoundly gifted, etc), and second, results in the erroneous misclassification of some gifted people as above average, but not gifted.

Suppose that an IQ test has three subtests: vocabulary, arithmetic, and picture analogies. The scores on each of the subtests are normalized (see standard score) and then added together to produce a composite IQ score. Now suppose that Joe obtains the maximum score of 20 on the arithmetic test, but gets 10 out of 20 on the vocabulary and analogies tests. Is it fair to say that Joe's total score of 20+10+10, or 40, represents his true ability? The answer is no, because Joe achieved the maximum possible score of 20 on the arithmetic test. Had the arithmetic test included additional, more difficult items, Joe might have gotten 30 points on that subtest, producing a "true" score of 30+10+10 or 50. Compare Joe's performance with that of Jim, who scored 15+15+15 = 45, without running into any subtest ceilings. In the original formulation of the test, Jim did better than Joe (45 versus 40), whereas it is Joe that actually has the higher "true" intelligence than Jim (score of 50 for Joe versus 45 for Jim) using a reformulated test that includes more difficult arithmetic items. In general, gifted people are underestimated by standard IQ tests for two reasons: (1) they tend to perform all subtests better than less talented people, and (2)they tend to do much better on some subtests than others, raising the inter-subtest variability and chance that a ceiling will be encountered.

When is a ceiling a ceiling?

In cognitive neuroscience, the measurement of the time to respond to a given stimulus is often of interest. In these measurements, a ceiling may be the lowest possible number (the fewest milliseconds to a response), rather than the highest value, as is the usual interpretation of "ceiling". In response time studies, it may appear that a ceiling had occurred in the measurements due to an apparent clustering around some minimum amount of time (such as the 250 ms needed by many people to press a key). However, this clustering could actually represent a natural physiological limit of response time, rather than an artifact of the stopwatch sensitivity (which of course would be a ceiling effect). Further statistical study, and scientific judgment, can resolve whether or not the observations are due to a ceiling or are the truth of the matter.

See also

• Floor effect