Our senses probe the external world. They also tell us about ourselves, as they monitor positions of the limbs and the balance of our bodies, and through pain they signal injury and illness. More subtly, there are innumerable internal signals monitoring everyday physiological activities, and conveying and maintaining our well-being; though little of this enters our
consciousness. In perception of objects and pictures, as
Sir Ernst Gombrich (1950) realized to such good effect, art and science meet.
Just how we know things through sensory experience is a question that was discussed by the Greek philosophers and has continued to be discussed ever since. But, perhaps curiously, planned experiments in the spirit of the physical sciences were hardly attempted much earlier than the mid-19th century. Since then, the experimental study of perception has yielded fundamental knowledge for physiology and psychology, especially from the outstanding work of
Hermann von Helmholtz (1867). It has revealed many surprises in the form of processes of which we are unaware, though they can often be demonstrated simply and dramatically as by the phenomena of
illusions. The study of perception, especially of vision and hearing and touch, has allowed psychology to grow from its philosophical roots into an experimental science; yet deeply puzzling philosophical questions remain, especially over the role of consciousness. It is puzzling, both that we are aware of so
little of perception, and that we have
any awareness or consciousness.
There is a long-standing tradition in philosophy that perception gives undeniably true knowledge. Philosophers have traditionally sought certainty, and often claimed it, whereas scientists — who are used to their theories being modified and upset by new data — generally settle for today's best bet. Philosophers have a heavy investment in the reliability of perception, for they stake their all on the certainty of knowledge from the senses to provide secure premisses for their arguments based on experience. Scientists, on the other hand, who are used to errors in measurement and observations, have found it necessary to check, and compare, and repeat observations as they do not expect reliability from the senses. Indeed, many scientific instruments have been developed precisely because of the limitations or the unreliability of perception: for it is easy to produce and demonstrate all manner of dramatic illusions, which could hardly occur if perception were direct reliable knowledge. Yet although illusions of object perception have been discussed by philosophers from
Aristotle to
Berkeley and more recently, philosophy generally has paid more attention to errors of logic and ambiguity of language, than to fallibilities of perception.
Philosophers are traditionally impressed by the undeniability of the 'raw experience' of
sensations. The sensation of toothache may be undeniable; but are perceptions of objects, and things happening, similarly infallible? One would think so if one believed that perceptions are simply sensations; but we now regard perceptions as giving us knowledge, albeit surprisingly indirectly, of the
causes or
sources of sensations — such as the states of our bodies, and especially objects in the environment — rather than of sensations themselves. It is now clear that there are vast, still largely mysterious perceptual jumps, intelligent leaps of the mind, which may land on error. One can, indeed, be wrong about the cause of toothache!
It is worth asking why we have both
perceptions and
conceptions of the world. Why is perception somehow separate, and in several ways different from our conceptual understanding? Very likely it is because perception, in order to be useful, must work very fast; whereas we may take minutes, hours, or years, forming concepts.
Perception is not traditionally thought of as an intelligent activity, though the power, especially of vision, to probe distance gains time needed for intelligent reactions to on-going events. It can be argued (see
stimulus) that the development of distance perception freed organisms from the tyranny of reflexes, and allowed perception to be intelligent.
Are perceptions
picked up by the senses, or are they
created internally by the perceiver? This question about the passivity or activity of perception is long-standing, and still debated. If sensations are created by the brain, a notion that receives strong support from physiology (see
visual brain in action;
visual system: environmental influences;
visual system: organization), we should expect to find, as we do, a vast amount of brain activity for perception. Whereas, if perceptions are simply 'picked up' (
Gibson 1950, 1966), the brain would have little to do. But a very great deal goes on, physiologically and cognitively.
This raises the old question: what is 'objective' and what is 'subjective'? The philosopher
John Locke (1690), who was well aware of the new science of his time, suggested that there are two kinds of characteristics:
primary characteristics, such as hardness, mass, and extension of objects in space and time — being in the world before life, and quite apart from mind — and
secondary characteristics, which are created by brain–mind. Thus colours are not in the world, but are created within us, though they are related in complex ways to light and the surfaces of objects.
It is generally accepted that Locke's 'primary' characteristics are present independently of mind and perception, and it is clear that 'secondary' characteristics are affected by states of the sensing organism; because colours change with adaptation, and everything appears tinged with yellow if we have jaundice.
Isaac Newton, writing on sensations of colour in
Opticks (1704), agreed with his friend Locke, saying that red light is not itself red, but is 'red-making'. Spelling this out, he said of light rays: 'there is nothing else than a certain power and disposition to stir up the sensation of this or that colour. For as sound in a bell or musical string ... is nothing but a trembling motion.' Then (in Query 23), he specifies something of the neural mechanism of vision that leads to the mysterious seat of sensation: 'Is not vision perform'd chiefly by the Vibrations of this (Eatherial) Medium, excited in the bottom of the eye by Rays of Light, and propagated through the solid, pellucid and uniform Capillamenta of the optic Nerves in the place (the "Sensorium") of Sensation?'
The empiricist school, of which Locke and Newton were founders, rejected the notion that had been the basis of much philosophy, that minds can receive knowledge by direct intuition, quite apart from perception. Mind was now regarded as essentially isolated from the physical world, linked by tenuous threads of nerve, sending signals to the brain, which has to make sense of sensations. At the same time, there were attempts to discover 'laws' of mind, corresponding in some ways to the laws of physics, though seldom if ever seen as being in quite the same category. Newton did, however, write (in a letter to Henry Oldenburg, secretary of the Royal Society): 'I suppose the
Science of colours will be granted
Mathematicall and as certain as any part of Optiques'. Laws of colour mixture were developed later, especially following the work of
Thomas Young, who made the important discovery in 1801 that all the spectral colours can be produced by mixture of various intensities of only three spectral lights. This took the sensations of colour somewhat outside the realm of physics, and yet they were seen as bound by certain laws. So evidently there could be a lawful science of sensation and of mind (see
colour vision: brain mechanisms;
colour vision: eye mechanisms). Newton fully appreciated that colour sensations are not always given by light, as he said (
Opticks, Query 16): 'When a Man in the dark presses either corner of his Eye with his finger, he will see a Circle of Colours like those of a Peacock's Tail.' At the same time, much like Pythagoras linking music with the physics of vibrating strings, Newton tried to describe aesthetics according to physical principles (Query 14):
- May not the harmony and discord of Colours arise from the proportions of the Vibrations propagated through the Fibres of the optick Nerves into the Brain, as the harmony and discord of Sounds arise from the proportions of the Vibrations of the Air? For some Colours, if they are view'd together, are agreeablezto one another, as those of Gold and Indigo, and others disagree.
So we find long-standing attempts to explain perceptual experience — from sensations to aesthetics — by physical principles of the natural sciences. But though, for example colour mixture, is linked to the physics of light, it is not derivable from optical principles. As the direct realism of immediate experience of the object world has been (almost universally) abandoned, we are left with having to devise bridging theories of perception to relate mind to the matter of the universe.
It is now generally accepted that perception depends on active physiologically based processes; but this notion is non-intuitive, for we know nothing of such processes or mechanisms by introspection, by consciousness. Moreover, perceiving objects around us seems so simple and easy! It happens so fast, and so effortlessly it is hard to conceive the complexity of the processes that we now know are involved.
This takes us to concepts familiar to engineers. It is not misleading to describe the organs of the senses — the eyes, ears, touch receptors, and so on — as 'transducers' that accept and signal patterns of energy from the external world, as coded messages, read by the brain to infer the state-of-play of the surrounding world. Another useful engineering concept is that of 'channels'. The various senses: touch and vision and hearing, and so on, are each subdivided into channels which generally can only be discovered by experiment. Thus, for example, though this was not at all realized before Young's (1801) colour mixture experiment, colour vision works with just three channels, responding to long-wavelength red, medium-wavelength green, and short-wavelength blue, light, respectively. All the hundreds of colours we see are, neurally, mixtures from these three colour channels (see
yellow.) Then there are channels representing the orientation of lines and edges, and channels for movement, as shown by direct physiological recording from the visual cortex, demonstrated dramatically by David Hubel and Torstin Wiesel (1962), who received the Nobel Prize for this outstanding work. By less physiologically direct methods, such as selective adaptation, it has been found that there are more or less independent channels for spatial frequency and many other visual characteristics. The ear has many frequency channels (see
hearing), and there is a score of channels for
touch, various kinds of pain, tickle, and for monitoring the positions of the limbs and setting muscle tensions for moving them appropriately (see
pain;
tickling). Small discrepancies, such as delay in sound between seeing a ball hit by a bat and hearing the impact, are rejected or pulled into place, to maintain a consistent world. Here, the constancies (see
colour perception: constancy and contrast) are very important; they modify sensations and perceptions to fit what should be there!
For signalling by the senses, as from instruments, it is important to appreciate the range of likely or possible objects that may be present (see
information rate of vision;
information theory). The eye receives all sorts of irrelevant stimuli, which are mainly disregarded, just as unwanted data and random disturbances are rejected whenever possible by scientific instruments, and in computer signal-processing. Sometimes, though, what is rejected turns out to be just what is needed. The immense difficulties encountered in current attempts to program computers to recognize objects from signals provided by television cameras indicate the incredible complexity and subtlety of animal and human perception (see
object perception). A key, surely, is the vast knowledge needed for sophisticated perception; but as yet this is inadequate, and hard to access as needed, in computers (see
artificial intelligence).
David Marr (1980) suggested that object shapes are derived from images via three essential stages: (i) the 'primal sketch'(es), describing intensity changes, locations of critical features such as terminal points, and local geometrical relations; (ii) the '2½-D sketch', giving a preliminary analysis of depth, surface discontinuities, and so on, in a frame that is centred on the viewer; (iii) the '3-D model representation', in an object-centred coordinate system, so that we see objects much as they are in three-dimensional space though they are presented from just one viewpoint. Marr supposed that this last stage is aided by restraints on the range of likely solutions to the problem of what is 'out there', the information-processing restraints being set by assuming typical object shapes, for example that many objects such as human beings, are modified cylinders, spheres, and cones. Interestingly, the painter Paul Cezanne came close to this notion in 1904: 'Treat nature by the cylinder, the sphere, the cone, everything in proper perspective so that each side of an object or a plane is directed towards a central point ... nature for us men is more depth than surface'.
The limited variety of typical objects may set restraints that are useful both for brains for perceiving, and for the artist to represent objects, and for the artificial intelligence endeavour to program computers to see. But although it can be difficult to represent or see some atypical objects (or even familiar objects from atypical viewpoints), perhaps it is not clear that these difficulties reflect perceptual restraints based on assuming cylinders, spheres, or cones, etc., for very different shapes can generally be seen without special difficulty.
Looking 'inwards' by introspection, we
seem to know that perceptions are made of
sensations, although from physiological and psychological experiments, as well as from the engineering approach, it has to be denied that sensations are the data for perceptions. The data are neural
signals, from the transducer senses, transmitted by many parallel channels — we may say to generate predictive hypotheses, which are our perceptual reality of the object world (see
perceptions as unconscious influences).
It was generally thought that perception occurs
passively from inputs from the senses. It is now, however, generally accepted that stored knowledge and assumptions
actively affect even the simplest perceptions. The relative importance of what are called passive 'bottom-up' processes to active 'top-down' processes, is a central controversy among those who study perception. There is more and more evidence for top-down knowledge, carried to lower-level perceptual mechanisms, some of this evidence being physiological. Psychological evidence, bearing on this, is discussed in the entry on
illusions. The changes of shape of wire cubes which reverse spontaneously in depth (see
Necker cubes) is clear evidence of top-down processes affecting what used to be regarded as simple sensory characteristics, such as shape and brightness. This is an example of how illusory phenomena can reveal processes of perception far removed from the world we perceive. Yet the brain is a physical system, the most wonderful machine we know.
(Published 1987)— Richard L. Gregory
Bibliography- Cezanne, P. (1904). Letter from Aix-en-Provence. In Rewald, J. (ed.) (1941), Letters, and in Goldwater, R., and Treves, M. (eds.) (1976). Artists on Art.
- Gibson, J. J. (1950). Perception of the Visual World.
- — — (1966). The Senses Considered as Perceptual Systems.
- Gombrich, E. (1960). Art and Illusion.
- Gregory, R. L. (1966, 5th edn. 1997). Eye and Brain.
- Helmholtz, H. von (1867). Handbuch der Physiologischen Optic. Hamburg. (3rd edn. 1909; trans. 1924 by Southall, J. P. C., with additions, as Helmholtz's Treatise on Physiological Optics, repr. 1962).
- Hubel, D. H., and Wiesel, T. N. (1962). 'Receptive field, binocular interaction and functional architecture in the cat's visual cortex'. Journal of Physiology, 160.
- Locke, J. (1690). Essay Concerning Human Understanding.
- Marr, D. (1982). Vision: A Computational Investigation into the Human Representation and Processing of Visual Information.
- Newton, I. (1704). Opticks. (4th edn. 1730).