Manipulating data in the form of an image through several possible techniques. An image is usually interpreted as a two-dimensional array of brightness values, and is most familiarly represented by such patterns as those of a photographic print, slide, television screen, or movie screen. An image can be processed optically, or digitally with a computer.
To digitally process an image, it is first necessary to reduce the image to a series of numbers that can be manipulated by the computer. Each number representing the brightness value of the image at a particular location is called a picture element, or pixel. A typical digitized image may have 512 × 512 or roughly 250,000 pixels, although much larger images are becoming common. Once the image has been digitized, there are three basic operations that can be performed on it in the computer. For a point operation, a pixel value in the output image depends on a single pixel value in the input image. For local operations, several neighboring pixels in the input image determine the value of an output image pixel. In a global operation, all of the input image pixels contribute to an output image pixel value. These operations, taken singly or in combination, are the means by which the image is enhanced, restored, or compressed.
An image is enhanced when it is modified so that the information it contains is more clearly evident, but enhancement can also include making the image more visually appealing. An example is noise smoothing. To smooth a noisy image, median filtering can be applied with a 3 × 3 pixel window. This means that the value of every pixel in the noisy image is recorded, along with the values of its nearest eight neighbors. These nine numbers are then ordered according to size, and the median is selected as the value for the pixel in the new image. As the 3 × 3 window is moved one pixel at a time across the noisy image, the filtered image is formed.
Another example of enhancement is contrast manipulation, where each pixel's value in the new image depends solely on that pixel's value in the old image; in other words, this is a point operation. Contrast manipulation is commonly performed by adjusting the brightness and contrast controls on a television set, or by controlling the exposure and development time in printmaking. Another point operation is that of pseudocoloring a black-and-white image, by assigning arbitrary colors to the gray levels. This technique is popular in thermography (the imaging of heat), where hotter objects (with high pixel values) are assigned one color (for example, red), and cool objects (with low pixel values) are assigned another color (for example, blue), with other colors assigned to intermediate values.
The aim of restoration is also to improve the image, but unlike enhancement, knowledge of how the image was formed is used in an attempt to retrieve the ideal (uncorrupted) image. Any image-forming system is not perfect, and will introduce artifacts (for example, blurring, aberrations) into the final image that would not be present in an ideal image. A point spread function, called a filter, can be constructed that undoes the blurring. By imaging the blurred image with the filter point spread function, the restored image results. The filter point spread function is spread out more than the blurring point spread function, bringing more pixels into the averaging process. This is an example of a global operation, since perhaps all of the pixels of the blurred image can contribute to the value of a single pixel in the restored image. This type of deblurring is called inverse filtering, and is sensitive to the presence of noise in the blurred image. By modifying the deblurring filter according to the properties of the noise, performance can be improved. An example of the need to deblur images from an optical system is the Hubble Space Telescope before its spherical aberration was corrected with new optics. See also Satellite astronomy.
Compression is a way of representing an image by fewer numbers, at the same time minimizing the degradation of the information contained in the image. Compression is important because of the large quantities of digital imagery that are sent electronically and stored. Digital high-definition television relies heavily on image compression to enable transmission and display of large-format color images. Once the image is compressed for storage or transmission, it must be uncompressed for use, by the inverse of the compression operations. There is a trade-off between the amount of compression and the quality of the uncompressed image. High compression rates are acceptable with television images, for example. However, where high image quality must be preserved (as in diagnostic medical images), only compression rates as low as three to four may be acceptable. See also Data compression.
Image processing is an active area of research in such diverse fields as medicine, astronomy, microscopy, seismology, defense, industrial quality control, and the publication and entertainment industries. The concept of an image has expanded to include three-dimensional data sets (volume images), and even four-dimensional volume-time data sets. An example of the latter is a volume image of a beating heart, obtainable with x-ray computed tomography (CT). CT, PET, single-photon emission computed tomography (SPECT), MRI, ultrasound, SAR, confocal microscopy, scanning tunneling microscopy, atomic force microscopy, and other modalities have been developed to provide digitized images directly. Digital images are widely available from the Internet, CD-ROMs, and inexpensive charge-coupled-device (CCD) cameras, scanners, and frame grabbers. Software for manipulating images is also widely available. See also Charge-coupled devices; Compact disk; Computer storage technology; Computerized tomography; Confocal microscopy; Data communications; Digital computer; Electron microscope; Medical ultrasonic tomography; Nuclear medicine; Scanning tunneling microscope.