Share on Facebook Share on Twitter Email
Answers.com

Units of information

 
Wikipedia: Units of information

In computing and telecommunications, a unit of information is the capacity some standard data storage system or communication channel, used to measure the capacities of other systems and channels. In information theory, units of information are also used to measure the information contents or entropy of random variables.

The most common units are the bit (the capacity of a system that can be in only two states) and the byte or octet (equivalent to eight independent bits). Larger units can be formed from these by the SI power-of-ten prefixes or the newer IEC binary power prefixes.

Contents

Primary units

Comparison of units of information: bit, trit, nat, ban. Quantity of informations is the height of bars. Dark green level is the "Nat" unit.

As observed by Hartley in 1928,[1] and further formalized by Shannon in 1945, the information that can be stored in a system is proportional to the logarithm logb N of the number N of possible states of that system. Changing the basis of the logarithm from b to a different number c has the effect of multiplying the value of the logarithm by a fixed constant, namely

logc N = (logc b) logb N

Therefore, the choice of the basis b determines the unit used to measure information. In particular, if b is a positive integer, then the unit is the amount of information that can be stored in a system with b possible states.

When b is 2, the unit is the "bit" (a contraction of binary digit). A system with 8 possible states, for example, can store up to log28 = 3 bits of information. Other units that have been named include:

  • Base b = 3: the unit is called "trit", and is equal to log2 3 (≈ 1.585) bits.[2]
  • Base b = 10: the unit is called "decimal digit", "Hartley", "ban", "decit", or "dit", and is equal to log2 10 (≈ 3.322) bits.[1][3][4][5]
  • Base b = e, the base of natural logarithms: the unit is called a "nat", "nit", or "nepit" (from Neperian), and is worth log2 e (≈ 1.443) bits.[1]

The trit, ban, and nat are rarely used to measure storage capacity; but the nat, in particular, is often used in information theory, because natural logarithms are sometimes easier to handle than logarithms in other bases.

Units derived from bit

Several conventional names are used for collections or groups of bits.

Byte

Historically, a byte was the number of bits used to encode a character of text in the computer, which depended on computer hardware architecture; but today it almost always means eight bits — that is, an octet. A byte can represent 28 = 256 distinct values, such as the integers 0 to 255, or -128 to 127. The IEEE 1541-2002 standard specifies "B" (upper case) as the symbol for byte. Bytes, or multiples thereof, are almost always used to specify the sizes of computer files and the capacity of storage units. Most modern computers and peripheral devices are designed to manipulate data in whole bytes or groups of bytes, rather than individual bits.

Nybble

A group of four bits, or half a byte, is sometimes called a nibble or nybble. This units is most often used in the context of hexadecimal number representation, since a nybble can store precisely one hexadecimal digit.[6]

Word, line, and page

Computers usually manipulate bits in groups of a fixed size, conventionally called words. The number of bits in a word is usually defined by the size of the registers in the computer's CPU, or by the number of data bits that are fetched from its main memory in a single operation. In the IA-32 architecture more commonly known as x86-32, a word is 16 bits, but other past and current architectures use words with 8, 24, 32, 36, 51, 64, 80 bits or others.

Some machine instructions and computer number formats use two words (a "double word" or "dword"), or four words (a "quad word" or "quad").

Computer memory caches usually operate on blocks of memory that consist of several consecutive words. These units are customarily called "lines".

Virtual memory systems partition the computer's main storage into even larger units, traditionally called "pages".

Systematic multiples

Terms for large quantities of bits can be formed using the standard range of SI prefixes for powers of 10, e.g., kilo = 103 = 1000 (kilobit or kbit), mega = 106 = 1,000,000 (megabit or Mbit) and giga = 109 = 1,000,000,000 (gigabit or Gbit). These prefixes are more often used for multiples of bytes, as in kilobyte (kB = 8,000 bits), megabyte (MB = 8,000,000 bits), and gigabyte (GB = 8,000,000,000 bits).

However, for technical reasons, the capacities of computer memories and some storage units are often multiples of some large power of two, such as 228 = 268,435,456 bytes. To avoid such unwieldy numbers, people have often misused the SI prefixes to mean the nearest power of two, e.g. using "kilo" for 210 = 1024, "mega" for 220 = 1,048,576, "giga" for 230 = 1,073,741,824, and so on. So, for example, a memory chip with capacity of 228 bytes would be referred to as a "256 megabyte chip". The table below illustrates these differences.

Symbol Prefix SI Meaning Binary meaning Size difference
k kilo 103   = 10001 210 = 10241 2.40%
M mega 106   = 10002 220 = 10242 4.86%
G giga 109   = 10003 230 = 10243 7.37%
T tera 1012 = 10004 240 = 10244 9.95%
P peta 1015 = 10005 250 = 10245 12.59%
E exa 1018 = 10006 260 = 10246 15.29%
Z zetta 1021 = 10007 270 = 10247 18.67%

In the past, uppercase "K" has been used instead of "k" to indicate 1024 instead of 1000. However, this usage was never consistently applied.

On the other hand, for external storage systems (such as optical disks), the SI prefixes were commonly used with their proper values (powers of 10). There have been many attempts to resolve the confusion by providing alternative notations for power-of-two multiples. In 1998 the International Electrotechnical Commission (IEC) issued a standard for this purpose, namely a series of binary prefixes that use 1024 instead of 1000 as the main radix:[7]

Symbol Prefix
Ki kibi, binary kilo 1 kibibyte (KiB) 210 bytes 1024 B
Mi mebi, binary mega 1 mebibyte (MiB) 220 bytes 1024 KiB
Gi gibi, binary giga 1 gibibyte (GiB) 230 bytes 1024 MiB
Ti tebi, binary tera 1 tebibyte (TiB) 240 bytes 1024 GiB
Pi pebi, binary peta 1 pebibyte (PiB) 250 bytes 1024 TiB
Ei exbi, binary exa 1 exbibyte (EiB) 260 bytes 1024 PiB

The JEDEC however recommends uppercase K, M, G, and T for the binary powers 210, 220, 230, and 240.[8]

Size examples

Obsolete and unusual units

Several other units of information storage have been named.[6]:

Most of these names are jargon, obsolete, or used only in very restricted contexts.

References

  1. ^ a b c Norman Abramson (1963), Information theory and coding. McGraw-Hill.
  2. ^ Donald E. Knuth, The Art of Computer programming, vol.2: Seminumerical algorithms.
  3. ^ Shanmugam (2006), Digital and Analog Computer Systems.
  4. ^ Gregg Jaeger (2007), Quantum information: an overview'
  5. ^ I. Ravi Kumar (2001), Comprehensive Statistical Theory of Communication.
  6. ^ a b Nybble at dictionary reference.com; sourced from Jargon File 4.2.0, accessed 2007-08-12
  7. ^ ISO/IEC standard is ISO/IEC 80000-13:2008. Not publicly available. This standard cancels and replaces subclauses 3.8 and 3.9 of IEC 60027-2:2005. The only significant change is the addition of explicit definitions for some quantities. ISO Online Catalogue
  8. ^ JEDEC Solid State Technology Association (December 2002), "Terms, Definitions, and Letter Symbols for Microcomputers, Microprocessors, and Memory Integrated Circuits", JESD 100B.01, http://www.jedec.org/download/search/JESD100B01.pdf, retrieved 2009-04-05 

External links


Search unanswered questions...
Enter a question here...
Search: All sources Community Q&A Reference topics
 
 

 

Copyrights:

Wikipedia. This article is licensed under the Creative Commons Attribution/Share-Alike License. It uses material from the Wikipedia article "Units of information" Read more