Singleton bound

In coding theory, the Singleton bound, named after R.C. Singleton, is a relatively crude bound on the size of a block code C with block length n, size r and minimum distance d.

Statement of the Bound

The minimum distance of a set C of codewords of length n is defined as

where d(x,y) is the Hamming distance between x and y. The expression A_q(n,d) represents the maximum number of possible codewords in a q-ary block code of length n and minimum distance d.

Then the Singleton bound states that

Proof

First observe that there are qⁿ many q-ary words of length n, since each letter in such a word may take one of q different values, independently of the remaining letters.

Now let C be an arbitrary q-ary block code of minimum distance d. Clearly, all codewords are distinct. If we delete the first d − 1 letters of each codeword, then all resulting codewords must still be pairwise different, since all original codewords in C have Hamming distance at least d from each other. Thus the size of the code remains unchanged.

The newly obtained codewords each have length

n − (d − 1) = n − d + 1

and thus there can be at most

q^{n − d + 1}

of them. Hence the original code C shares the same bound on its size | C | :

MDS codes

Block codes that achieve equality in Singleton bound are called MDS (maximum distance separable) codes. Examples of such codes include codes that have only one codeword (minimum distance n), codes that use the whole of (F_q)ⁿ (minimum distance 1), codes with a single parity symbol (minimum distance 2) and their dual codes. These are often called trivial MDS codes.

In the case of binary alphabets, only trivial MDS codes exist.^[1]

Examples of non-trivial MDS codes include extended Reed-Solomon codes.^{[citation needed]}

See also

• Gilbert-Varshamov bound
• Plotkin bound
• Hamming bound
• Johnson bound
• Griesmer bound

Notes

1. ^ see e.g. Vermani (1996), Proposition 9.2.

References

• R.C. Singleton (1964). "Maximum distance q-nary codes". IEEE Trans. Inf. Theory 10: 116–118. doi:10.1109/TIT.1964.1053661. 

Further reading

• J.H. van Lint (1992). Introduction to Coding Theory. GTM. 86 (2nd ed.). Springer-Verlag. p. 61. ISBN 3-540-54894-7. 
• F.J. MacWilliams; N.J.A. Sloane (1977). The Theory of Error-Correcting Codes. North-Holland. pp. 33,37. ISBN 0-444-85193-3. 
• L. R. Vermani: Elements of algebraic coding theory, Chapman & Hall, 1996.