Incompressible string

An incompressible string is a string with Kolmogorov complexity equal to its length, so that it has no shorter encodings.^[1] The pigeonhole principle can be used to be prove that for any lossless compression algorithm, there must exist many incompressible strings.

Example

Suppose we have the string 12349999123499991234, and we are using a compression method that works by putting a special character into the string (say @) followed by a value that points to an entry in a lookup table (or dictionary) of repeating values. Let us imagine we have an algorithm that examines the string in 4 character chunks. Looking at our string, our algorithm might pick out the values 1234 and 9999 to place into its dictionary. Let us say that 1234 is entry 0 and 9999 is entry 1. Now the string can become:

 @0@1@0@1@0

This string is much shorter, although storing the dictionary itself will cost some space. However, the more repeats there are in the string, the better the compression will be.

Our algorithm can do better though, if it can view the string in chunks larger than 4 characters. Then it can put 12349999 and 1234 into the dictionary, giving us:

 @0@0@1

This string is even shorter. Now consider another string:

 1234999988884321

This string is incompressible by our algorithm. The only repeats that occur are 88 and 99. If we were to store 88 and 99 in our dictionary, we would produce:

 1234@1@1@0@04321

This is just as long as the original string, because our placeholders for items in the dictionary are 2 characters long, and the items they replace are the same length. Hence, this string is incompressible by our algorithm.

References

This page was last edited on 21 November 2023, at 13:53