ngram-entropy/README.md

ngram-entropy

usage: (ngram-entropy) | (ngram-entropy N) | (ngram-entropy MIN MAX)

example

$ ngram-entropy < shakespeare.txt
 1:  4.889 bits, 4.889 bits/byte (111 unique ngrams)
 2:  8.327 bits, 4.164 bits/byte (2350 unique ngrams)
 3: 11.065 bits, 3.688 bits/byte (18248 unique ngrams)
 4: 13.264 bits, 3.316 bits/byte (81310 unique ngrams)
 5: 15.110 bits, 3.022 bits/byte (256294 unique ngrams)
 6: 16.727 bits, 2.788 bits/byte (621009 unique ngrams)
 7: 18.119 bits, 2.588 bits/byte (1178718 unique ngrams)
 8: 19.266 bits, 2.408 bits/byte (1869126 unique ngrams)
 9: 20.163 bits, 2.240 bits/byte (2612156 unique ngrams)
10: 20.825 bits, 2.082 bits/byte (3307528 unique ngrams)
11: 21.297 bits, 1.936 bits/byte (3890718 unique ngrams)
12: 21.625 bits, 1.802 bits/byte (4344981 unique ngrams)
13: 21.850 bits, 1.681 bits/byte (4681468 unique ngrams)
14: 22.006 bits, 1.572 bits/byte (4924896 unique ngrams)
15: 22.117 bits, 1.474 bits/byte (5100377 unique ngrams)
16: 22.195 bits, 1.387 bits/byte (5228236 unique ngrams)
17: 22.251 bits, 1.309 bits/byte (5321715 unique ngrams)
18: 22.291 bits, 1.238 bits/byte (5390184 unique ngrams)
19: 22.320 bits, 1.175 bits/byte (5440459 unique ngrams)
20: 22.341 bits, 1.117 bits/byte (5477696 unique ngrams)