32 lines
1.2 KiB
Markdown
32 lines
1.2 KiB
Markdown
# ngram-entropy
|
|
|
|
```
|
|
usage: (ngram-entropy) | (ngram-entropy N) | (ngram-entropy MIN MAX)
|
|
```
|
|
|
|
## example
|
|
|
|
```sh
|
|
$ ngram-entropy < shakespeare.txt
|
|
1: 4.889 bits, 4.889 bits/byte (111 unique ngrams)
|
|
2: 8.327 bits, 4.164 bits/byte (2350 unique ngrams)
|
|
3: 11.065 bits, 3.688 bits/byte (18248 unique ngrams)
|
|
4: 13.264 bits, 3.316 bits/byte (81310 unique ngrams)
|
|
5: 15.110 bits, 3.022 bits/byte (256294 unique ngrams)
|
|
6: 16.727 bits, 2.788 bits/byte (621009 unique ngrams)
|
|
7: 18.119 bits, 2.588 bits/byte (1178718 unique ngrams)
|
|
8: 19.266 bits, 2.408 bits/byte (1869126 unique ngrams)
|
|
9: 20.163 bits, 2.240 bits/byte (2612156 unique ngrams)
|
|
10: 20.825 bits, 2.082 bits/byte (3307528 unique ngrams)
|
|
11: 21.297 bits, 1.936 bits/byte (3890718 unique ngrams)
|
|
12: 21.625 bits, 1.802 bits/byte (4344981 unique ngrams)
|
|
13: 21.850 bits, 1.681 bits/byte (4681468 unique ngrams)
|
|
14: 22.006 bits, 1.572 bits/byte (4924896 unique ngrams)
|
|
15: 22.117 bits, 1.474 bits/byte (5100377 unique ngrams)
|
|
16: 22.195 bits, 1.387 bits/byte (5228236 unique ngrams)
|
|
17: 22.251 bits, 1.309 bits/byte (5321715 unique ngrams)
|
|
18: 22.291 bits, 1.238 bits/byte (5390184 unique ngrams)
|
|
19: 22.320 bits, 1.175 bits/byte (5440459 unique ngrams)
|
|
20: 22.341 bits, 1.117 bits/byte (5477696 unique ngrams)
|
|
```
|