mbk/ngram-entropy
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

add shakespeare example to readme

Browse source
This commit is contained in:
mehbark 2026-04-16 14:58:38 -04:00
parent 88d0335ae3
commit 6e2a978c01
Signed by: mbk
GPG key ID: E333EC1335FFCCDB
1 changed files with 26 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

26
README.md
View file

@ -3,3 +3,29 @@
```
usage: (ngram-entropy) | (ngram-entropy N) | (ngram-entropy MIN MAX)
```
## example
```sh
$ ngram-entropy < shakespeare.txt
1: 4.889 bits, 4.889 bits/byte (111 unique ngrams)
2: 8.327 bits, 4.164 bits/byte (2350 unique ngrams)
3: 11.065 bits, 3.688 bits/byte (18248 unique ngrams)
4: 13.264 bits, 3.316 bits/byte (81310 unique ngrams)
5: 15.110 bits, 3.022 bits/byte (256294 unique ngrams)
6: 16.727 bits, 2.788 bits/byte (621009 unique ngrams)
7: 18.119 bits, 2.588 bits/byte (1178718 unique ngrams)
8: 19.266 bits, 2.408 bits/byte (1869126 unique ngrams)
9: 20.163 bits, 2.240 bits/byte (2612156 unique ngrams)
10: 20.825 bits, 2.082 bits/byte (3307528 unique ngrams)
11: 21.297 bits, 1.936 bits/byte (3890718 unique ngrams)
12: 21.625 bits, 1.802 bits/byte (4344981 unique ngrams)
13: 21.850 bits, 1.681 bits/byte (4681468 unique ngrams)
14: 22.006 bits, 1.572 bits/byte (4924896 unique ngrams)
15: 22.117 bits, 1.474 bits/byte (5100377 unique ngrams)
16: 22.195 bits, 1.387 bits/byte (5228236 unique ngrams)
17: 22.251 bits, 1.309 bits/byte (5321715 unique ngrams)
18: 22.291 bits, 1.238 bits/byte (5390184 unique ngrams)
19: 22.320 bits, 1.175 bits/byte (5440459 unique ngrams)
20: 22.341 bits, 1.117 bits/byte (5477696 unique ngrams)
```