Credits
Wordado’s word lists are built with the help of these sources. Their licences ask us to name them, and we are glad to.
FineWeb v1.4.0 (HuggingFaceFW/fineweb, sample/10BT, shards 000-009), counted by corpus count-text
Contains information from FineWeb (https://huggingface.co/datasets/HuggingFaceFW/fineweb), which is made available under the ODC Attribution License v1.0 (https://opendatacommons.org/licenses/by/1-0/).
Google Books Ngram, British English 1-grams (20200217), match counts for 2000-2019, summed by corpus sum-gbooks
Word frequencies derived from the Google Books Ngram dataset, British English, version 20200217, years 2000–2019 (https://books.google.com/ngrams), licensed under CC BY 3.0 (https://creativecommons.org/licenses/by/3.0/). Changed: yearly counts summed and reduced to a ranking of headwords.
FineWeb-2 (HuggingFaceFW/fineweb-2, deu_Latn train, shards 000-002), counted by corpus count-text
Contains information from FineWeb-2 (https://huggingface.co/datasets/HuggingFaceFW/fineweb-2), which is made available under the ODC Attribution License v1.0 (https://opendatacommons.org/licenses/by/1-0/).
Google Books Ngram, German 1-grams (20200217), match counts for 2000-2019, summed by corpus sum-gbooks
Word frequencies derived from the Google Books Ngram dataset, German, version 20200217, years 2000–2019 (https://books.google.com/ngrams), licensed under CC BY 3.0 (https://creativecommons.org/licenses/by/3.0/). Changed: yearly counts summed and reduced to a ranking of headwords.
English: word list version 12
German: word list version 1