Public
Brown et al. · 2020-05
Language Models are Few-Shot Learners
“Two internet-based books corpora (Books1 and Books2) appear in the GPT-3 training mix as ordinary data sources.”
Books is a genre. LibGen is a library with a legal history. The paper needed the first word. The disk had the second.
The tell · If a training-set name gets quieter between the folder and the paper, ask what the folder was called.
How this became public: Described in the authors’ MDL privilege opinions.