The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text
Paper
•
2506.05209
•
Published
•
59
Pre-training open datasets
Permissivly licensed datasets for LLM pre-training.
Permissivly licensed datasets for LLM pre-training.