See https://github.com/michahu/pre-pretraining for more information.

Usage:

model = AutoModel.from_pretrained('michahu8/pythia-160m-sd-500-c4-10k')
tokenizer = AutoTokenizer.from_pretrained('EleutherAI/pythia-160m')
Downloads last month
12
Safetensors
Model size
0.1B params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support