OpenThoughts: Data Recipes for Reasoning Models
Paper • 2506.04178 • Published • 55
Alon Albalak
alon-albalak
AI & ML interests
None yet
Organizations
authored 2
papers 12 months ago
authored 4
papers over 1 year ago
Big-Math: A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models
Paper • 2502.17387 • Published • 8
Towards System 2 Reasoning in LLMs: Learning How to Think With Meta Chain-of-Though
Paper • 2501.04682 • Published • 99
Surveying the Effects of Quality, Diversity, and Complexity in Synthetic Data From Large Language Models
Paper • 2412.02980 • Published • 15
Generative Reward Models
Paper • 2410.12832 • Published • 7
authored 3
papers almost 2 years ago
Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning
Paper • 2305.12295 • Published • 1
The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources
Paper • 2406.16746 • Published
DataComp-LM: In search of the next generation of training sets for language models
Paper • 2406.11794 • Published • 56
authored 4
papers about 2 years ago
Improving Few-Shot Generalization by Exploring and Exploiting Auxiliary Data
Paper • 2302.00674 • Published
Efficient Online Data Mixing For Language Model Pre-Training
Paper • 2312.02406 • Published • 1
A Survey on Data Selection for Language Models
Paper • 2402.16827 • Published • 4
Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence
Paper • 2404.05892 • Published • 39
authored a
paper about 3 years ago