A Map for Studying Pre-training in LLMs
- Data Collection
- General Text Data
- Specialized Data
- Data Preprocessing
- Quality Filtering
- Deduplication
TRISHA SHARMA us107
🎯
ritwikraha
/ Pretraining-LLM.md
Last active
August 21, 2026 09:50
Pretraining of Large Language Models