Skip to content
#

pretraining

Star

Here is 1 public repository matching this topic...

Language: Shell
Filter by language
All 317 Python 236 Jupyter Notebook 43 HTML 6 Rust 3 TeX 2 CSS 1 Julia 1 Markdown 1 SCSS 1 Shell 1

haolpku / Awesome-LLM-Data-Preparation

Star 1

Data Preparation for Large Language Models — a curated companion to our JCST 2026 survey. Covers Pre-training, Continual Pre-training, and Post-training (SFT/RLHF/RLAIF) across collection, filtering, dedup, generation, evaluation.

nlp awesome deep-learning survey awesome-list data-preparation sft pretraining data-centric-ai large-language-models llm rlhf instruction-tuning rlaif continual-pretraining
  • Updated Apr 28, 2026
  • Shell

Improve this page

Add a description, image, and links to the pretraining topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the pretraining topic, visit your repo's landing page and select "manage topics."

Learn more