#pretraining

Task-Seeded Synthetic Data Improved NVIDIA's Model by 11 Points on Hard Science Questions

NVIDIA's research shows that synthetic training data structured around task families—not raw scale—drives targeted capability gains. Their approach improved scientific reasoning by 11 points while keeping math and code performance stable.