Nvidia’s ‘Nemotron-4 340B’ model redefines synthetic data generation, rivals GPT-4
Nvidia’s ‘Nemotron-4 340B’ model redefines synthetic data generation, rivals GPT-4

venturebeat.com
Nvidia’s ‘Nemotron-4 340B’ model redefines synthetic data generation, rivals GPT-4

Redefines synthetic data generation? From "making fake data" to what? (I get it, it's hyperbole.)
Training on synthetic data is the most garbage-sounding thing I've ever heard. Isn't Reddit and Wattpad fake enough? At least those posts were generated by actual humans.
I guess I'll wait and see, but I'm really skeptical that this will be a good thing.
Its a promising idea. Limitless training data in any domain you want. Whether or not it actually pans out is a whole different story.