27
Deep toots, high toots (media.kbin.social)
you are viewing a single comment's thread
view the rest of the comments
[-] garyyo@lemmy.world 2 points 1 year ago

Yeah. Science is often about rigorously verifying the things that seem obvious, and often going into significantly more detail about it too. TinyStories for example not only confirms that better quality data gives better quality models, but also how to go about to get that data, what parameters of the models lead to what observed effects, and how all of that can be used in the future. The simple one line summary of the conclusion might be "better training data creates better models" but that does nothing to really explain what better quality actually means or how to go about getting that better quality data, or why the data used for previous models was worse quality.

this post was submitted on 11 Jul 2023
27 points (90.9% liked)

Best of Mastodon

2314 readers
1 users here now

Share the best posts you find on mastodon. Add a link to the original toot

Related communities:

founded 1 year ago
MODERATORS