540
submitted 6 months ago by ElCanut@jlai.lu to c/memes@slrpnk.net
you are viewing a single comment's thread
view the rest of the comments
[-] Even_Adder@lemmy.dbzer0.com 5 points 6 months ago

It can't see what tokens it puts out, you would need additional passes on the output for it to get it right. It's computationally expensive, so I'm pretty sure that didn't happen here.

[-] Jesusaurus@lemmy.world 1 points 6 months ago

With the amount of processing it takes to generate the output, a simple pass over the to-be final output would make sense...

[-] ramirezmike@programming.dev 1 points 6 months ago

doesn't it work literally by passing in everything it said to determine what the next word is?

[-] ondoyant@beehaw.org 1 points 6 months ago

it chunks text up into tokens, so it isn't processing the words as if they were composed from letters.

this post was submitted on 13 May 2024
540 points (98.6% liked)

solarpunk memes

2935 readers
688 users here now

For when you need a laugh!

The definition of a "meme" here is intentionally pretty loose. Images, screenshots, and the like are welcome!

But, keep it lighthearted and/or within our server's ideals.

Posts and comments that are hateful, trolling, inciting, and/or overly negative will be removed at the moderators' discretion.

Please follow all slrpnk.net rules and community guidelines

Have fun!

founded 2 years ago
MODERATORS