ElCanut@jlai.lu to solarpunk memes@slrpnk.net · 3 months agoBaybe what's wrong? You've barely touched your Strawberrumjlai.luimagemessage-square76fedilinkarrow-up1548arrow-down18
arrow-up1540arrow-down1imageBaybe what's wrong? You've barely touched your Strawberrumjlai.luElCanut@jlai.lu to solarpunk memes@slrpnk.net · 3 months agomessage-square76fedilink
minus-squareEven_Adder@lemmy.dbzer0.comlinkfedilinkEnglisharrow-up5·3 months agoIt can’t see what tokens it puts out, you would need additional passes on the output for it to get it right. It’s computationally expensive, so I’m pretty sure that didn’t happen here.
minus-squareramirezmike@programming.devlinkfedilinkarrow-up1·3 months agodoesn’t it work literally by passing in everything it said to determine what the next word is?
minus-squareadderaline@beehaw.orglinkfedilinkEnglisharrow-up1·3 months agoit chunks text up into tokens, so it isn’t processing the words as if they were composed from letters.
minus-squareJesusaurus@lemmy.worldlinkfedilinkEnglisharrow-up1·3 months agoWith the amount of processing it takes to generate the output, a simple pass over the to-be final output would make sense…
It can’t see what tokens it puts out, you would need additional passes on the output for it to get it right. It’s computationally expensive, so I’m pretty sure that didn’t happen here.
doesn’t it work literally by passing in everything it said to determine what the next word is?
it chunks text up into tokens, so it isn’t processing the words as if they were composed from letters.
With the amount of processing it takes to generate the output, a simple pass over the to-be final output would make sense…