@benni@lemmy.world to Lemmy Shitpost@lemmy.world • 23 days agoIn heatlemmy.worldimagemessage-square136fedilinkarrow-up11.23K
arrow-up11.23KimageIn heatlemmy.world@benni@lemmy.world to Lemmy Shitpost@lemmy.world • 23 days agomessage-square136fedilink
minus-square@_stranger_@lemmy.worldlinkfedilink4•22 days agoIt’s not even words, it “thinks” in “word parts” called tokens.
minus-square@Swedneck@discuss.tchncs.delinkfedilink1•2 days agoand those tokens? just numbers, indexes. LLMs have no concept of language or words or anything, it’s literally just a statistical calculator where the numbers encode some combination of letter(s)
It’s not even words, it “thinks” in “word parts” called tokens.
and those tokens? just numbers, indexes. LLMs have no concept of language or words or anything, it’s literally just a statistical calculator where the numbers encode some combination of letter(s)