@[email protected] to Lemmy [email protected] • 2 months agoIn heatlemmy.worldimagemessage-square145fedilinkarrow-up11.19K
arrow-up11.19KimageIn heatlemmy.world@[email protected] to Lemmy [email protected] • 2 months agomessage-square145fedilink
minus-square@[email protected]linkfedilink4•2 months agoIt’s not even words, it “thinks” in “word parts” called tokens.
minus-square@[email protected]linkfedilink1•2 months agoand those tokens? just numbers, indexes. LLMs have no concept of language or words or anything, it’s literally just a statistical calculator where the numbers encode some combination of letter(s)
It’s not even words, it “thinks” in “word parts” called tokens.
and those tokens? just numbers, indexes. LLMs have no concept of language or words or anything, it’s literally just a statistical calculator where the numbers encode some combination of letter(s)