Track_Shovel to Lemmy [email protected]English • 1 month agoHexadecimalslrpnk.netimagemessage-square136fedilinkarrow-up1825
arrow-up1825imageHexadecimalslrpnk.netTrack_Shovel to Lemmy [email protected]English • 1 month agomessage-square136fedilink
minus-square@[email protected]linkfedilink3•1 month agoDepends on how many parameters you want to use. I can run it with 8billion on my laptop.
Don’t you need a beefy GPU to run local LLMs?
Depends on how many parameters you want to use. I can run it with 8billion on my laptop.