minus-square@donatas@feddit.ukOPtoSelfhosted@lemmy.world•Some local LLMs tested on an average gaming PClinkfedilinkEnglish4•2 months ago128GB won’t make any difference in gaming when compared to, say, 32GB, so it’s just to fit larger LLMs into memory. However, 0.5t/s is hardly usable for every day tasks, so 32GB will still be more realistic combination with the RTX4070. linkfedilink
minus-square@donatas@feddit.ukOPtoSelfhosted@lemmy.world•Some local LLMs tested on an average gaming PClinkfedilinkEnglish5•2 months agoPerformance/vision based tests have tokens/s at the end of tables. linkfedilink
@donatas@feddit.uk to Selfhosted@lemmy.worldEnglish • 2 months agoSome local LLMs tested on an average gaming PCplus-squaregithub.comexternal-linkmessage-square17fedilinkarrow-up164
arrow-up164external-linkSome local LLMs tested on an average gaming PCplus-squaregithub.com@donatas@feddit.uk to Selfhosted@lemmy.worldEnglish • 2 months agomessage-square17fedilink
128GB won’t make any difference in gaming when compared to, say, 32GB, so it’s just to fit larger LLMs into memory. However, 0.5t/s is hardly usable for every day tasks, so 32GB will still be more realistic combination with the RTX4070.