@[email protected] to [email protected]English • 4 months agoNvidia Announces RTX 50's Graphic Card Blackwell Series: RTX 5090 ($1999), RTX 5080 ($999), RTX 5070 Ti ($749), RTX 5070 ($549)www.theverge.comexternal-linkmessage-square106fedilinkarrow-up1166
arrow-up1166external-linkNvidia Announces RTX 50's Graphic Card Blackwell Series: RTX 5090 ($1999), RTX 5080 ($999), RTX 5070 Ti ($749), RTX 5070 ($549)www.theverge.com@[email protected] to [email protected]English • 4 months agomessage-square106fedilink
minus-square@[email protected]linkfedilinkEnglish5•4 months agoWhat if I’m buying a graphics card to run Flux or an LLM locally. Aren’t these cards good for those use cases?
minus-square@[email protected]linkfedilinkEnglish5•4 months agoOh yeah for sure, I’ve run Llama 3.2 on my RTX 4080 and it struggles but it’s not obnoxiously slow. I think they are betting more software will ship with integrated LLMs that run locally on users PCs instead of relying on cloud compute.
What if I’m buying a graphics card to run Flux or an LLM locally. Aren’t these cards good for those use cases?
Oh yeah for sure, I’ve run Llama 3.2 on my RTX 4080 and it struggles but it’s not obnoxiously slow. I think they are betting more software will ship with integrated LLMs that run locally on users PCs instead of relying on cloud compute.