Track_Shovel to Lemmy [email protected]English • 1 month agoHexadecimalslrpnk.netimagemessage-square95fedilinkarrow-up1597arrow-down115
arrow-up1582arrow-down1imageHexadecimalslrpnk.netTrack_Shovel to Lemmy [email protected]English • 1 month agomessage-square95fedilink
minus-square@[email protected]linkfedilink0•1 month agoDepends on how many parameters you want to use. I can run it with 8billion on my laptop.
Don’t you need a beefy GPU to run local LLMs?
Depends on how many parameters you want to use. I can run it with 8billion on my laptop.