zecg@lemmy.worldM to Stuff and Such@lemmy.world · 2 months ago"I bought a datacenter GPU that doesn’t even have a normal PCIe connector, stuck it in my gaming PC with an adapter, and now I have 32GB of VRAM across two GPUs running a 27 billion parameter model"blog.tymscar.comexternal-linkmessage-square0linkfedilinkarrow-up11arrow-down10cross-posted to: technology@lemmy.worldlocalllama@sh.itjust.workstechnik@feddit.org
arrow-up11arrow-down1external-link"I bought a datacenter GPU that doesn’t even have a normal PCIe connector, stuck it in my gaming PC with an adapter, and now I have 32GB of VRAM across two GPUs running a 27 billion parameter model"blog.tymscar.comzecg@lemmy.worldM to Stuff and Such@lemmy.world · 2 months agomessage-square0linkfedilinkcross-posted to: technology@lemmy.worldlocalllama@sh.itjust.workstechnik@feddit.org
