minus-squareiminahurry@discuss.tchncs.detoSelfhosted@lemmy.world•Guide: Self-hosting open source GPT chat with no GPU using GPT4AlllinkfedilinkEnglisharrow-up4·1 year agoAnybody know of a good guide for hosting this with GPU? Every guide seems to be talking about running it on CPU when one would expect the opposite to be true. I have not been able to use my RTX 3060 for this so far. linkfedilink
Anybody know of a good guide for hosting this with GPU? Every guide seems to be talking about running it on CPU when one would expect the opposite to be true. I have not been able to use my RTX 3060 for this so far.