lemmydividebyzero@reddthat.com to Technology@lemmy.worldEnglish · 3 个月前Opensource AI Must Winopensourceaimustwin.comexternal-linkmessage-square106linkfedilinkarrow-up1282arrow-down120
arrow-up1262arrow-down1external-linkOpensource AI Must Winopensourceaimustwin.comlemmydividebyzero@reddthat.com to Technology@lemmy.worldEnglish · 3 个月前message-square106linkfedilink
minus-squaremabeledo@lemmy.worlddeleted by creatorlinkfedilinkEnglisharrow-up1arrow-down1·edit-210 天前deleted by creator
minus-squareshortwavesurfer@lemmy.ziplinkfedilinkEnglisharrow-up4·3 个月前I ran it on my 8GB RAM desktop.
minus-squaremabeledo@lemmy.worlddeleted by creatorlinkfedilinkEnglisharrow-up1·edit-210 天前deleted by creator
minus-squareZephyrXero@lemmy.worldlinkfedilinkEnglisharrow-up4arrow-down1·3 个月前I got Qwen 3.5:9b running on my 8GB GPU the other day, and it still has some room left over
minus-squaremabeledo@lemmy.worlddeleted by creatorlinkfedilinkEnglisharrow-up2·edit-210 天前deleted by creator
minus-squareZephyrXero@lemmy.worldlinkfedilinkEnglisharrow-up4arrow-down1·3 个月前If the model dumps over to system ram it gets super slow, you ideally want it to fit completely in your VRAM
deleted by creator
I ran it on my 8GB RAM desktop.
deleted by creator
I got Qwen 3.5:9b running on my 8GB GPU the other day, and it still has some room left over
deleted by creator
If the model dumps over to system ram it gets super slow, you ideally want it to fit completely in your VRAM