Alphane Moon@lemmy.world to Single Board Computers@lemux.minnix.devEnglish · 3 months agoFirefly EC-R3576PC FD is an Embedded Large-Model Computer based on Rockchip RK3576 processor - CNX Softwarewww.cnx-software.comexternal-linkmessage-square2fedilinkarrow-up114arrow-down12cross-posted to: hardware@lemmy.worldlinuxhardware@programming.dev
arrow-up112arrow-down1external-linkFirefly EC-R3576PC FD is an Embedded Large-Model Computer based on Rockchip RK3576 processor - CNX Softwarewww.cnx-software.comAlphane Moon@lemmy.world to Single Board Computers@lemux.minnix.devEnglish · 3 months agomessage-square2fedilinkcross-posted to: hardware@lemmy.worldlinuxhardware@programming.dev
minus-squarehendrik@palaver.p3x.delinkfedilinkEnglisharrow-up6·edit-23 months ago4GB to 8GB of RAM? That’s not large by any standard?! And a bit less than 2 tokens per second for a 6B parameter model isn’t fast at all.
4GB to 8GB of RAM? That’s not large by any standard?! And a bit less than 2 tokens per second for a 6B parameter model isn’t fast at all.
Who downvotes this