Firefly EC-R3576PC FD is described as an "Embedded Large-Model Computer" powered by a Rockchip RK3576 octa-core Cortex-A72/A53 processor with a 6 TOPS NPU
  • hendrik@palaver.p3x.deEnglish
    6·
    3 months ago

    4GB to 8GB of RAM? That’s not large by any standard?! And a bit less than 2 tokens per second for a 6B parameter model isn’t fast at all.