Alphane Moon to Single Board [email protected]English • 5 months agoFirefly EC-R3576PC FD is an Embedded Large-Model Computer based on Rockchip RK3576 processor - CNX Softwarewww.cnx-software.comexternal-linkmessage-square2arrow-up114arrow-down12cross-posted to: hardware[email protected]
arrow-up112arrow-down1external-linkFirefly EC-R3576PC FD is an Embedded Large-Model Computer based on Rockchip RK3576 processor - CNX Softwarewww.cnx-software.comAlphane Moon to Single Board [email protected]English • 5 months agomessage-square2cross-posted to: hardware[email protected]
minus-squarehendriklinkfedilinkEnglish6•edit-25 months ago4GB to 8GB of RAM? That’s not large by any standard?! And a bit less than 2 tokens per second for a 6B parameter model isn’t fast at all.
4GB to 8GB of RAM? That’s not large by any standard?! And a bit less than 2 tokens per second for a 6B parameter model isn’t fast at all.
Who downvotes this