• BetaDoggo_@lemmy.world
    link
    fedilink
    English
    arrow-up
    7
    ·
    1 year ago

    200 tokens per second isn’t achievable with a 1.5B even on low-midrange GPUs. Unless they’re attaching an external GPU it’s not happening on a raspberry pi.

    This article is disjointed and smells like AI.