• DarkThoughts@kbin.social
    link
    fedilink
    arrow-up
    2
    arrow-down
    4
    ·
    1 year ago

    You need a little gpu server farm for proper models & context sizes though. Single consumer gpus don’t have enough vram for that.