• MyNamesNotRobert@lemmynsfw.com
    link
    fedilink
    English
    arrow-up
    4
    ·
    7 months ago

    llamacpp. Remember to modify the launch script to use multiple cores. Go to hugging face io and look for GGUF compatible models.