Yumina

3 replies

  1. Plant Serious ·

    For the best experience, you want a gpu with at least 8gb vram, otherwise the entire model is offloaded to the much slower system memory resulting in calls that take upwards of several minutes

  2. Oncin ·

    oh dang, seems like my device isn't capable for local llm

  3. Plant Serious ·

    If you ever have any questions about it though, feel free to DM me, maybe I can help you with figuring out what you need or can do with it until you can get a setup that would give you a good experience for it