Yumina

Community · World Discussions

Choosing which model for "Memory & Summary" - Which model is best for you?

L ·

Playing "Naruto: The Will of Fire" to save on token costs, I plan to every so often cut my session short, then start a new session to fit with the time period my character is in. What I want to do is figure out which model can provide the best and shortest context possible without editing as to transfer the memory from session to session. Of course cost is a large concern, but I'd still be curious as to which model would be the most reliable if you have to sacrifice a few more tokens for it.

There's also the interaction between first starting the session, the LM reading the memory output and then updating the jutsu and relations to fit how it was which I've been having trouble to do, but help in that regard would be appreciated as well.

This topic also doesn't only have to revolve around one card. Post how you've expertly used the system to save on tokens as well!

3 replies

  1. Swuell ·

    transfer the session from session to session--as in on Yumina or another website? If you mean on another website then yes, that's possible due to export. If you mean on Yumina, then no--that's not possible at all. At least from what the creator told me when I had tried to do this. You can import the char/world/rules into a new world but it won't import your chat. And when you say memory and summary do you mean the experimental addon? Because that's not how that works. That's per session unless the creator makes an actual worldwide global site toggle. As of now it's contained within it's own session.

    If you're worried about cost honestly you can just use the free model as it does just fine. and then use the more expensive one when it doesn't work out for you. They even have a mix model where you can set rules -- like what percentage to use what model and how much -- and I think that might help you more than manually doing it? Cuz if i remember right the -- NEVERMIND: sorry. The mix model is not for the memory addon. It's only for your base model. But that's some info for that if you ever want to use it for that. As for the base you have to switch it back and forth manually. You can also disable the very last one until you really need it if you're trying to save.

    Also there is no specific model that can do that without actually butchering what you're trying to do. You might be able to make a rule to do that but as far as I know I don't see a way to inject a prompt directly…

  2. L ·

    I mean purely on Yumina. While I know of other sites you can play cards on, I don't know of any with such thought put into well constructed worlds, although if there was another, I'd love to know!

    It'd not chat necessarily that I'm worried about, you can use (Context & Memory) to contain what you need, copy what you have had in one session, (Or change the model of and regenerate that...) and paste that into a new session. Sure, the responses won't be exact as how you've had it, but they still carry the story that's being told.

    (Unless it keeps getting updated, in which case there's the layered summary option which I don't see that gets updated, perhaps you could edit and save it into that.)

    (EDITED): Drat- seems like memory won't let it stay after transfer. Got to think of a way to transfer memory from session to session. Perhaps a way could be implemented if the owner thought it was a good idea.)

  3. Swuell ·

    Yeah I told you memory is chat locked. Nothing transfers. There is no transfer of chat or memories.

    And another one you can check out that’s similar to this but done a bit different is Voyage done by the creators of AI dungeon. It’s good in terms of building worlds and game like systems and has things similar to this but different. Both of them have their pros and cons. You can try it and see though. The last one would be like 2 or three specific generators on Perchance. Depending on what you want. But downside is you’re stuck with perchance’s modified(?) llm. And it’s a bit slower if you use more memory (but at least it has that option.)

    You can technically just write it in memory but that’s still entirely different than what actually happens due to the way the memory works. And I’ve asked the creator and as far as I know no kind of transfer or duplication is currently possible. It’d be nice to be able to duplicate the chat that can work in terms of transferring if you mainly stay on one platform. Though there’s branches for different options which create a session under a session but that’s still different than duplicating a chat.

    For context though you can honestly just use the cheapest. Probably more cost effective. The issue with the free one is you have a low bar for hugging face (which I think the general free use response also takes) so if you hit the cap then hugging face will nullify the memory and say you’ve reached cap for the day. All you’ll need to do is wait a…