More drift/fixation from the text model. Question.
I have been using the text model in AI RPG and others. I am well aware of all the hurdles and traps to avoid with the model to try and keep it from breaking. The dev posts and detailed user posts were helpful though I think the issues might be a bit more broad.
I know that lots of people are reporting that the model will fixate on certain words and phrases and that's true but in addition to the ones we all know, the model will fixate on words, phrases, names etc. that it has used earlier. It doesn't actually matter that you ban certain words or avoid them, the model will just pick up a different one on fixate on that instead.
My real issue is this though. I just started a new AI RPG chat. I deleted all of the overview, body and tracked data from the previous chat and deleted all the auto-saves. It should be a fresh start. yet in the new chat, it is bringing in the SAME character names and descriptions and situations from the previous chat in this new chat that should be very different. No coincidence here, these are unique characters I created.
If everything is stored in the browser and I delete all of the chat and previous data then where is the text model getting this from? fixation and drift coming from a previous chat? Is the model looking into hidden areas of my browser? saving data in a place I'm not aware?
Can someone explain to me how the model did this? I'd like to know and maybe it might shed a bit more light on the current models issues.