Comment on
[Guide/Feedback] How to survive the current model and some thoughts about it
Respectfully, I'd like to voice my disagreement with the assertion that the old model was better than the current one. My experience has been that minus temporary (albeit severe at times, yes) oddities that arise from instability with the model still being a work in progress, the new model is better in quite literally every single way from the old model. I say this only because you specifically said here that you want the dev to drop development on the current model and return to the old one -- so this statement is less directed at you, and more so that the dev knows that isn't a universal sentiment.
Again, this is just my experience (I know many other people are having a different experience), and isn't meant to imply that you "aren't allowed to complain" or something. But for me personally when I compare the two models:
- I've been able to write far more complex stories with the new model than I could with the old model, and much longer ones too. With the old model, every 20 or so replies, complex stories would fall apart completely unless I babysat the memories and summary and edited them constantly. It would forget key plot details (like a character saying "we need to figure out who cursed me" when the opening scene literally was her attacking a mage and getting cursed as a result), hallucinate things that had never happened, mix up characters, and make erroneous assumptions that it presented as fact. The new model has so far been much less prone to these behaviors (though they do sometimes happen).
- I've found the new model much better at writing complex characters most of the time, but I have noticed this fluctuate a lot with some of the updates. But the old model typically struggled severely with nuance. For example, in threads with the premade character Yvette, she either hated my character's guts or trusted her completely (sometimes waffling between the two unpredictably) -- there was no slowly building trust. Similarly slowburn romance wasn't a thing -- everything had to be very all-or-nothing or the AI wouldn't understand what was going on. Which has not been my experience with the new model. I find that the new model does sometimes get really hooked on certain terms and exaggerate them, but the old model would totally ignore character bios at times (e.g., Yvette's bio explicitly says she is NEUTRAL about magic, but in so many forbidden romance stories where my character was a witch/mage, it would have Yvette either hate magic or else be completely appalled at the oppression of mages and be very pro-mage -- once it literally even had her express genuine shock that some people would hunt mages to cull their mana lmao...).
- Relatedly, the old model often seemed to struggle to keep characters coherent across situations. For example, I once did a Yvette isekai thread and she suddenly went from "what the fuck is this shit" type dialogue to "Ah... I am not certain of what you speak, but would those perhaps be the flying metal boxes I had seen when I arrived? I did not recognize them, and found them quite frightening." 💀 I haven't had this problem with the new model.
- With the old model, I felt like I was constantly fighting it to write anything that wasn't all sunshine and rainbows. It didn't even have to be a taboo subject -- the second any emotional weight appeared, it was constantly trying to change the subject. It also insisted every single character be a paragon of healthy coping skills and never ever handle their feelings in an unhealthy way, and I don't even mean dangerous things, but even having a character verbally snap at a loved one or hide their feelings, there were times I would explicitly prompt it to do that and it would go, "She thought about [thing I instructed], but realized that wouldn't solve anything, and decided to [use a healthy strategy] instead." Also, if a character had a "taboo" thing mentioned in their backstory (like a history of unhealthy behaviors or childhood abuse), it would often bend over backwards to avoid referencing that in any way, shape, or form, which really detracted from the character depth because that part of their history never informed their perceptions, they never even thought about it unless my character directly asked about a related subject (and even then it would try to find any excuse to change the subject). I've genuinely never had a problem with the new model going dark when I didn't intend for it to do so, and in situations where the darkness fits the plot, I love its willingness to go there without me having to metaphorically drag it kicking and screaming. This was my #1 frustration with the old model, and I was pretty close to giving up on Perchance and switching to SillyTavern because of it before the new model was rolled out.
- The new model is much smarter in its ability to infer things and understand implications (though this varies due to the current instability). I've been genuinely impressed with it sometimes picking up on foreshadowing that I had thought to be very subtle. Similar to the point above about everything being all-or-nothing, I frequently had to spell things out for the old model very directly before it would figure out what I was getting at. I literally had a time where I wrote that my character "leaned in, her eyes on Yvette's lips in a silent request for permission" during a heartfelt moment and it literally didn't acknowledge at all that she was trying to kiss her. Finally in exasperation I edited it to clarify, "in a silent request for permission to kiss her," and immediately Yvette kissed my character... implying that the AI likely hadn't understood what that "silent request" actually was, even though that sort of description is pretty common in kiss scenes.
- When writing two women flirting, the old model used to sometimes seem to forget that they were both women. For example the AI character putting her hand on my character's face and feeling stubble. Or once the character made a flirty double-entendre about something getting "hard," which... isn't really a typical double-entendre between two women lol. I've never once had that happen with the new model.
- Another thing that makes the new model feel so much more immersive to me is the way that it actually references my character's cultural background. For example, the user character I write with most is named "Carmen" (not my real name ofc) and the old model would usually shorten it to "Carm" which I hate the sound of so I was always fighting it to stop doing that (editing it out to say "Carmen" only for it to call her Carm again a few messages later). But just recently the new model had a loved one call her "Carmencita" which I loved as that respects Carmen's cultural heritage, which the old model ignored 100% of the time. I also really love how the new model will have her loved ones call her Spanish-language terms of endearment like "querida."
- In writing child characters, I often felt like the old model treated them like adults. Telling them things that an adult with healthy boundaries wouldn't tell a child, using vocabulary or concepts a child that age couldn't be reasonably expected to understand, placing expectations on them that are wildly age-inappropriate, acting like it's surprising for a 6 year old to react childishly to something, etc. Whereas I haven't run into those things with the new model.
I genuinely don't know why experiences are varying so deeply in terms of people's perception of the old vs new models. Maybe it's our writing styles being a better fit for one model than the other or something, or a difference in custom writing instructions, I don't know. (I don't think it's type of story, because I've written so many different types of stories with the new model -- drama, slice of life, romance, comedy, angst, found family, iyashikei [healing], isekai, fluff, hurt/comfort, smut, adventure, fake dating... -- and it's done beautifully with matching my tone in all of them.) But when I see people advocate for a rollback to the old model, I always feel like I want to let the dev know that not everybody sees it that way, because I found the old model extremely frustrating to write with. (Again that doesn't mean I think you aren't allowed to complain. It just means that I also want to share my differing experience.)