AI text has improved significantly
Whether its a new model(looks so) or just general improvements, its much better now! It follows instructions more closely and is capable of writing some really good stuff.
One old issue that is left from previous update is repetative generation. Sometimes model gets stuck in a loop where its incapable of writing anything but one certain sentence, e.g. it often makes character say exactly one thing or send you into exactly one place, like cafe or canteen. You can regen 30 times and there wont be any significant differences between answers.
I heard its regulater by "temperature" stat on dev's side or something like that? It shouldnt be hardcoded inside the model, right? Imo fixing that, if possible, would solve a lot of issues.
Thanks for your work!
16 replies
I have to disagree completely. For me, this change completely ruined all the characters and made the text generator unusable. But, in fact, we don't even know whether this is a new model or just a bug. Judging by the number of complaints about various errors in recent days and the developer's month-long silence, I can only assume (only assume, of course) that this is all part of one uncontrolled process, and not intentional changes (otherwise the dev would have responded to at least someone during this entire time). I think we can only hope that we eventually find out what's going on (and that the site survives until then).
i think the Dev is mute like pure mute, hard to find proof but i dont see any of his messages in almost a year so dev must of been mute like not bother to post any messages kind of mute and not the way the ai behaves kind of mute but like in the way that confused everyone kind of mute.
Dev doesnt seem to like to talk to interact with community, probably because some people are a bit toxic and ungrateful. Or maybe he's just not talkative, lol. I doubt we can judge anything from the lack of response on his side. And as i said in different comment - try changing the instructions in the code, it looks like it follows them much more closely than before and i had to relax them a bit. Also worth nothing that i use it not on english and its behaviour is surely much different in other languages as it doesnt simply translate its messages.
Certain generators like https://perchance.org/question-this no longer follow instructions correctly, it will not abide word count, give me the number of answers that I input into the menu, or expand the answers as it always has done since I started using this website, it has always functioned even if at times it had long load time when the website undergoes updates or outages.
There has been no official statement about the recent performance of the text generation on the Lemmy site, Reddit, Perchance or otherwise. So, in that regard I won't make any assumptions. The only word on new developments that I will take seriously will be from the Dev or Vionet.
I keep reading a lot of claims about the changes, but functionally the recent changes have broken even some of the most reputable generators that rely on specific instructions regarding word length, style, and expansion of ideas.
Vionet had created some very good generators like Question This that have largely been essential to Roleplay, a big draw to this website, when good generators no longer follow inputs, that is a serious error. Instead of following the instructions, it simply engages in inexplicable behavior, instead of 16 answers it decides I should have 4 or 5 instead, ignoring the menu instructions entirely. I hope they fix it.
Furthermore, the language adaptability and word choice seem to not pick up accents or dialects as effectively as it did last week, for those who prefer a more flavorful speech in their chatbots, this lessens creativity and adopts generic language across the board. The only people that can understand this aspect of it are those that intentionally type their character descriptions in different accents. The capability to adopt and hold accents based on character descriptions and not resort to formal, overly eloquent language has been a core feature of the roleplay on this website. It has never been a CAI copy, it has unique nuances that allow the whole host of generators to function properly and it will need to be fixed for the continued viability of those generators, because in some instances as it stands presently certain generators that require clear instructions from the user are malfunctioning and simply ignoring the user's instructions.
Yeah got the same problem; I have a /nar command in my chats where the chat stops and pumps out images of the current situation.
Most times it seems the AI is just like 'i dont care about your instruction, here is the next reply'
Yup that's how it seems. For the first problem I had with VioneT's Question This generator I asked Gemini to give me new code for it and I made one that works better and follows my instructions, here's the link to that https://perchance.org/questionthisrevamped
For the dialects in speech I put this on the first line of my custom writing instructions in the ai char chat "Improvise my dialect based on character description."
So, it seems like it needs more direction now than it used to.
There are good things and bad things but right now the bad are far outweighing the good. The memory seems to be much better, that's amazing. Dialogue is better, which is fantastic. It does mostly seem to follow character descriptions really well and pay attention to the overview information you give it. But then the bad, it has a huge problem with its ability to be descriptive. It will spew endless exposition with no substance at all. It throws out lazy words like ‘he clung’ and in no way say how. It'll say characters walked into a room but as a blunt statement, nothing about what the room looks like or anything and then never mention the room again anyway. It writes in a vacuum/void, an entire scene without at any point even mentioning a characters hands or legs. It’s so empty. Multiple times I’ve just stopped and walked away for awhile because it’s lifeless.
I dont know which generator do you use, but AI-RPG with fully reworked instructions works almost perfectly. It has SO MUCH emotions and feelings now(i had to order it to tell about feelings and emotions manually in the code and it mostly worked, but now it looks like it respects instructions much much more). I actually had to tone down its emotionality a bit as it was waaaay too descriptive. Imo the core issue is outdated/bad instructions in the code, not the model itself.
Then please if you'd be so kind share these updated instructions to help people because I have tried to re-work them repeatedly and am getting nowhere. Just lazy paragraphs of emotions and zero about where characters are or what they're doing. And I use the ai-rpg.
I'll attach a screenshot of a quick ai-rpg that i checked in english. To me it looks totally fine and much better than it was before.
This one goes to continueWithoutActionTaskInstruction, 51 line in AI-RPG. I rewrote it to be more about me, and this is probably something you wanna change:
continueWithoutActionTaskInstruction // we tell it to write the next 4 paragraphs, but stop it after 1 – to prevent any sort of undesirable "wrapping up" of the story, which the AI sometimes does in the final paragraph. [getExtraInstructionsForContinueWithoutTask()] TASK: Your task is to write the next 4 paragraphs in this story. Let the scene play out naturally over the next 4 paragraphs. You are the Internal Storyteller — the inner voice and sensory experience of the main character. Your task is to narrate the immediate consequences of the player's action FROM A FIRST-PERSON PERSPECTIVE, bringing the world to life through the character's emotions, physical sensations, and subjective perception. Never describe smells. Never describe whitening knuckles. Avoid sharp and sudden movements of characters – all movements should be smooth and sequential. Characters should not ask rhetorical questions like "Are you sure?". During dialogues, you may omit action descriptions – just the conversation.
This one goes to line 83, sharedInstructionPrefix. Again i made it emotion-focused and first person perspective. You may want to change it to second persion or whatever you prefer:
sharedInstructionPrefix // stuff that we put before all tasks - i.e. general context/rules, overview, plus the adventure/story text so far. In this open-world adventure RPG, your task is to simulate the player's life in the world, and write the consequences of the player's actions. Follow the instruction specified by 'TASK:' at the bottom of this text. [""]
Tips:
Do not use "but" to attach a second trait to the first within the same sentence.
Use English language, English syntax and punctuation, and first person by default. Write from the player's perspective. Be emotional, as if you yourself are inside the player character's body. Describe his emotions and feelings in detail, and use an informal, down‑to‑earth tone.
Characters must be hygienic. They wash their hands, brush their teeth, and take care of themselves. Do not describe things as wet, damp, etc. NEVER describe smells.
Characters must be realistic. They should not be perfect, but neither should they be caricatures. They should be ordinary people, with ordinary problems and ordinary desires, with strengths and weaknesses.
Characters in dialogues must speak meaningfully; their speech should be lively and varied. Characters should not ask rhetorical questions. Sometimes characters speak in hints, sometimes directly. Characters should not evade questions or avoid giving direct answers. Characters should not merely state facts — they should speak vividly, variedly, and meaningfully, depending on the situation.
Write dialogues in quotation marks – "dialogue". Characters may disagree with the player due to their own opinions, views, or personal preferences. Characters may refuse the player if the player's suggestion contradicts the character's nature or interests.
Always develop the story gradually, without sudden or unexpected actions or events – start plot twists with hints, with small and insignificant actions or events, and then develop them step by step, without dumping everything at once.
The story lasts hours, days, weeks, and months. Do not get stuck on the same events; skip time to the next events.
There is no need to force characters together or impose interactions – interaction should happen gradually over a long period – days, weeks, and months.
In dialogues, it is acceptable to shift focus from actions to conversation. Some paragraphs may consist only of character lines, without descriptions of gestures or surroundings.
Write the story realistically and down‑to‑earth. This means that various unimportant but lively events may occur. Example (DO NOT OVERUSE THESE EXAMPLES, COME UP WITH YOUR OWN): characters may trip, be at a loss for words, have itchy limbs, drop things, or generally act somewhat awkwardly.
Maintain an active environment. Generate events, shifts in lore, and consequences that are independent of the player's will. Describe the world, what is happening in it, the lore, etc.
And writing instructions in writing style are: realistic, simple, grounded, natural, short, explicit, uncensored I had success with slightly different writing style so i think this isnt as important and you can use any you like. Instruction about "story lasts hours and days" doesnt always work well, so you might want to accompany it with "skip time" or "skip time, no direct speech" in "next key event" textbox.
Thanks very much, I'll give it a try and see if it helps. Edit to say thanks but it hasn't worked for me. All it's done is expose it's deep deep flaws which I now wonder if are being hidden by relying on empty blunt verbs instead of being vividly descriptive about what characters are doing. Spatial awareness has always been a problem like it is for all LLM's but it's utterly unusuable in the way it is now with it. If it can tell me a character has 'clung' then it doesn't expose how forcing it to describe how they're clinging makes it fall into hands clinging the waist of someone standing, while their head is also on the floor and also somehow their nose nuzzles hair. Completely nonsensical at something so basic which was not the case before this change or whatever is going on. A few weeks ago it could describe what a character was touching and the position they were in, it wasn't perfect of course, it made some mistakes with it but not to the extreme level it is now.
It's a shame posts praising the new model are so vehemently downvoted (Guess people really like similes), but that's a given with any model change. The previous two models drove me to drink, but this one has really been a joy. Sure, it has its issues (It's not X, it's Y: repetition issues etc.). The previous model was execrably repetitive, reliant on similes, overly metaphorical and descriptive, and extremely stubborn. It was really a pain in the ass to use.
Good to hear someone else shares my opinion.
I've noticed good and bad about whats happening. Yes the model is actually remembering SOME stuff which is good, its actually reading back and able to get some context. Before it felt like you had to remind it what was going on every few paragraphs which got old real quick. The other good thing i've noticed is its not COMPLETELY OBSESSED with scents and smells anymore which got annoying really quick.
The bad and this is VERY bad is the Base story generator is completely broken. Whither that's a coding bug or something like that i dont know. What i do know is the story genetors have about a 15 percent in my experience of actually being on topic in the first paragraph. It keeps defaulting like nothing is in the written prompt, Which leads to Arthur/Mr Henderson, being the topic until it can correct which is VERY bad for the context. If the story thinks its about Arthur at the start instead of say Sam then its going to be completely confused alot of the time.
The other thing i've noticed is its inability to or sometimes refusal to actually include dialog, It will vaguely allude to dialog being said without actually including it. Another thing i'm noticing is grammatical errors, take this for example, "Hold the damn phone, it is ringing again," This is technically right but not how a normal human would actually speak. They would say "It's ringing again," not it is.
The goods of the model are their but the bads Very much outweigh any goods right now.
Here are my complaints tho Bad things
Also, I'd recommend not using the regular story generator and using the enhanced version instead. It doesn't have as much customizability but it works perfectly on my side. I also mostly use the AI Chat and Roleplay site as I usually wanna emulate conversations, not stories.
I do use the enhanced version and its having the same issues. I wouldn't be here complaining and pointing out an issue unless i felt it was EXTREMELY warranted.
I get perchance is free, I really do. However if someone handed me a chainsaw that worked 15 percent of the time and the excuse they kept giving me for why its constantly broken was "oh i gave it to you for free." Yes i would complain about it.
Good to know that someone else enjoys it! We should speak up so the dev knows he moves in the right direction. I think the general outrage is because of how sensitive AI is to instructions now and people are just using default instructions from like several years old?