Help a newbie out?
Hi everyone I have very little knowledge of coding but I can learn! I want to have an offline AI that is very smart and can actually hold a conversation not just recycle lines I have used earlier, I want it to actually remember the conversations we have, please tell me how to do that thank you
We all want a very smart offline AI. So far the market only produced dumb AI
But you can have it offline right!? Is it possible to learn that power?
First, you will need a powerful PC and GPU. AI is very resource hungry and takes a lot of processing power to be very good. This is especially true if you want it to "remember" things.
my PC specs are decent, but why would I need powerful PC for a chat AI? Isn't it all just text? Please tell me more
Because AI text gen is not just spitting out text from some lookup table: it's looking through billions of chunks of text, looking for patterns, then combining them together to form a response. There is a an absolutely massive amount of number crunching that goes into the process. In addition, your want for it to "remember" things is an extremely tall order because, AI doesn't remember anything.
Every query you send (this is true for all AI models) includes:
This is always sent as one big blob of text that the AI has to read, parse, process, group, compare, quantize, then finally generate a response. The more data you send, the more it has to process, the more resources are required.
Bro I just wanted an AI that I can roleplay with without it changing the setting every couple of messages,,,,,like we were in a party to rescue a villager's sister from vampires but for the rest of RP the AI companion keeps asking me how is my sister that we saved earlier doing? And I keep replying to it bro for the thousand time she wasn't my sister and she was a vampire that we sadly had to put down....