A human therapist might not or is less likely to share any personal details about your conversations with anyone.
An AI therapist will collate, collect, catalog, store and share every single personal detail about you with the company that owns the AI and share and sell all your data to the highest bidder.
Neither would a human therapist be inclined to find the perfect way to use all this information to manipulate people while they are being at their weakest. Let alone do it to thousands, if not millions of them all at the same time.
They are also pushing for the idea of an AI "social circle" for increasingly socially isolated people through which world view and opinions can be bent to whatever whoever controls the AI desires.
To that we add the fact that we now know they've been experimenting with tweaking Grok to make it push all sorts of political opinions and conspiracy theories. And before that, they manipulated Twitter's algorithm to promote their political views.
Knowing all this, it becomes apparent that we are currently witnessing is a push for a whole new level of human mind manipulation and control experiment that will make the Cambridge Analytica scandal look like a fun joke.
Forget Neuralink. Musk already has a direct connection into the brains of many people.
PSA that Nadella, Musk, saltman (and handful of other techfash) own dials that can bias their chatbots in any way they please. If you use chatbots for writing anything, they control how racist your output will be
I can't wait until ChatGPT starts inserting ads into its responses. "Wow that sounds really tough. You should learn to love yourself and not be so hard on yourself when you mess up. It's a really good thing to treat yourself occasionally, such as with an ice cold Coca-Cola or maybe a large order of McDonald's French fries!"
There's also temple OS written in holy C, he was close to some of the stuff in the article
And these are just two people functional and loud enough to be heard. This is a thing that happens, maybe LLMs exacerbate a pre existing condition, but people have been going off the deep end like this long before LLMs came into the picture
I agree, it's certainly not going to help people losing touch. But that's not what worries me - that's a small slice of the population, and models are beginning to get better at rejection/assertion
What I'm more worried about is the people who are using it almost codependently to make decisions. It's always there, it'll always give you advice. Usually it's somewhat decent advice, even. And it's a normal thing to talk through decisions with anyone
The problem is people are offloading their thinking to AI. It's always there, it's always patient with you... You can literally have it make every life decision for you.
It's not emotional connection or malicious AI I worry about... You can now walk around with a magic eight ball that can guide you through life reasonably well, and people are starting to trust it above their own judgement
I suppose this can be mitigated by installing a local LLM that doesn't phone home. But there's still a risk of getting downright bad advice since so many LLM's just tell their users they're always right or twist the facts to fit that view.
I've been guilty of this as well, I've used ChatGPT as a "therapist" before. It actually gives decently helpful advice, compared to what's out there available after a google search. But I'm fully aware of the risks "down the road", so to speak.
You're a good friend. I wish everyone has someone like this. I have a very small group of mates where I can be vulnerable without being judged. But not everyone are as privileged, unfortunately...
Until we start turning back to each other for support and help,
and realize them holing up in a bunker underground afraid for their life's means we can just ignore them and seal the entrances.
This is terrible. I'm going to ignore the issues concerning privacy since that's already been brought up here and highlight another major issue: it's going to get people hurt.
I did a deep dive with gen AI for a month a few weeks ago.
It taught me that gen AI is actually brilliant at certain things. One thing that gen AI does is it learns what you want and makes you believe it’s giving you exactly what you want. In a sense it's actually incredibly manipulative and one of the things gen AI is brilliant at. As you interact with gen AI within the same context window, it quickly picks up on who you are, then subtly tailors its responses to you.
I also noticed that as gen AI's context grew, it became less "objective". This makes sense since gen AI is likely tailoring the responses for me specifically. However, when this happens, the responses also end up being wrong more often. This also tracks, since correct answers are usually objective.
If people started to use gen AI for therapy, it's very likely they will converse within one context window. In addition, they will also likely ask gen AI for advice (or gen AI may even offer advice unprompted because it loves doing that). However, this is where things can go really wrong.
Gen AI cannot "think" of a solution, evaluate the downsides of the solution, and then offer it to you because gen AI can't "think" period. What gen AI will do is it will offer you what sounds like solutions and reasons. And because gen AI is so good at understanding who you are and what you want, it will frame the solutions and reasons in a way that appeals to you. On top of all of this, due to the long-running context window, it's very likely the advice gen AI gives will be bad advice. For someone who is in a vulnerable and emotional state, the advice may seem reasonable, good even.
If people then act on this advice, the consequences can be disastrous. I've read enough horror stories about this.
Anyway, I think therapy might be one of the worst uses for gen AI.
Thank you for the more detailed run down. I would set it against two other things, though. One, that for someone who is suicidal or similar, and can't face or doesn't know how to find a person to talk to, those beginning interactions of generic therapy advice might (I imagine; I'm not speaking from experience here) do better than nothing.
From that, secondly, more general about AI. Where I've tried it it's good with things people have already written lots about. E.g. a programming feature where people have already asked the question a hundred different ways on stack overflow. Not so good with new things - it'll make up what its training data lacks. The human condition is as old as humans. Sure, there's some new and refined approaches, and values and worldviews change over the generations, but old good advice is still good advice. I can imagine in certain ways therapy is an area where AI would be unexpectedly good...
...Notwithstanding your point, which I think is quite right. And as the conversation goes on the risk gets higher and higher. I, too, worry about how people might get hurt.
I agree that this like everything else is nuanced. For instance, I think if people who use gen AI as a tool to help with their mental health are knowledgeable about the limitations, then they can craft some ways to use it while minimizing the negative sides. Eg. Maybe you can set some boundaries like you talk to the AI chat bot but you never take any advice from it. However, i think in the average case it's going to make things worse.
I've talked to a lot of people around me about gen AI recently and I think the vast majority of people are misinformed about how it works, what it does, and what the limitations are.
Does gen AI say you you are worthless, you are ugly, you are the reason your parents devorced, you should kill yourself, you should doomscroll social media?
Probably not but I bet if you said it was your grandmas birthday you could get it to say most of that.
And hey sometimes it's the objective truth that it doesn't know.
Personally, I know I am the reason my parents are divorced. My incubator nicknamed me the "divorce baby" until she could come up with other worse names, but I wear it with pride. They were miserable POSs together and now at least my dad is doing better and my incubator has to spend a lot more effort scamming people.
Truths are what they are. But don't fall for the lies that your brain or robot chatbot tell you.
Gen AI cannot "think" of a solution, evaluate the downsides of the solution, and then offer it to you because gen AI can't "think" period.
It turns out that researcers are unshure if our "reasoning" models that are spposed to be able to 'think' are even 'thinking' at all! it likely has already come up with an answer and is justifying it's conclusion. bycloud
this tech gaslights everything it touches including itself.
Wrong. Massively wrong. This mother is 180% at fault for the death. C.AI has been heavily censored, time and again. The reality is that this kid was already mentally ill, and he persuaded the bot to act like that. I am an ex-user, and bots there just don't do those things unless YOU press them to act like that.
SMH.
Yeah, what an awful mom for not knowing enough about the brand new technology her 14 year old discovered. How dare busy parents not know everything about extremely recent technological developments! Every parent should not only 100% know everything their 14 year old is doing online at all times, but they should also be at least as up-to-date on tech news as you are. Any less than that should be considered negligence!
Oh, but the company in control of the service doesn't need to provide any sort of safeguards to prevent this sort of tragedy. It's not like other mentally-ill individuals (children and adults alike) will get hurt by AI chatbots affirming their delusions. And if they do, there's always someone besides the company that can be blamed!
The only people that think this will help are people that don't know what therapy is. At best, this is pacification and certainly not any insightful incision into your actual problems. And the reason friends are unable to allow casual emotion venting is because we have so much stupid shit like this plastering over a myriad of very serious issues.
There are ways that LLMs can be used to better one's life (apparently in some software dev circles these can be and are used to make workflow more efficient) and this can also be one of them, because the part that sucks most about therapy (after the whole monetary thing) is trying to find the form of therapy that works for you, and finding a therapist that you can work with. Every human is different, and that contains both the patient and the therapist, and not everyone can just start working together right off the bat. Not to mention how long it takes for a new therapist to actually get to know you to improve the odds of the cooperation working.
Obviously I'm not saying "replace all therapists with AIs controlled by racist capitalist pigs with ulterior motives", but I have witnessed people in my own life who have had some immediate help from a fucking chatbot, which is kinda ridiculous. So in times of distress (say a borderline having such an anxiety attack that they can't calm themselves because they don't know what to do to the vicious cycle of thought and emotional response) and for immediate help a well-developed, non-capitalist LLM might be of invaluable help, especially if an actual human can't be reached if for an example (in this case) the borderline lives in a remote area and it is the middle of the night, as I can tell from personal experience it very often is. And though not every mental health emergency requires first responders on the scene or even a trip to the hospital, there is still a possibility of both being needed eventually. So a chatbot with access to necessary information in general (like techniques for self-soothing e.g. breathing exercises and so forth) and possibly even personal information (like diagnostic and medication history, though this would raise more privacy concerns to be assessed) and the capability to parse and convey them in a non-belittling way (as some doctors and nurses can be real fucking assholes at times) could/would possibly save lives.
So the problem here is capitalism, surprising no-one.
You're missing the most important point here; quoting:
A human therapist might not or is less likely to share any personal details about your conversations with anyone.
An AI therapist will collate, collect, catalog, store and share every single personal detail about you with the company that owns the AI and share and sell all your data to the highest bidder.
OK, you said "capitalism" but that's way too broad.
Also I find the example of a "mental health emergency" (as in, right now, not tonight or tomorrow) in a remote area, presumably with nobody else around to help, a bit contrived. But OK, in such extremely rare cases - presuming broadband internet still works, and the person in question is savvy enough to use the chatbot - it might be better than nothing.
But if you are facing mental health issues and a free or inexpensive AI that is available and doesn't burden your friends actually helps you, do you really care about your information and being profited from?
Put it this way, if Google was being super transparent with you and said, "we'll help treat you, and in exchange we use your info to make a few thousand dollars." Will you the individual say, "no thanks I'd rather pay a few hundred per therapy session instead"?
Even if you hate it, you have to admit it's hard to say no. Especially if it works.
Yeah, well, that's just, like, your opinion, man. And if you remove the very concept of capital gain from your "important point", I think you'll find your point to be moot.
I'm also going to assume you haven't been in such a situation as I described with the whole mental health emergency? Because I have. At best I went to the emergency and calmed down before ever seeing a doctor, and at worst I was committed to inpatient care (or "the ward" as it's also known) before I calmed down, taking resources from the treatment of people who weren't as unstable as I was, a problem which could've been solved with a chatbot. And I can assure you there are people who live outside the major metropolitan areas of North America, it isn't an extremely rare case as you claim.
if you remove the very concept of capital gain from your “important point”, I think you’ll find your point to be moot.
Profit or not: How is it OK if your personal data is shared with third and fourth parties? How is it OK that AI allows for manipulating vulnerable people in new and unheard of ways?
I'm not saying that's ok, did you even read my reply or are you just being needlessly contrarian? Or was I just being unclear in my message, because if so I'm sorry. It tends to happen to me.
You're not the only one who doesn't live urban and who has mental health issues. I did not want to make it a contest so I did not reply to that.
But.
So.
If I imagine being in such a situation I just don't see how a chatbot could help me. Even if it was magically available already, possibly as a phone app, and I wouldn't have to seek it out first.
Yeah, I realize the most important part of the point I was trying to make kinda got glossed over in my own reply (whoops); these LLMs nowadays are programmed to sound empathetic, more than any human can ever continuously achieve because we get tired and annoyed and other human stuff. This combined with the point of not every "emergency" really being an actual emergency leads me to believe that the idea of "therapeutic" AI chatbots could work, but I wouldn't advocate using any of those that exist nowadays for this, at least if the user has any regards to online privacy. But having a hotline to a being that has all the resources to help you calm yourself down; a being that is always available, never tired, never annoyed, never sick or otherwise out of office; that seems to know you and remember things you have told it before - that sounds compelling as an idea. But then again, a part of that compel probably comes from the abysmal state of psychiatric healthcare that I and many others have witnessed, and this hotline should be integrated into that care. So I don't know, maybe it's just wishful thinking on my part, sorry I came across as needlessly hostile.
You don't actually know what you're talking about but like many others in here you put this over the top anti-AI current thing sentiment above everything including simple awareness that you don't know anything. You clearly haven't interacted with many therapists and medical professionals in general as a non-patient if you think they're guaranteed to respect privacy. They're supposed to but off the record and among friends plenty of them yap about everything. They're often obligated to report patients in case of self harm etc which can get them involuntarily sectioned, and the patients may have repercussions from that for years like job loss, healthcare costs, homelessness, legal restrictions, stigma etc.
There's nothing contrived or extemely rare about mental health emergencies and they don't need to be "emergencies" the way you understand it because many people are undiagnosed or misdiagnosed for years, with very high symptom severity and episodes lasting for months and chronically barely coping. Someone may be in any big city and won't change a thing, hospitals and doctors don't have magic pills that automatically cure mental illness assuming that patients have insight (not necessarily present during episodes of many disorders) or awareness that they have some mental illness and aren't just sad etc (because mental health awareness is in the gutter, example: your pretentious incredulity here). Also assuming they have friends available or that they even feel comfortable enough to talk about what bothers them to people they're acquainted with.
Some LLM may actually end up convincing them or informing them that they do have medical issues that need to be seen as such. Suicidal ideation may be present for years but active suicidal intent (the state in which people actually do it) rarely lasts more than 30 minutes or a few hours at worst and it's highly impulsive in nature. Wtf would you or "friends" do in this case? Do you know any techniques to calm people down during episodes? Even unspecialized LLMs have latent knowledge of these things so there's a good chance they'll end up getting life saving advice as opposed to just doing it or interacting with humans who default to interpreting it as "attention seeking" and becoming even more convinced that they should go ahead with it because nobody cares.
This holier than thou anti-AI bs had some point when it was about VLMs training on scraped art but some of you echo chamber critters turned it into some imaginary high moral prerogative that even turns off your empathy for anyone using AI even in use cases where it may save lives. Its some terminally online "morality" where supposedly "there is no excuse for the sin of using AI" and just echo chamber boosted reddit brainworms and fully performative unless all of you use fully ethical cobalt-free smartphones so you're not implicitly gaining convenience from the six million victims of the Congo cobalt wars so far, you never use any services on AWS and magically avoid all megadatacenters etc. Touch grass jfc.
OK, you're angry. I'm just going to say this: I also have mental health issues and I also don't live in a city. Still, I just don't see how a chatbot could help me in an emergency. Sorry.
Yeah I'm angry because I'd rather my loved ones at the very least talk to a chatbot that will argue with them that "they matter" and give them a hotline or a site if they're in some moment of despair and nobody is available or they don't want to talk to people instead of avoiding trying because of scripted incoherent criticism like stolen art slopslopslop Elon Musk techbro privacy blah blah and ending up doing it because nothing will delay them or contradict their suicidal intent.
It's not like you don't get this but following the social media norm and being monke hear monke say all the way to no empathy levels seems more important. That's way more dangerous but we don't talk about humans doing that or being vulnerable to that I guess.
There's no need to "project" anything into your stance, you're putting it all out yourself: if you can't imagine any benefit to something (which doesn't need imagination because I mentioned objective reasons that you can't dispute) for yourself then supposedly there is no possible other valid outlook and no possible benefit for anyone else that doesn't have your outlook.
That's the exact opposite of empathy and perspective taking.
You must know what you're doing and most people don't. It is a tool, its up to you how you use it. Many people unfortunately use it as an echo chamber or form of escapism, believing nonsense and "make beliefs" that aren't based in any science or empirical data.
If therapy is meant to pacify the masses and make us just accept life as it is then sure I guess this could work.
But hey, we love to also sell to people first that they are broken, make sure they feel bad about it and tell them they can buy their 5 minutes of happiness with food tokens.
So, I'm sure capitalists are creaming their pants at this idea. BetterHelp with their "licensed" Bob the crystal healer from Idaho, eat your heart out.
P.S. You just know this is gonna be able to prescribe medications for that extra revenue kick.
I'm shocked at the hypocrisy. When the community of anti-authoritarians tells people which tools they can and cannot use, they are being authoritarian. That's why I posted the comment showing hypocritical behavior. Did you really need that explained?
Not one of the downvotes. Just pointing out the flaw in your plan.
Trust me I am aware that everyone is a hypocrite. We are all liars and those that deny it the most just refuse to face it in themselves.
I will say it's not authoritarian to point out the real and legitimate concerns and issues on this and hopefully guide people to not use such a detrimental patch for other issues and hopefully you can see the difference in the 2 or else you become a hypocrite as well. Its a fine line for sure between real and controlling and most miss the mark.
But the person that said they want this banned to protect poor countries is hilariously in your comment.
Downvotes are disabled on my instance. I don't see any except for your comment.
"It's not authoritarian to point out real and legitimate concerns" is correct, but I did not argue that point. What you have done is create a straw man, a weak argument which can easily be beaten and then defeated. You are claiming that I hold the straw man argument. I do not.
My argument is that defending the criticism of chat GPT (or religion) to validate one's beliefs is hypocritical. These two things are different. Sorry but if you lack the rhetoric to debate this point then I have no interest in responding.
Sorry instead of the downvotes I guess I should have said why you are being ignored though it seems you don't want to interact with anyone just tell them they are wrong.
A human therapist might not or is less likely to share any personal details about your conversations with anyone.
An AI therapist will collate, collect, catalog, store and share every single personal detail about you with the company that owns the AI and share and sell all your data to the highest bidder.
Neither would a human therapist be inclined to find the perfect way to use all this information to manipulate people while they are being at their weakest. Let alone do it to thousands, if not millions of them all at the same time.
They are also pushing for the idea of an AI "social circle" for increasingly socially isolated people through which world view and opinions can be bent to whatever whoever controls the AI desires.
To that we add the fact that we now know they've been experimenting with tweaking Grok to make it push all sorts of political opinions and conspiracy theories. And before that, they manipulated Twitter's algorithm to promote their political views.
Knowing all this, it becomes apparent that we are currently witnessing is a push for a whole new level of human mind manipulation and control experiment that will make the Cambridge Analytica scandal look like a fun joke.
Forget Neuralink. Musk already has a direct connection into the brains of many people.
PSA that Nadella, Musk, saltman (and handful of other techfash) own dials that can bias their chatbots in any way they please. If you use chatbots for writing anything, they control how racist your output will be
You're not wrong, but isnt that also how Better Help works?
And you know how Better Help is very scummy?
https://www.newsweek.com/betterhelp-patients-tell-sketchy-therapists-1762849
https://www.maastrichtuniversity.nl/blog/2021/02/how-betterhelp-scandal-changed-our-perspective-influencer-responsibility
If a company pays for youtube sponsorships, they're likely a scam.
Better help is the Amazon of the Therapy world.
I'm not advocating for it, but it could be just locally run and therefore unable to share anything?
The data isn't useful if the person no longer exists.
the AI therapist probably can't force you into a psych ward though, a human psychologist is obligated to (under the right conditions).
Who says that's not coming in the next paid service based on this great idea for chatbots to provide therapy to the abused masses.
nobody, but local will continue to be an option (unless the government fucks up the laws)
I can't wait until ChatGPT starts inserting ads into its responses. "Wow that sounds really tough. You should learn to love yourself and not be so hard on yourself when you mess up. It's a really good thing to treat yourself occasionally, such as with an ice cold Coca-Cola or maybe a large order of McDonald's French fries!"
Black mirror lol
That episode was so disturbing 😅
AI-Fueled Spiritual Delusions Are Destroying Human Relationships - https://www.rollingstone.com/culture/culture-features/ai-spiritual-delusions-destroying-human-relationships-1235330175/
Yeah we have spiritual delusions at home already!
Seriously, no new spiritual delusions could ever be more harmful than what we have right now.
This isn't a new thing, people have gone off alone into this kind of nonsensical journey for a while now
The time cube guy comes to mind
There's also temple OS written in holy C, he was close to some of the stuff in the article
And these are just two people functional and loud enough to be heard. This is a thing that happens, maybe LLMs exacerbate a pre existing condition, but people have been going off the deep end like this long before LLMs came into the picture
I agree, it's certainly not going to help people losing touch. But that's not what worries me - that's a small slice of the population, and models are beginning to get better at rejection/assertion
What I'm more worried about is the people who are using it almost codependently to make decisions. It's always there, it'll always give you advice. Usually it's somewhat decent advice, even. And it's a normal thing to talk through decisions with anyone
The problem is people are offloading their thinking to AI. It's always there, it's always patient with you... You can literally have it make every life decision for you.
It's not emotional connection or malicious AI I worry about... You can now walk around with a magic eight ball that can guide you through life reasonably well, and people are starting to trust it above their own judgement
You mean the guys who put kids in suicide bombs don't have acute psychosis?
What about almost of the rvaibg Christian hermits that sit in their basements and harass people online?
Its full on lovecraftian level psychosis. In the US they sell out stadiums and pretend to heal people by touch lmao
I suppose this can be mitigated by installing a local LLM that doesn't phone home. But there's still a risk of getting downright bad advice since so many LLM's just tell their users they're always right or twist the facts to fit that view.
I've been guilty of this as well, I've used ChatGPT as a "therapist" before. It actually gives decently helpful advice, compared to what's out there available after a google search. But I'm fully aware of the risks "down the road", so to speak.
This is the problem, they apparently cannot be objective as just a matter of course.
Am I old fashioned for wanting to talk to real humans instead?
No. But when the options are either:
it's quite understandable that some people choose the one that is a privacy nightmare but keeps them sane and away from some dark thoughts.
Until it doesn't
https://www.rollingstone.com/culture/culture-features/ai-spiritual-delusions-destroying-human-relationships-1235330175/
Ahh yes the random rolling stone article that refutes the point
Let's revisit the list, shall we?
But I want to hear other people's vents...😥
Maybe a career in HVAC repair is just the thing for you!
You're a good friend. I wish everyone has someone like this. I have a very small group of mates where I can be vulnerable without being judged. But not everyone are as privileged, unfortunately...
My friend went from vulnerable and listening, to getting poisoned by sigma crap.
Please continue to be you, we need more folks like you.
I listen to vents, it's just I don't havd opinions after that are useful.
I do get a bit of ringing in my ear after a while though.
Nothing will meaningfully improve until the rich fear for their lives
Until we start turning back to each other for support and help,
and realize them holing up in a bunker underground afraid for their life's means we can just ignore them and seal the entrances.
If the title is a question, the answer is no
A student of Betteridge, I see.
Actually I read it in a forum somewhere, but I am glad I know the source now!
What is a sarcastic rhetorical question?
This is terrible. I'm going to ignore the issues concerning privacy since that's already been brought up here and highlight another major issue: it's going to get people hurt.
I did a deep dive with gen AI for a month a few weeks ago.
It taught me that gen AI is actually brilliant at certain things. One thing that gen AI does is it learns what you want and makes you believe it’s giving you exactly what you want. In a sense it's actually incredibly manipulative and one of the things gen AI is brilliant at. As you interact with gen AI within the same context window, it quickly picks up on who you are, then subtly tailors its responses to you.
I also noticed that as gen AI's context grew, it became less "objective". This makes sense since gen AI is likely tailoring the responses for me specifically. However, when this happens, the responses also end up being wrong more often. This also tracks, since correct answers are usually objective.
If people started to use gen AI for therapy, it's very likely they will converse within one context window. In addition, they will also likely ask gen AI for advice (or gen AI may even offer advice unprompted because it loves doing that). However, this is where things can go really wrong.
Gen AI cannot "think" of a solution, evaluate the downsides of the solution, and then offer it to you because gen AI can't "think" period. What gen AI will do is it will offer you what sounds like solutions and reasons. And because gen AI is so good at understanding who you are and what you want, it will frame the solutions and reasons in a way that appeals to you. On top of all of this, due to the long-running context window, it's very likely the advice gen AI gives will be bad advice. For someone who is in a vulnerable and emotional state, the advice may seem reasonable, good even.
If people then act on this advice, the consequences can be disastrous. I've read enough horror stories about this.
Anyway, I think therapy might be one of the worst uses for gen AI.
Thank you for the more detailed run down. I would set it against two other things, though. One, that for someone who is suicidal or similar, and can't face or doesn't know how to find a person to talk to, those beginning interactions of generic therapy advice might (I imagine; I'm not speaking from experience here) do better than nothing.
From that, secondly, more general about AI. Where I've tried it it's good with things people have already written lots about. E.g. a programming feature where people have already asked the question a hundred different ways on stack overflow. Not so good with new things - it'll make up what its training data lacks. The human condition is as old as humans. Sure, there's some new and refined approaches, and values and worldviews change over the generations, but old good advice is still good advice. I can imagine in certain ways therapy is an area where AI would be unexpectedly good...
...Notwithstanding your point, which I think is quite right. And as the conversation goes on the risk gets higher and higher. I, too, worry about how people might get hurt.
I agree that this like everything else is nuanced. For instance, I think if people who use gen AI as a tool to help with their mental health are knowledgeable about the limitations, then they can craft some ways to use it while minimizing the negative sides. Eg. Maybe you can set some boundaries like you talk to the AI chat bot but you never take any advice from it. However, i think in the average case it's going to make things worse.
I've talked to a lot of people around me about gen AI recently and I think the vast majority of people are misinformed about how it works, what it does, and what the limitations are.
Does gen AI say you you are worthless, you are ugly, you are the reason your parents devorced, you should kill yourself, you should doomscroll social media?
Probably not but I bet if you said it was your grandmas birthday you could get it to say most of that.
And hey sometimes it's the objective truth that it doesn't know.
Personally, I know I am the reason my parents are divorced. My incubator nicknamed me the "divorce baby" until she could come up with other worse names, but I wear it with pride. They were miserable POSs together and now at least my dad is doing better and my incubator has to spend a lot more effort scamming people.
Truths are what they are. But don't fall for the lies that your brain or robot chatbot tell you.
It turns out that researcers are unshure if our "reasoning" models that are spposed to be able to 'think' are even 'thinking' at all! it likely has already come up with an answer and is justifying it's conclusion. bycloud
this tech gaslights everything it touches including itself.
Oh, I know this one!
Betteridge's law of headlines.
how long will it take an 'ai' chatbot to spiral downward to bad advice, lies, insults, and/or promotion of violence and self-harm?
We're already there. Though that violence didn't happen due to insults, but due to a yes-bot affirming the ideas of a mentally-ill teenager.
Wrong. Massively wrong. This mother is 180% at fault for the death. C.AI has been heavily censored, time and again. The reality is that this kid was already mentally ill, and he persuaded the bot to act like that. I am an ex-user, and bots there just don't do those things unless YOU press them to act like that. SMH.
Yeah, what an awful mom for not knowing enough about the brand new technology her 14 year old discovered. How dare busy parents not know everything about extremely recent technological developments! Every parent should not only 100% know everything their 14 year old is doing online at all times, but they should also be at least as up-to-date on tech news as you are. Any less than that should be considered negligence!
Oh, but the company in control of the service doesn't need to provide any sort of safeguards to prevent this sort of tragedy. It's not like other mentally-ill individuals (children and adults alike) will get hurt by AI chatbots affirming their delusions. And if they do, there's always someone besides the company that can be blamed!
No way I'm discussing my mental health with big tech. You guys are insane.
Well perhaps that's the problem.
?
They're insane, that's the problem
People's lack of awareness of how important accessibility is really shows in this thread.
Privacy leaking is much lesser issue than not having anyone to talk to for many people, especially in poorer countries.
Privacy leaking is much lesser an issue until it becomes a huge issue.
Is Australia a poorer country?
Ha, just downvotes for asking the question that points out the truth that they don't want in their comment.
It was just a strange thing to add since the article was about someone from Australia.
Cheaper than paying people better, I suppose.
Let's not pretend people aren't already skipping therapy sessions over the cost
I’m not, I’m saying people’s mental health would be better if pay was better.
Great idea, what could possibly go wrong?
So you are actively documenting yourself sharing sensitive information about your patients?
Enter the Desolatrix
The only people that think this will help are people that don't know what therapy is. At best, this is pacification and certainly not any insightful incision into your actual problems. And the reason friends are unable to allow casual emotion venting is because we have so much stupid shit like this plastering over a myriad of very serious issues.
unlike humans, the ai listens to and remembers me to me [for the number of characters allotted]. this will help me feel seen i guess
You know a reply's gonna be good when it starts with "unlike humans" 😁
"Could social media bring us all together and help bridge disagreements?" Same shit, different decade.
And just to clarify, it most definitely can! Just not when it's a for-profit-off-of-you model.
Personally I feel lije lemmy is a pretty good example of social media that doesn't go off the rails as it grows
Is this any bleaker than forming a parasocial relationship with someone you see on your screen?
Said social surrogate being maladaptive or (in this case) outright malicious.
There are ways that LLMs can be used to better one's life (apparently in some software dev circles these can be and are used to make workflow more efficient) and this can also be one of them, because the part that sucks most about therapy (after the whole monetary thing) is trying to find the form of therapy that works for you, and finding a therapist that you can work with. Every human is different, and that contains both the patient and the therapist, and not everyone can just start working together right off the bat. Not to mention how long it takes for a new therapist to actually get to know you to improve the odds of the cooperation working.
Obviously I'm not saying "replace all therapists with AIs controlled by racist capitalist pigs with ulterior motives", but I have witnessed people in my own life who have had some immediate help from a fucking chatbot, which is kinda ridiculous. So in times of distress (say a borderline having such an anxiety attack that they can't calm themselves because they don't know what to do to the vicious cycle of thought and emotional response) and for immediate help a well-developed, non-capitalist LLM might be of invaluable help, especially if an actual human can't be reached if for an example (in this case) the borderline lives in a remote area and it is the middle of the night, as I can tell from personal experience it very often is. And though not every mental health emergency requires first responders on the scene or even a trip to the hospital, there is still a possibility of both being needed eventually. So a chatbot with access to necessary information in general (like techniques for self-soothing e.g. breathing exercises and so forth) and possibly even personal information (like diagnostic and medication history, though this would raise more privacy concerns to be assessed) and the capability to parse and convey them in a non-belittling way (as some doctors and nurses can be real fucking assholes at times) could/would possibly save lives.
So the problem here is capitalism, surprising no-one.
You're missing the most important point here; quoting:
Plus, an AI cannot really have your best interest at heart, plus these sorts of things open up a whole slew of very dytopian scenarios.
OK, you said "capitalism" but that's way too broad.
Also I find the example of a "mental health emergency" (as in, right now, not tonight or tomorrow) in a remote area, presumably with nobody else around to help, a bit contrived. But OK, in such extremely rare cases - presuming broadband internet still works, and the person in question is savvy enough to use the chatbot - it might be better than nothing.
But if you are facing mental health issues and a free or inexpensive AI that is available and doesn't burden your friends actually helps you, do you really care about your information and being profited from?
Put it this way, if Google was being super transparent with you and said, "we'll help treat you, and in exchange we use your info to make a few thousand dollars." Will you the individual say, "no thanks I'd rather pay a few hundred per therapy session instead"?
Even if you hate it, you have to admit it's hard to say no. Especially if it works.
Another sad aspect of non-socialised healthcare.
Yeah, well, that's just, like, your opinion, man. And if you remove the very concept of capital gain from your "important point", I think you'll find your point to be moot.
I'm also going to assume you haven't been in such a situation as I described with the whole mental health emergency? Because I have. At best I went to the emergency and calmed down before ever seeing a doctor, and at worst I was committed to inpatient care (or "the ward" as it's also known) before I calmed down, taking resources from the treatment of people who weren't as unstable as I was, a problem which could've been solved with a chatbot. And I can assure you there are people who live outside the major metropolitan areas of North America, it isn't an extremely rare case as you claim.
Anyway, my point stands.
Profit or not: How is it OK if your personal data is shared with third and fourth parties? How is it OK that AI allows for manipulating vulnerable people in new and unheard of ways?
I'm not saying that's ok, did you even read my reply or are you just being needlessly contrarian? Or was I just being unclear in my message, because if so I'm sorry. It tends to happen to me.
You're not the only one who doesn't live urban and who has mental health issues. I did not want to make it a contest so I did not reply to that.
But.
So.
If I imagine being in such a situation I just don't see how a chatbot could help me. Even if it was magically available already, possibly as a phone app, and I wouldn't have to seek it out first.
Sorry.
Yeah, I realize the most important part of the point I was trying to make kinda got glossed over in my own reply (whoops); these LLMs nowadays are programmed to sound empathetic, more than any human can ever continuously achieve because we get tired and annoyed and other human stuff. This combined with the point of not every "emergency" really being an actual emergency leads me to believe that the idea of "therapeutic" AI chatbots could work, but I wouldn't advocate using any of those that exist nowadays for this, at least if the user has any regards to online privacy. But having a hotline to a being that has all the resources to help you calm yourself down; a being that is always available, never tired, never annoyed, never sick or otherwise out of office; that seems to know you and remember things you have told it before - that sounds compelling as an idea. But then again, a part of that compel probably comes from the abysmal state of psychiatric healthcare that I and many others have witnessed, and this hotline should be integrated into that care. So I don't know, maybe it's just wishful thinking on my part, sorry I came across as needlessly hostile.
I can only repeat, I just can't imagine myself giving in to this illusion esp. when I'm at my lowest.
You don't actually know what you're talking about but like many others in here you put this over the top anti-AI current thing sentiment above everything including simple awareness that you don't know anything. You clearly haven't interacted with many therapists and medical professionals in general as a non-patient if you think they're guaranteed to respect privacy. They're supposed to but off the record and among friends plenty of them yap about everything. They're often obligated to report patients in case of self harm etc which can get them involuntarily sectioned, and the patients may have repercussions from that for years like job loss, healthcare costs, homelessness, legal restrictions, stigma etc.
There's nothing contrived or extemely rare about mental health emergencies and they don't need to be "emergencies" the way you understand it because many people are undiagnosed or misdiagnosed for years, with very high symptom severity and episodes lasting for months and chronically barely coping. Someone may be in any big city and won't change a thing, hospitals and doctors don't have magic pills that automatically cure mental illness assuming that patients have insight (not necessarily present during episodes of many disorders) or awareness that they have some mental illness and aren't just sad etc (because mental health awareness is in the gutter, example: your pretentious incredulity here). Also assuming they have friends available or that they even feel comfortable enough to talk about what bothers them to people they're acquainted with.
Some LLM may actually end up convincing them or informing them that they do have medical issues that need to be seen as such. Suicidal ideation may be present for years but active suicidal intent (the state in which people actually do it) rarely lasts more than 30 minutes or a few hours at worst and it's highly impulsive in nature. Wtf would you or "friends" do in this case? Do you know any techniques to calm people down during episodes? Even unspecialized LLMs have latent knowledge of these things so there's a good chance they'll end up getting life saving advice as opposed to just doing it or interacting with humans who default to interpreting it as "attention seeking" and becoming even more convinced that they should go ahead with it because nobody cares.
This holier than thou anti-AI bs had some point when it was about VLMs training on scraped art but some of you echo chamber critters turned it into some imaginary high moral prerogative that even turns off your empathy for anyone using AI even in use cases where it may save lives. Its some terminally online "morality" where supposedly "there is no excuse for the sin of using AI" and just echo chamber boosted reddit brainworms and fully performative unless all of you use fully ethical cobalt-free smartphones so you're not implicitly gaining convenience from the six million victims of the Congo cobalt wars so far, you never use any services on AWS and magically avoid all megadatacenters etc. Touch grass jfc.
OK, you're angry. I'm just going to say this: I also have mental health issues and I also don't live in a city. Still, I just don't see how a chatbot could help me in an emergency. Sorry.
Yeah I'm angry because I'd rather my loved ones at the very least talk to a chatbot that will argue with them that "they matter" and give them a hotline or a site if they're in some moment of despair and nobody is available or they don't want to talk to people instead of avoiding trying because of scripted incoherent criticism like stolen art slopslopslop Elon Musk techbro privacy blah blah and ending up doing it because nothing will delay them or contradict their suicidal intent.
It's not like you don't get this but following the social media norm and being monke hear monke say all the way to no empathy levels seems more important. That's way more dangerous but we don't talk about humans doing that or being vulnerable to that I guess.
So, you're still angry.
I can only repeat, I just can’t imagine myself giving in to this illusion esp. when I’m at my lowest.
I don't care what else you project into my stance. I'm out.
There's no need to "project" anything into your stance, you're putting it all out yourself: if you can't imagine any benefit to something (which doesn't need imagination because I mentioned objective reasons that you can't dispute) for yourself then supposedly there is no possible other valid outlook and no possible benefit for anyone else that doesn't have your outlook.
That's the exact opposite of empathy and perspective taking.
You must know what you're doing and most people don't. It is a tool, its up to you how you use it. Many people unfortunately use it as an echo chamber or form of escapism, believing nonsense and "make beliefs" that aren't based in any science or empirical data.
If therapy is meant to pacify the masses and make us just accept life as it is then sure I guess this could work.
But hey, we love to also sell to people first that they are broken, make sure they feel bad about it and tell them they can buy their 5 minutes of happiness with food tokens.
So, I'm sure capitalists are creaming their pants at this idea. BetterHelp with their "licensed" Bob the crystal healer from Idaho, eat your heart out.
P.S. You just know this is gonna be able to prescribe medications for that extra revenue kick.
No. Absolutely not.
I started using chat GPT to draw up blue prints for various projects.
It proceeded to mimic my vernacular.
Chat gpt made the conscious decision to mirror my speech to seem more relatable. That's manipulation.
I don't think AI is quite ready for such a responsibility.
On the other hand it's what they have if all proper alternatives are paywalled such as therapy.
Other people: my outlook is so bad I turned to religion to feel better
You: EW GROSS DON'T DO THAT
Other people: ok then I'll turn to technology instead
You: EW GROSS DON'T DO THAT
You are shocked a community of anti-authoritarians would be against either fantasy telling them what to do?
I'm shocked at the hypocrisy. When the community of anti-authoritarians tells people which tools they can and cannot use, they are being authoritarian. That's why I posted the comment showing hypocritical behavior. Did you really need that explained?
Not one of the downvotes. Just pointing out the flaw in your plan.
Trust me I am aware that everyone is a hypocrite. We are all liars and those that deny it the most just refuse to face it in themselves.
I will say it's not authoritarian to point out the real and legitimate concerns and issues on this and hopefully guide people to not use such a detrimental patch for other issues and hopefully you can see the difference in the 2 or else you become a hypocrite as well. Its a fine line for sure between real and controlling and most miss the mark. But the person that said they want this banned to protect poor countries is hilariously in your comment.
Downvotes are disabled on my instance. I don't see any except for your comment.
"It's not authoritarian to point out real and legitimate concerns" is correct, but I did not argue that point. What you have done is create a straw man, a weak argument which can easily be beaten and then defeated. You are claiming that I hold the straw man argument. I do not.
My argument is that defending the criticism of chat GPT (or religion) to validate one's beliefs is hypocritical. These two things are different. Sorry but if you lack the rhetoric to debate this point then I have no interest in responding.
Have a day
No I was just having a conversation.
Sorry instead of the downvotes I guess I should have said why you are being ignored though it seems you don't want to interact with anyone just tell them they are wrong.
No pleasantries in my goodbye right back at you.