AI medical tools found to downplay symptoms of women, ethnic minorities
https://arstechnica.com/health/2025/09/ai-medical-tools-found-to-downplay-symptoms-of-women-ethnic-minorities/Open linkView original on piefed.socialSyndicated from the fediverse. Read and engage on the original instance.
View original on piefed.socialhttps://arstechnica.com/health/2025/09/ai-medical-tools-found-to-downplay-symptoms-of-women-ethnic-minorities/Open linkView original on piefed.social
5 replies
Just like real doctors 👀
Bias training data = bias LLM. Who knew?
Imagine, a hallucination engine mostly developed by white men and trained on data gathered by white men failing to treat symptoms experienced by women and ethnic minorities seriously. Who would've guessed this outcome?!
Imagine a hallucination engine being developed globally by white men in China on data gathered by white men in India.
Wait...what?
Truth is that even here in the United States roughly 30% of the AI Workforce is non-male. You can hop online and look at pictures from AI Conferences from around the world and notice a high participation of non-male presenting people, sometimes approaching at least half the audience.
Garbage in, garbage out.
Especially when you shove it into a garbage maker.