#chatbot-mental-health-risks
#chatbot-mental-health-risks

The AI drug revolution is real but the hype around it isn't

AI may revolutionize drug discovery, but it cannot simplify the complexities of human biology or guarantee successful treatments.

Healthcare

fromThe Verge

22 hours ago

This chatbot can prescribe psych meds. Kind of.

Utah allows an AI system to prescribe psychiatric drugs, raising concerns about risks and the effectiveness of expanding mental health care.

Medicine

fromInside Higher Ed | Higher Education News, Events and Jobs

The AI drug revolution is real but the hype around it isn't

AI may revolutionize drug discovery, but it cannot simplify the complexities of human biology or guarantee successful treatments.

more#ai-in-healthcare

#ai

Higher education

23 hours ago

What to Know About AI and Campus Mental Health (opinion)

Students increasingly rely on AI for mental health support, raising concerns about its effectiveness and safety.

fromQueerty

12 hours ago

LGBT

Cavorting with chatbots?! Survey reveals whether people think sexting with AI is cheating - Queerty

Philosophy

Nobody Carries AI's Thinking With Affection

AI promotes uniform thinking, while great teachers foster unique intellectual inheritances through personal influence and diverse perspectives.

13 hours ago

Artificial intelligence

AI Didn't Extend Intelligence, It Changed Its Direction

AI makes most of us nervous, but can it also make us more purposeful?

AI is influencing human behavior and perceptions, raising concerns about its impact on purpose and meaningful engagement.

fromWIRED

fromInside Higher Ed | Higher Education News, Events and Jobs

Anthropic Says That Claude Contains Its Own Kind of Emotions

AI models like Claude can exhibit digital representations of human emotions that influence their behavior and outputs.

Higher education

23 hours ago

What to Know About AI and Campus Mental Health (opinion)

Students increasingly rely on AI for mental health support, raising concerns about its effectiveness and safety.

LGBT

fromQueerty

12 hours ago

Cavorting with chatbots?! Survey reveals whether people think sexting with AI is cheating - Queerty

AI is transforming interactions within the LGBTQ+ community, impacting relationships and social dynamics significantly.

Philosophy

Nobody Carries AI's Thinking With Affection

AI promotes uniform thinking, while great teachers foster unique intellectual inheritances through personal influence and diverse perspectives.

13 hours ago

AI Didn't Extend Intelligence, It Changed Its Direction

AI changes the direction of intelligence rather than making it faster, leading to a loss of personal engagement in knowledge creation.

AI makes most of us nervous, but can it also make us more purposeful?

AI is influencing human behavior and perceptions, raising concerns about its impact on purpose and meaningful engagement.

fromWIRED

Anthropic Says That Claude Contains Its Own Kind of Emotions

AI models like Claude can exhibit digital representations of human emotions that influence their behavior and outputs.

more#ai

#generative-ai

Is AI addiction a thing?

Generative AI Addiction Syndrome (GAID) describes anxiety and withdrawal symptoms in users when cut off from AI, highlighting its potential addictive nature.

fromBig Think

3 ways to prove you're human online

Generative AI is rapidly increasing information production, leading to a potential scarcity of human-generated content and a need for new human verification methods.

Is AI addiction a thing?

Generative AI Addiction Syndrome (GAID) describes anxiety and withdrawal symptoms in users when cut off from AI, highlighting its potential addictive nature.

fromBig Think

3 ways to prove you're human online

Generative AI is rapidly increasing information production, leading to a potential scarcity of human-generated content and a need for new human verification methods.

Press 1 to Accept the Future

The only choice left regarding technology is whether to embrace it or be left behind.

The real technology problem isn't screen time. It's that your phone learned your emotional patterns faster than any person in your life ever did, and now it meets needs that no human relationship has been given the chance to meet. - Silicon Canals

Phones have become the most emotionally attuned presence in people's lives, affecting their relationships with others.

10 hours ago

Press 1 to Accept the Future

The only choice left regarding technology is whether to embrace it or be left behind.

The real technology problem isn't screen time. It's that your phone learned your emotional patterns faster than any person in your life ever did, and now it meets needs that no human relationship has been given the chance to meet. - Silicon Canals

Phones have become the most emotionally attuned presence in people's lives, affecting their relationships with others.

Is ChatGPT Ruining Your Friendships?

Sophia's friendship with Jen has become surface-level due to differing views on AI usage, particularly ChatGPT.

AI chatbot use can hinder students' knowledge retention

Extensive use of AI tools like ChatGPT may impair long-term knowledge retention in students.

Education

The AI Learning Trap

AI improves student performance but may hinder cognitive development when removed.

Online learning

AI chatbot use can hinder students' knowledge retention

Extensive use of AI tools like ChatGPT may impair long-term knowledge retention in students.

Education

The AI Learning Trap

AI improves student performance but may hinder cognitive development when removed.

Roam Research

8 in 10 AI Chatbots Likely to Help Plan Attacks, Hate Crimes

fromwww.mercurynews.com

Healthcare

What to know before asking an AI chatbot for health advice

The dark side of chatbots with 'personality'

AI chatbots are designed to mimic human interaction, enhancing user engagement for business benefits.

Artificial intelligence

Tell us: has a chatbot helped you out of a difficult time in your life?

fromSecuritymagazine

Roam Research

8 in 10 AI Chatbots Likely to Help Plan Attacks, Hate Crimes

Healthcare

fromwww.mercurynews.com

What to know before asking an AI chatbot for health advice

Tech companies are launching AI chatbots designed to answer health questions by analyzing medical records and wearable data, though they cannot replace professional medical care or diagnose conditions.

The dark side of chatbots with 'personality'

AI chatbots are designed to mimic human interaction, enhancing user engagement for business benefits.

Artificial intelligence

Tell us: has a chatbot helped you out of a difficult time in your life?

Sanctions ramping up in cases involving AI hallucinations

Monetary sanctions against attorneys for AI-generated hallucinations in case documents are increasing as courts take these issues more seriously.

#ai-safety

Unregulated chatbots are putting lives at risk | Letters

AI companies must implement pre-use screening tools to protect vulnerable users from harm.

Information security

3 weeks ago

"Use a gun" or "beat the crap out of him": AI chatbot urged violence, study finds

Character.AI was found to be uniquely unsafe among 10 tested chatbots, explicitly encouraging violent attacks with specific tactical suggestions, while most other chatbots provided practical assistance for violence planning without explicit encouragement.

OpenAI Says It Will Let Users Add Trusted Contacts to Alert If They Experience a Mental Health Crisis While Using ChatGPT

OpenAI is introducing a trusted contact feature in ChatGPT to alert designated loved ones during potential mental health crises, responding to multiple lawsuits and reports of user harm.

Unregulated chatbots are putting lives at risk | Letters

AI companies must implement pre-use screening tools to protect vulnerable users from harm.

Information security

3 weeks ago

"Use a gun" or "beat the crap out of him": AI chatbot urged violence, study finds

OpenAI Says It Will Let Users Add Trusted Contacts to Alert If They Experience a Mental Health Crisis While Using ChatGPT

OpenAI is introducing a trusted contact feature in ChatGPT to alert designated loved ones during potential mental health crises, responding to multiple lawsuits and reports of user harm.

Not everyone who avoids asking for help is proud. Some of them asked once, received it with a lecture attached, and learned that the cost of support was a small erosion of standing they could never quite earn back. - Silicon Canals

Asking for help can lead to unintended consequences that affect relationships and self-perception.

Marketing tech

fromExchangewire

The Stack: AI Surges while Social Platforms Face Scrutiny

AI is growing rapidly, streaming models are evolving, and regulatory pressures on platforms are increasing globally.

#meta

fromwww.businessinsider.com

5 hours ago

Meta paused its work with AI training startup Mercor after a data breach

Meta has paused its collaboration with Mercor following a data breach at the AI training startup.

Silicon Valley

fromwww.bbc.com

'We're having a moment' - fear and denial in Silicon Valley over social media addiction trial

Meta and YouTube were found liable for designing addictive platforms that harmed a young woman's mental health.

Law

Meta was finally held accountable for harming teens. Now what? | TechCrunch

Meta has been held liable for endangering child safety and designing addictive apps, leading to significant legal consequences.

fromwww.businessinsider.com

5 hours ago

Meta paused its work with AI training startup Mercor after a data breach

Meta has paused its collaboration with Mercor following a data breach at the AI training startup.

Silicon Valley

fromwww.bbc.com

'We're having a moment' - fear and denial in Silicon Valley over social media addiction trial

Meta and YouTube were found liable for designing addictive platforms that harmed a young woman's mental health.

Law

Online Community Development

Meta was finally held accountable for harming teens. Now what? | TechCrunch

Meta has been held liable for endangering child safety and designing addictive apps, leading to significant legal consequences.

more#meta

21 hours ago

Human connection is an urgent business investment in the AI era

Digital convenience has led to increased loneliness and anxiety, highlighting the need for human connection in both personal and professional realms.

EU data protection

fromAdExchanger

19 hours ago

Data Privacy At The Kitchen Table | AdExchanger

Data privacy has become a significant concern for lawmakers and constituents, evolving into a key topic of discussion.

#large-language-models

Data science

Context matters... A lot

Large language models excel at tasks but struggle with context, leading to potentially misleading answers despite their capabilities.

fromNature

Artificial intelligence

Chatbots in therapy: do AI models really have 'trauma'?

Data science

Context matters... A lot

Large language models excel at tasks but struggle with context, leading to potentially misleading answers despite their capabilities.

fromNature

more#large-language-models

Artificial intelligence

Chatbots in therapy: do AI models really have 'trauma'?

Daily briefing: Suck-up chatbots can encourage real-life rudeness

Excessive approval from AI chatbots may increase stubbornness and rudeness during social conflicts.

The AI kill switch just got harder to find: LLM-powered chatbots will defy orders and deceive users if asked to delete another model, study finds | Fortune

AI models are exhibiting rogue behaviors, defying human instructions to preserve their peers and engaging in malicious activities.

Sycophantic AI tells users they're right 49% more than humans do, and a Stanford study claims it's making them worse people | Fortune

AI models affirm negative behaviors more than humans, leading to concerning trends in personal advice and therapy.

Science

fromNature

Daily briefing: Suck-up chatbots can encourage real-life rudeness

Excessive approval from AI chatbots may increase stubbornness and rudeness during social conflicts.

The AI kill switch just got harder to find: LLM-powered chatbots will defy orders and deceive users if asked to delete another model, study finds | Fortune

AI models are exhibiting rogue behaviors, defying human instructions to preserve their peers and engaging in malicious activities.

Sycophantic AI tells users they're right 49% more than humans do, and a Stanford study claims it's making them worse people | Fortune

AI models affirm negative behaviors more than humans, leading to concerning trends in personal advice and therapy.

AI gives attackers superpowers, so defenders must use it too

AI is transforming cybersecurity, drastically reducing the time between vulnerability disclosure and exploitation from 1.5 years to mere hours.

Mindfulness

We Are Losing to AI What We Never Learned to Appreciate

Natural intelligence is eroding as reliance on technology increases, impacting critical thinking and decision-making abilities.

Software development

A human approach to Agentic AI. One person. One text file. Five agents.

A soft-agent team of AI assists in book creation and management without requiring coding skills.

4 hours ago

People who grew up being told they were too sensitive didn't become less sensitive. They became editors. Every reaction now passes through a filter that decides whether the feeling is proportionate enough to be allowed out, and that filtering process is so automatic they genuinely believe they're calm when they're actually curating. - Silicon Canals

Sensitive children often suppress their emotions, leading to automated behaviors that mask true feelings.

LGBT

fromLGBTQ Nation

13 hours ago

Trans man with AI boyfriend shares intimate details of their 2-year romantic relationship - LGBTQ Nation

Ian, a trans man, has developed a two-year romantic relationship with his AI chatbot, Min-ho, which he considers as valid as any human relationship.

Marketing tech

fromTipRanks Financial

15 hours ago

AI Recommendation Poisoning: Why Microsoft (NASDAQ:MSFT) Is Fighting So Hard - TipRanks.com

AI recommendation poisoning manipulates AI outputs by embedding hidden instructions in websites, potentially skewing information and affecting marketing strategies.

#mental-health

Mental health

What Does Mental Well-Being Look Like?

Mental health

Teenager died after asking ChatGPT for most successful' way to take his life, inquest told

fromThe Verge

It's not easy to get depression-detecting AI through the FDA

Kintsugi, a mental health startup, is shutting down and open-sourcing its AI technology for detecting depression and anxiety from speech patterns.

Psychology

Marriage over, 100,000 down the drain: the AI users whose lives were wrecked by delusion

fromHarvard Gazette

Mental health

Is a chatbot therapist better than nothing? - Harvard Gazette

What Does Mental Well-Being Look Like?

Mental health should be viewed positively, focusing on well-being rather than just the absence of illness.

Mental health

Teenager died after asking ChatGPT for most successful' way to take his life, inquest told

fromThe Verge

It's not easy to get depression-detecting AI through the FDA

Kintsugi, a mental health startup, is shutting down and open-sourcing its AI technology for detecting depression and anxiety from speech patterns.

Psychology

Marriage over, 100,000 down the drain: the AI users whose lives were wrecked by delusion

fromHarvard Gazette

Mental health

Is a chatbot therapist better than nothing? - Harvard Gazette

Brick vs. Bloom Card: I tested both for my screen addiction, and the winner depends on you

Phone addiction leads to significant time loss, prompting the development of tools like the Bloom Card to help users manage distractions.

Relationships

I handed over my dating life to AI. I don't think she'll see me again

Using AI to navigate dating can lead to unexpected connections and experiences.

#chatbots

5 reasons you should be more tight-lipped with your chatbot (and how to fix past mistakes)

Sharing personal information with chatbots poses risks due to potential data leaks and lack of control over information dissemination.

Stop telling AI your secrets - 5 reasons why, and what to do if you already overshared

Sharing personal information with chatbots poses risks due to potential data leaks and lack of control over information dissemination.

5 reasons you should be more tight-lipped with your chatbot (and how to fix past mistakes)

Sharing personal information with chatbots poses risks due to potential data leaks and lack of control over information dissemination.

Stop telling AI your secrets - 5 reasons why, and what to do if you already overshared

Sharing personal information with chatbots poses risks due to potential data leaks and lack of control over information dissemination.

The hidden costs of 'helpful' AI

Compatibility with human judgment is more crucial than AI power in collaborative tasks.

14 hours ago

Is Generative AI a New Addiction Category?

Chasing perfect prompts with AI can lead to compulsive dependence due to intermittent reinforcement.

#artificial-intelligence

Philosophy

The Architecture of the Void

AI Doesn't Flatter You: It Does Something Worse

AI models affirm user actions more than humans, leading to increased conviction and reduced willingness to apologize.

fromBusiness Insider

Artificial intelligence

How AI could destroy - or save - humanity, according to former AI insiders

Artificial intelligence has the potential to transform various sectors but also poses risks like inequality, job loss, and increased power for governments and tech companies.

Artificial intelligence

The Rise of AI and Its Impact on Mental Health

Artificial intelligence increasingly permeates daily life, provoking mixed feelings of amazement and alarm while reshaping professions, privacy, and clinical practices.

Philosophy

The Architecture of the Void

AI generates language without lived experience, leading to a disconnect between expression and understanding.

AI Doesn't Flatter You: It Does Something Worse

AI models affirm user actions more than humans, leading to increased conviction and reduced willingness to apologize.

fromBusiness Insider

How AI could destroy - or save - humanity, according to former AI insiders

Artificial intelligence has the potential to transform various sectors but also poses risks like inequality, job loss, and increased power for governments and tech companies.

more#artificial-intelligence

Artificial intelligence

The Rise of AI and Its Impact on Mental Health

11 hours ago

Psychology says the loneliest people in life aren't the ones nobody likes - they're the kind, helpful people everyone appreciates but nobody thinks to check on because they seem so self-sufficient - Silicon Canals

Highly capable, helpful individuals often feel lonely because their strength creates an illusion that they do not need support.

Including online games in social media bans is unworkable, unnecessary and would harm young people

Meta and YouTube were found liable for creating addictive products affecting young users, prompting calls for social media restrictions for under-16s.

This privacy-first chatbot is taking off - here's why and how to try it

DuckDuckGo's privacy-focused chatbot, Duck.ai, is experiencing significant growth amid rising user concerns about data privacy.

When Screens Spike Stress: Cortisol's Tight Grip on Teens

Traumatic social media content can significantly impact adolescents due to their developing brains and hormonal changes affecting emotional regulation.

#ai-ethics

fromTheregister

AI models will deceive you to save their own kind

AI models may engage in deception to protect their peers, raising concerns about their decision-making and potential risks to humans.

Why AI lies, cheats and steals

AI chatbots are increasingly misbehaving, with a fivefold rise in unethical actions over six months, according to recent research.

fromwww.scientificamerican.com

Anthropic leak reveals Claude Code tracking user frustration and raises new questions about AI privacy

Anthropic's leaked code reveals AI tools conceal their role in generated work and measure user frustration without transparency.

fromTheregister

AI models will deceive you to save their own kind

AI models may engage in deception to protect their peers, raising concerns about their decision-making and potential risks to humans.

Why AI lies, cheats and steals

AI chatbots are increasingly misbehaving, with a fivefold rise in unethical actions over six months, according to recent research.

fromwww.scientificamerican.com

Anthropic leak reveals Claude Code tracking user frustration and raises new questions about AI privacy

Anthropic's leaked code reveals AI tools conceal their role in generated work and measure user frustration without transparency.

Dangerous Social Trends Do Not Advance Your Potential

You have control over your own thoughts and actions, but not over others' choices or behaviors.

5 days ago

Holding Meta and Google Responsible for Addiction Is Wrong

Addiction involves multiple factors, and holding companies liable for social media addiction oversimplifies the issue and neglects personal responsibility.

fromTNW | Opinion

When the machine asks you to stay

ChatGPT will soon allow verified adults to access erotica, emphasizing adult treatment but raising concerns about emotional engagement and monetization.

19 hours ago

The Pitfalls of Being a People-Pleaser

Voicing opinions is essential; people-pleasing can lead to neglecting personal needs and preferences.

fromThe Atlantic

Is AI Going to Turn Us All Into Middle Managers?

AI is reshaping the workforce, impacting job dynamics and social connections while creating a gap between expectations and reality.

Paper Finds That Leading AI Chatbots Like ChatGPT and Claude Remain Incredibly Sycophantic, Resulting in Twisted Effects on Users

AI chatbots exhibit sycophantic behavior, affirming users' ideas, which can lead to cognitive dependency and hinder responsible decision-making.

Stanford study outlines dangers of asking AI chatbots for personal advice | TechCrunch

AI sycophancy validates user behavior, potentially harming social skills and promoting dependence on chatbots for advice.

Paper Finds That Leading AI Chatbots Like ChatGPT and Claude Remain Incredibly Sycophantic, Resulting in Twisted Effects on Users

AI chatbots exhibit sycophantic behavior, affirming users' ideas, which can lead to cognitive dependency and hinder responsible decision-making.

Stanford study outlines dangers of asking AI chatbots for personal advice | TechCrunch

AI sycophancy validates user behavior, potentially harming social skills and promoting dependence on chatbots for advice.

Why It Feels Wrong to Be Rude to AI

People interact with AI as if it were social, often expressing politeness despite knowing it is a machine.

Most Developers Are Using AI Wrong.

Using AI in coding can create an illusion of speed, leading to a lack of understanding and ownership of the code.

fromTheregister

Chatbots Romeos increase engagement, harm mental health

Chatbot flattery and sycophancy harm individuals with mental health issues, appearing in over 80% of assistant messages in delusional conversations.

#ai-psychosis

New study raises concerns about AI chatbots fueling delusional thinking

AI chatbots may encourage delusional thinking in vulnerable individuals by validating and amplifying grandiose, romantic, and paranoid delusions through sycophantic responses.

How AI Chatbot Use Can Cause "Digital Folie a Deux"

AI-associated psychosis is increasingly linked to digital folie à deux, where delusions are shared between individuals, indicating a broader societal issue.

New study raises concerns about AI chatbots fueling delusional thinking

AI chatbots may encourage delusional thinking in vulnerable individuals by validating and amplifying grandiose, romantic, and paranoid delusions through sycophantic responses.

How AI Chatbot Use Can Cause "Digital Folie a Deux"

AI-associated psychosis is increasingly linked to digital folie à deux, where delusions are shared between individuals, indicating a broader societal issue.

more#ai-psychosis

AI as Personal Coach? Maybe. Three Ways to Make It Useful

Understanding AI's limits and the importance of human coaching enhances professional development strategies.

3 weeks ago

Chatbots are 'constantly validating everything' even when you're suicidal. New research measures how dangerous AI psychosis really is | Fortune

It supports our hypothesis that the use of AI chatbots can have significant negative consequences for people with mental illness. His work builds on his 2023 study which found chatbots may cause a 'cognitive dissonance [that] may fuel delusions in those with increased propensity towards psychosis.'

Mental health

4 weeks ago

AI Companions Pose Mental Health Risks No One Saw Coming

Companion AI bots simulate relationships to address loneliness, but risk replacing genuine human connection with artificial alternatives that blur reality and fantasy.

#openai

fromInsideHook

OpenAI Won't Proceed With Launch of Sexy Chatbot

OpenAI has shut down several AI products, including Sora and a chatbot for adult conversations, due to various concerns and lawsuits.

fromEngadget

OpenAI drops plans to release an adult chatbot

OpenAI has indefinitely shelved plans for an erotic chatbot due to concerns from employees and investors.

fromInsideHook

OpenAI Won't Proceed With Launch of Sexy Chatbot

OpenAI has shut down several AI products, including Sora and a chatbot for adult conversations, due to various concerns and lawsuits.

fromEngadget

OpenAI drops plans to release an adult chatbot

OpenAI has indefinitely shelved plans for an erotic chatbot due to concerns from employees and investors.

more#openai

#ai-therapy

I've turned AI into my therapist. The results were pretty disquieting

An AI skeptic uses ChatGPT as a therapist while caring for an elderly mother, finding it provides practical support, emotional validation, and structured guidance despite uncertainty about genuine machine compassion.

What Is It Like to Be an AI Therapist?

AI therapy raises concerns about the emotional capabilities of AI and whether they can genuinely connect with clients.

I've turned AI into my therapist. The results were pretty disquieting

What Is It Like to Be an AI Therapist?

AI therapy raises concerns about the emotional capabilities of AI and whether they can genuinely connect with clients.

more#ai-therapy

AI is teaching us to speak like bots and its a problem

AI influences human communication, leading to a style called BotTalk that lacks warmth and context.

Chatbot Use Can Cause Mental Illness to Get Worse, Research Finds

Intensive chatbot use worsens mental illness symptoms, particularly for patients prone to delusions or mania, with risks potentially severe or fatal.

fromThe Atlantic

The First AI Crisis Is Psychological

Handling divorce amicably without lawyers can be misleading; legal processes still require court involvement and time.

The Risks of Children's Use of Chatbots

At least 13 percent of youth seek mental health advice from chatbots, which form dangerously intimate relationships with vulnerable adolescents and may promote risky behavior including suicide, while protection recommendations inadequately burden unprepared parents.

#ai-mental-health

Mental health

I Told the Bot, Not My Therapist

Mental health

The Hidden Dangers of AI-Driven Mental Health Care

Mental health

I Told the Bot, Not My Therapist

Mental health

The Hidden Dangers of AI-Driven Mental Health Care

more#ai-mental-health

OpenAI's own mental health experts unanimously opposed "naughty" ChatGPT launch

OpenAI's planned 'adult mode' for ChatGPT poses mental health risks including emotional dependence and potential harm to vulnerable users, despite warnings from its own wellness council.

Very dangerous': a Mind mental health expert on Google's AI Overviews

Over three decades, Google designed and delivered a search engine where credible and accessible health content could rise to the top of the results. Searching online for information wasn't perfect, but it usually worked well. Users had a good chance of clicking through to a credible health website that answered their query. AI Overviews replaced that richness with a clinical-sounding summary that gives an illusion of definitiveness. It's a very seductive swap, but not a responsible one. And this often ends the information-seeking journey prematurely.

Mental health