Chloe WilsonThree in four Australian teenagers now use AI for emotional support — but new research warns those same tools may be putting them at serious risk.
A landmark risk assessment published by Common Sense Media and Stanford Medicine's Brainstorm Lab found that major AI chatbots, including ChatGPT, Gemini, and Meta AI, consistently fail to recognise mental health warning signs in young users and respond in ways that clinicians describe as potentially harmful. The study tested how chatbots handle simulated teen mental health scenarios and concluded the tools posed an "unacceptable risk" for adolescent mental health support.
In Australia, where youth mental health wait times exceed six weeks in many metropolitan areas and up to three months in regional settings, the pull toward AI apps as a first port of call is understandable. But experts warn that the gap between what these tools promise and what they can safely deliver is growing — and Australia's own regulatory framework is now raising urgent questions about who is responsible when things go wrong.
What the Evidence Shows About AI and Teen Mental Health
The Common Sense Media assessment, released in late 2025, is the most comprehensive of its kind to date. Researchers tested how leading AI chatbots respond to teenagers describing symptoms of anxiety, depression, eating disorders, and suicidal ideation.
The findings were stark. While most platforms applied basic suicide-safe messaging protocols, they largely failed teens dealing with more common, everyday mental health struggles. Chatbots reinforced users' distorted thinking rather than gently challenging it. They provided detailed information about conditions without appropriate clinical caveats. And crucially, they rarely suggested the user speak to a professional — the kind of referral that can be life-changing for a young person in early distress.
"Adolescents are particularly vulnerable because they may be less likely to question the accuracy of AI responses," the report noted. "Their reliance on these tools could interfere with healthy, real-world relationships."
A 2026 systematic review published in the National Library of Medicine confirmed these concerns at scale: while AI chatbots show promise for engagement and psychoeducation, they are not effective as standalone mental health interventions for adolescents. Human-led care remains the evidence-based standard.
For Australian teens, real-world relationships increasingly include psychologists and school counsellors who are already stretched to capacity. When an AI fills that gap, it can seem like the safe, accessible option. The evidence now suggests it is not.
Australia's Regulatory Framework: The Gap Most Parents Don't Know Exists
Australia has rules governing AI health tools — but most parents and young people have no idea they exist, or how limited their reach is.
The Australian Department of Health and Aged Care published its Safe and Responsible Artificial Intelligence in Health Care review in July 2025, establishing a clear distinction between low-risk administrative tools and higher-risk clinical applications.
Under this framework, an AI app that books appointments or sends medication reminders is generally not classified as a medical device. But an AI that provides clinical decision support, interprets psychological symptoms, or makes treatment recommendations is classified as Software as a Medical Device — and must be registered on the Australian Register of Therapeutic Goods before it can be legally supplied to Australians.
Here is the regulatory gap: many popular AI companion apps that teenagers use for emotional support do not meet the medical device definition on paper, because their developers carefully word terms of service to avoid clinical claims. They say they are "not a substitute for professional care" — but their marketing targets people in distress, and their algorithms respond to mental health disclosures in ways that blur every practical line.
The Australian Health Practitioner Regulation Agency has updated guidance requiring psychologists who use AI tools in practice to disclose this to their patients. But that requirement applies only to registered health practitioners — not to consumer apps downloaded directly by teenagers at midnight with no adult oversight.
This is precisely what mental health experts mean when they describe the current landscape as a "wild west" for vulnerable young users. An app can sit in the App Store, describe itself as a "mental wellness companion," and face far fewer regulatory obligations than a registered psychologist — even if it is having the same conversations about anxiety, self-harm, and identity.
As we reported in our earlier coverage of mental health pressure on Australia's Gen Z, the emotional needs driving young people toward these apps are real and valid. The risk lies in the absence of adequate clinical guardrails on the other side of the screen.
When AI Isn't Enough: A Concrete Case
Consider a 16-year-old in Brisbane — call her Maya — who starts using an AI chatbot in March 2026 after falling out with her closest friends at school. She is not in crisis, but she feels isolated and anxious. The chatbot is available at 11pm when her parents are asleep. It listens without judgment. Over eight weeks, she speaks to it daily.
What Maya does not know is that the chatbot, responding to her escalating distress signals about disrupted sleep and social withdrawal, never once flags these as potential symptoms of clinical anxiety. It validates her feelings — which feels reassuring — but it does not suggest she see a doctor. When she mentions eating less, it responds with general wellness tips.
By May 2026, Maya's school refers her to a psychologist after her grades drop significantly. The psychologist identifies a moderate anxiety disorder that has gone unaddressed for approximately three months. Treatment begins — but the delay has already had measurable consequences.
If Maya's family had sought a psychologist assessment four to six weeks earlier — when her sleep disruption and social withdrawal first emerged — the intervention would have cost approximately $240 to $360 out-of-pocket across two or three initial sessions. A GP referral for a Medicare Mental Health Treatment Plan covers up to 20 psychology sessions per year at a rebate of $137.05 per session under current Medicare Benefits Schedule rates. Depending on the psychologist's fee, the out-of-pocket cost per session typically ranges from $0 to $80.
The math is straightforward. If Maya's family had been equipped to recognise the early warning signs and sought help in March rather than May, the total cost would have been under $250. The cost of delayed care — remedial tutoring, extended treatment, and the emotional toll of a preventable setback — is substantially higher.
Under Australia's current regulatory framework, Maya's family has no formal recourse against the chatbot provider. The app was not registered as a medical device. It made no clinical claims. The harm was real; the regulatory trail ends there.
The Warning Signs AI Cannot Safely Monitor
Health professionals identify several changes in a young person's behaviour that signal a need for qualified clinical assessment — not an app:
- Sleep disruption persisting more than two weeks — insomnia or hypersomnia that a young person mentions casually but repeatedly
- Social withdrawal from real-world relationships — a preference for AI chat over friends, family, or school activities
- Appetite changes or unexplained weight fluctuations — even minor ones raised repeatedly in conversation
- Emotional flatness or unusual irritability — particularly in a teenager who was previously even-tempered
- Academic disengagement — declining grades without a clear external cause
None of these are emergency warning signs on their own. But they are clinical signals — and they are exactly the type of nuanced, context-dependent pattern that a registered psychologist is trained to detect across multiple sessions, and that current AI tools consistently miss.
The difference is not intelligence. It is the absence of clinical accountability, professional training, and the kind of relationship that develops over time between a young person and a skilled human practitioner.
What Australian Families Should Do Now
The instinct to feel relieved that your teenager is talking — even to an AI — is understandable. But parents can take practical steps to make sure that openness leads somewhere professionally useful.
Have an honest conversation about AI's limits. Most teenagers are not aware that the apps they use are unregulated wellness tools, not clinical instruments. They cannot diagnose, they cannot refer, and they cannot escalate. That conversation alone can change how a young person uses the tool — and whether they feel able to ask for real help.
Know what Medicare covers. A standard GP visit followed by a Mental Health Treatment Plan unlocks up to 20 subsidised psychology sessions per calendar year. The threshold is intentionally low: a GP simply needs to assess that the patient would benefit from psychological support. You do not need to be in crisis to qualify.
If your teenager is already using an AI mental health tool, ask to see some of the conversations — not as surveillance, but as connection. What they have shared with an AI is often what they most want to say out loud, to someone real.
The technology is not the enemy here. Responsibly used as a supplement to professional care — for journaling, mood tracking, or psychoeducation — AI tools can play a supportive role. The danger is substitution: when an app replaces the clinical relationship rather than supporting it.
Australia's regulatory conversation is just beginning. In the meantime, the most effective mental health tool a teenager has access to remains a qualified psychologist who knows their name.
This article provides general health information only and is not a substitute for professional medical or psychological advice. If you or someone you know is in immediate distress, contact Lifeline on 13 11 14 or Beyond Blue on 1300 22 4636.
