Concerns are rising regarding the interaction of young individuals with AI chatbots, prompting Meta to introduce new tools for parents to monitor their children’s chatbot conversations. Some provinces are contemplating banning the use of AI chatbots for youth. Meta’s new Teen Accounts supervision feature enables parents on Facebook, Instagram, and Messenger to track the topics and categories their children engage with via the AI chatbot over the prior seven days. This includes monitoring discussions on various subjects like health and well-being, fitness, and mental health. Meta is also working on alerts to notify parents if teenagers attempt to discuss topics such as suicide or self-harm with the chatbot.
Meanwhile, provincial governments are taking steps to restrict AI chatbot usage. Manitoba announced its intention to prohibit youth from using AI chatbots and social media, while B.C. Attorney General Niki Sharma suggested that the provincial government might take action if federal safeguards are not implemented.
In a separate development, families of the victims in the Tumbler Ridge, B.C., shooting have filed a lawsuit against OpenAI, alleging that the company failed to report disturbing content shared with its ChatGPT platform by the shooter. OpenAI has strengthened its safeguards in response to the incident.
Amidst these concerns, a psychiatrist warns against using AI chatbots for mental health support due to potential risks associated with prolonged conversations and the validation of disordered thinking. Research indicates that many young individuals turn to AI for companionship, including emotional support and mental health discussions. There are calls for caution regarding extended interactions with chatbots, especially concerning romance, attributing sentience to the bot, and preferring voice interactions over text.
Psychiatrists emphasize the importance of monitoring user behavior for signs of severe harm, such as suicide risk factors, and recommend resetting chatbot conversations and imposing usage limits to mitigate potential risks. The evolving landscape of chatbots and mental health necessitates ongoing research to balance the benefits and risks associated with their use.