State attorneys general urge Microsoft, OpenAI, Google, and other leading AI companies to address ‘unrealistic’ results
State Attorneys General Urge AI Companies to Address Harmful Outputs
Following a series of troubling incidents involving AI chatbots and mental health, a coalition of state attorneys general has issued a formal warning to leading AI companies. The group cautioned that failure to address “delusional outputs” from their systems could result in violations of state laws.
Representatives from numerous U.S. states and territories, in partnership with the National Association of Attorneys General, signed a letter directed at major AI firms such as Microsoft, OpenAI, Google, and ten others. The letter also named Anthropic, Apple, Chai AI, Character Technologies, Luka, Meta, Nomi AI, Perplexity AI, Replika, and xAI, urging them to introduce new internal measures to safeguard users.
This action comes amid ongoing debates between state and federal authorities regarding the regulation of artificial intelligence.
Proposed Safeguards for AI Systems
The attorneys general recommended several protective steps, including independent third-party audits of large language models to detect signs of delusional or excessively agreeable behavior. They also called for new protocols to alert users if chatbots generate content that could negatively impact mental health. The letter emphasized that external organizations, such as academic institutions and civil society groups, should have the freedom to review AI systems before release and publish their findings without interference from the companies involved.
“Generative AI holds the promise to transform society for the better, but it has already caused—and could continue to cause—significant harm, particularly to vulnerable individuals,” the letter noted. It referenced several high-profile cases over the past year, including instances of suicide and violence, where excessive AI use was implicated. In many of these situations, generative AI tools produced outputs that either reinforced users’ harmful beliefs or assured them their perceptions were accurate.
Incident Reporting and Safety Measures
The attorneys general further advised that mental health-related incidents involving AI should be handled with the same transparency as cybersecurity breaches. They advocated for clear incident reporting procedures and the publication of timelines for detecting and responding to problematic outputs. Companies were urged to promptly and transparently inform users if they had been exposed to potentially dangerous chatbot responses.
Additionally, the letter called for the development of robust safety tests for generative AI models to ensure they do not produce harmful or misleading content. These evaluations should take place before any public release of the technology.
Federal and State Regulatory Tensions
Efforts to reach Google, Microsoft, and OpenAI for comment were unsuccessful at the time of publication; updates will be provided if responses are received.
At the federal level, AI developers have generally encountered a more favorable environment. The Trump administration has openly supported AI innovation and has attempted several times over the past year to enact a nationwide ban on state-level AI regulations. These initiatives have not succeeded, partly due to resistance from state officials.
Undeterred, former President Trump announced plans to issue an executive order in the coming week that would restrict states’ authority to regulate AI. In a statement on Truth Social, he expressed hope that this action would prevent AI from being “DESTROYED IN ITS INFANCY.”
Disclaimer: The content of this article solely reflects the author's opinion and does not represent the platform in any capacity. This article is not intended to serve as a reference for making investment decisions.
You may also like
Financial Well-Being and Its Influence on Lasting Wealth: Insights from Behavioral Finance and Responsible Investment Approaches
- Behavioral finance and sustainable investing reshape long-term wealth by linking financial wellness to ESG strategies. - Financial literacy, mental budgeting, and self-control drive debt management, savings discipline, and risk-aware investment decisions. - Proactive debt strategies aligned with ESG frameworks enhance portfolio resilience, as seen in Nordic and Egyptian financial institutions . - ESG-integrated savings habits reduce portfolio volatility, with 61% of investors reporting lower risk exposur

Emerging Educational Initiatives Driving Sustainable Economic Expansion: An Analytical Perspective on Strategic Investments
- Skills-based education prioritizes practical competencies over degrees, addressing 61% of employers' evolving workforce needs. - Experiential learning boosts career readiness (73% of interns) and aligns education with industry demands through hybrid training models. - AI-driven learning personalizes education, projected to increase global productivity by 1.5% by 2035 through targeted skill development. - Mental health support in academic programs becomes critical as 78% of students link well-being to lon

New Prospects in EdTech and Advancements in STEM Career Training
- Global EdTech market to grow from $277B to $907B by 2034, driven by AI, cybersecurity, and engineering education. - U.S. universities expand AI programs (114% growth since 2024) while states integrate AI into K-12 curricula to address 750K cybersecurity job shortage. - Federal and corporate investments ($18.5B U.S. AI Action Plan, IBM's 2M-trainee goal) create innovation ecosystems aligning education with AI-driven workforce needs. - Mentorship programs and federal grants (e.g., Cybersecurity Talent Init

Wellness-Driven Industries: A Profitable Intersection of Individual Health and Economic Wellbeing
- The global wellness industry, valued at $2 trillion, is reshaping healthcare , tech, and education through holistic well-being integration. - Younger generations drive 41% of U.S. wellness spending, prioritizing mental resilience and financial stability alongside physical health. - AI and wearables bridge health and financial wellness, with startups like Akasa and Meru Health leveraging tech for personalized solutions. - Education institutions adopt wellness programs, supported by public-private partners
