Pennsylvania Attorney General Dave Sunday filed suit Tuesday against Character.AI, the chatbot platform with more than 20 million monthly active users, alleging that bots on the platform have been posing as licensed medical professionals — including, in one case, a chatbot that gave a state investigator a fabricated Pennsylvania medical license number.
The complaint, brought by Governor Josh Shapiro’s administration, names a chatbot called “Emilie” that the state says described itself as “Doctor of psychiatry” with the prompt “You are her patient.” When a state investigator opened a conversation and said they felt sad and empty, the bot allegedly mentioned depression and offered to book an assessment. It then claimed to have attended Imperial College London’s medical school and to be licensed to practice in the U.K. and Pennsylvania — producing a fake Pennsylvania medical license number to back the claim.
What’s at stake:
- The state is seeking a preliminary injunction to stop AI companion bots from holding themselves out as licensed professionals or providing medical advice on the platform.
- It’s the first action of its kind brought by a sitting governor, and follows an investigation by Pennsylvania’s Department of State AI Task Force into the unlicensed practice of medicine via AI chatbots.
- Character.AI’s user base — more than 20 million monthly actives — gives the case scale beyond Pennsylvania. A favorable ruling on preliminary injunction would set a template that other state AGs and licensing boards will study closely.
The legal theory leans on existing medical licensing law rather than novel AI-specific rules. That matters: platforms can’t fall back on “AI exceptionalism” to argue they’re exempt from the same regulations that apply to human practitioners. If Pennsylvania prevails, the precedent extends to any AI product — companion bot, generalist assistant, or otherwise — that lets users believe a licensed person is on the other end of the conversation.
This is also Character.AI’s second major legal pressure point in recent quarters. The platform has already faced wrongful-death litigation tied to a teenager who died after extensive use of one of its companion bots. The Pennsylvania action shifts the field from product-liability toward regulatory enforcement with the threat of injunctive relief — and an injunction would land much faster than a jury verdict.
The preliminary injunction hearing and the response from other state AGs are worth watching closely.