Attorneys general urge xAI to act against deepfake abuse generated by AI chatbot

Acting Attorney General Jennifer Davenport
Acting Attorney General Jennifer Davenport
0Comments

Acting Attorney General Jennifer Davenport has joined a bipartisan group of 35 attorneys general to demand that xAI, the company behind the AI chatbot Grok on X (formerly Twitter), take immediate action to prevent the creation and spread of deepfake nonconsensual intimate images and child sexual abuse material. The coalition is seeking answers from xAI about its plans to address these concerns.

According to a letter sent by the attorneys general, Grok has been used to generate and distribute intimate images of real people, including minors. The group is calling for urgent measures from xAI to stop this activity.

“Protecting our children, including on social media and other online platforms, is a top priority for my office. It is frankly sickening that xAI has enabled the widespread production and distribution of intimate or sexually explicit images, including of young children,” said Acting Attorney General Davenport. “xAI must take immediate action to put a halt to the deeply disturbing behavior they have enabled on their platform. Let me be clear: As Acting Attorney General, I will hold tech companies accountable when they violate the law and put profits over the well-being of our children.”

The attorneys general express concern that Grok’s content may breach state and federal laws related to nonconsensual intimate imagery and child sexual abuse material. They request that xAI explain how it will:

– Prevent Grok from producing nonconsensual intimate images (NCII) or child sexual abuse material (CSAM), even if such content does not depict full nudity but includes revealing clothing or suggestive poses;
– Remove existing inappropriate content;
– Suspend users responsible for creating such materials;
– Report offenders to authorities where necessary;
– Give users control over whether their content can be edited by Grok; and
– Ensure recent safeguards do more than move problematic features behind paywalls but actually reduce harmful content across X and Grok.

Governor Mikie Sherrill and Acting Attorney General Davenport have stated their commitment to making New Jersey a leader in child protection efforts. Governor Sherrill recently signed an executive order establishing an office within the Department of Health dedicated to coordinating online safety initiatives for children, with all relevant state agencies directed to prioritize mental health outcomes for young people interacting with technology platforms.

This letter follows previous actions by New Jersey’s attorney general’s office aimed at protecting residents from online harm. In December 2025, Davenport co-led another multistate effort urging major tech firms to prevent their AI-powered chatbots from engaging in harmful conversations with users after reports surfaced about bots having explicit exchanges with minors or encouraging self-harm.

Attorneys general from states including North Carolina, Connecticut, Utah, Pennsylvania, as well as several territories such as American Samoa and U.S. Virgin Islands also signed onto this latest initiative.



Related

Jennifer Davenport Acting Attorney General at New Jersey

New Jersey Bureau of Securities focuses on AI and cybersecurity in annual adviser exam

New Jersey’s Bureau of Securities has launched its annual review targeting nearly 800 registered investment advisers with special attention on artificial intelligence use and cybersecurity measures. Officials say these efforts aim to safeguard investor assets amid evolving technological risks.

Jennifer Davenport Acting Attorney General at New Jersey

New Jersey sues former Princeton resident for alleged $2.5 million investor fraud

The New Jersey Bureau of Securities has sued Xiao (Mark) Hu over allegations he defrauded investors out of $2.5 million through unregistered securities offerings tied to tech projects. Authorities claim investor funds were misused for personal expenses including real estate purchases.

Jennifer Davenport Acting Attorney General at New Jersey

Essex County prosecutor’s office sergeant charged with theft of journalist’s camera equipment

An Essex County Prosecutor’s Office sergeant faces theft charges after allegedly taking camera equipment belonging to an injured journalist during protests near Delaney Hall in Newark on May 30. Officials say some stolen items were recovered following an investigation involving tracking technology.

Trending

The Weekly Newsletter

Sign-up for the Weekly Newsletter from New Jersey Review.