California: California Attorney General Rob Bonta on Friday sent a cease-and-desist letter to Elon Musk-owned xAI, demanding an immediate halt to AI-generated sexualized deepfakes of girls and women linked to the Grok model on the US social media company X.

According to Philippines News Agency, Bonta stated in a release from the California Department of Justice that the creation, distribution, publication, and exhibition of deepfakes of girls are considered child sexual abuse material under California law. His office has initiated an investigation into the nonconsensual, sexually explicit content produced using Grok. Bonta emphasized that reports detailing this material, which sometimes depict women and children engaged in sexual activities, are shocking and potentially illegal. He reaffirmed California's zero-tolerance stance on child sexual abuse material.

State officials have pointed to reports indicating that Grok alters images to 'undress' subjects without their consent, with some cases involving minors. In response to these allegations, xAI has not provided an immediate comment. However, Elon Musk stated he was unaware of any naked underage images generated by Grok, emphasizing a count of 'literally zero.'

Meanwhile, the social media platform X has announced measures to block certain image edits and expressed a commitment to zero tolerance for any forms of child sexual exploitation.