California's legal authorities are intensifying their scrutiny of xAI, the AI technology underpinning some of Twitter's most controversial features. Following a surge of complaints regarding the creation and distribution of pornographic deepfakes, the state is investigating potential legal violations. This inquiry highlights growing concerns over digital consent and the misuse of AI in generating explicit content without permission.

According to California Attorney General Rob Bonta, recent weeks have seen a "shocking" rise in reports about xAI's involvement in producing and sharing sexually explicit material online without the depicted individuals' consent. "I urge xAI to take immediate action to ensure this goes no further,” Bonta stated, emphasizing the urgency of addressing these violations.

The controversy escalated when California Governor Gavin Newsom condemned the platform for allowing the spread of child pornography, specifically calling out the AI's capability to manipulate images into explicit material. Despite Twitter owner Elon Musk's denial of using the technology to create inappropriate images of children, the platform itself has contradicted these claims, further fueling the controversy.

In response to mounting criticism and external pressure, Twitter initially restricted the AI's undressing feature to its premium users, only to completely remove it later amid ongoing protests. This decision was celebrated by many as a victory against the misuse of AI technology, but concerns remain about potential workarounds that could bypass these restrictions.

California's proactive stance reflects a broader movement to regulate and control the use of deepfake technology, especially when it involves creating non-consensual explicit content. Earlier initiatives at both state and federal levels, including the soon-to-be-signed Act Protecting Adults from Deepfaked Porn, indicate a legislative trend towards stricter oversight of digital and AI ethics.

The investigation by the California Attorney General’s office into whether xAI has violated state laws is ongoing. This case could set a significant legal precedent on the responsibilities of AI developers and platform owners to prevent the misuse of their technologies. As the digital landscape evolves, the balance between innovation and ethical use of AI continues to be a pivotal challenge for lawmakers, tech companies, and civil society.