China proposes new cyberbullying law to combat AI-generated abuse

China’s ongoing legislative and regulatory push to tackle online abuse has increasingly integrated measures targeting AI-enabled harassment, deepfakes, and automated abuse.

The country's cyberspace regulator on Wednesday released a draft law aimed at curbing cyberbullying, including AI-enabled abuse, as Beijing tightens oversight of online bullying in the world's largest internet community.

The proposed law would apply to cyberbullying activities carried out within China, as well as to organizations and individuals overseas that target the country.

Online platforms would be required to verify the real identities of users before allowing them to post information or use instant messaging services.

The proposed rules ask platforms to trace and report the risk of cyberbullying content generated or spread using AI technology, remove and block such content, and report it to authorities.

The draft further requires schools and other educational institutions to include anti-cyberbullying education in their curricula. 

The regulator is seeking public feedback on the proposed legislation until August 28.

The rules also address AI-driven psychological harm, verbal abuse, and emotional manipulation, with additional protections for minors and vulnerable groups.

China’s Supreme People's Court, Supreme People's Procuratorate, and Ministry of Public Security explicitly penalize the use of generative AI technologies to fabricate or disseminate illegal information, insults, defamation, and sexually explicit or manipulative content targeting individuals.

Under the new proposed law, accountability regulators place direct responsibility on tech platforms and AI service providers, focusing on classification rules for online environments.

The new proposal has introduced criminal liability for malicious actors. Individuals who utilize automated tools, "troll armies," or AI-generated manipulation to orchestrate coordinated reputation attacks, doxxing, or harassment campaigns face severe legal repercussions, ranging from administrative restrictions and social media bans to criminal prosecution.

Upon violation, companies can face severe administrative penalties, fines, service suspensions, or criminal liability if they fail to implement robust risk management, moderation, and emergency intervention mechanisms to block AI-facilitated cyberbullying and harassment.

As reported, Online service providers could face fines of up to 10 million yuan ($1.5 million), the shutdown of their websites or applications, or the revocation of business licenses, according to the draft.

This comes as China is facing a surge in digital harassment and online abuse, the Cyberspace Administration of China has released a draft cyberbullying law designed to hold tech platforms directly accountable for AI-enabled harassment, deepfakes, and synthetic digital abuse