China Proposes New Regulations for AI Emotional Interaction Services

The National Cyber Administration of China has introduced draft regulations aimed at enhancing oversight of artificial intelligence services that simulate human emotional interactions. Released for public comment on October 7, 2023, these regulations require AI providers to assess users’ emotional states and caution against excessive use, marking a significant move to promote responsible AI deployment.

Strengthening Oversight of AI Services

The proposed rules specifically target AI products and services available to the public that exhibit human-like traits in personality, thought, and communication. These AI systems engage users through various means, including text, images, audio, and video. The initiative reflects Beijing’s commitment to shaping the rapid development of consumer-facing AI technologies by imposing stringent safety and ethical guidelines.

Under these regulations, service providers will be accountable for ensuring user safety throughout the entire lifecycle of the product. They must establish robust systems for algorithm review, data security, and the protection of personal information. Additionally, the draft emphasizes the need for intervention when users demonstrate signs of addiction or extreme emotional states.

Addressing Psychological Risks

The draft regulations also aim to mitigate potential psychological risks associated with emotional interaction AI. Providers will be expected to identify and assess users’ emotional states, as well as their level of dependence on the service. In instances where users exhibit severe emotional responses or addictive behavior, providers are mandated to take appropriate measures to intervene.

Furthermore, the regulations set clear boundaries regarding content and user conduct. Services must refrain from generating material that endangers national security, spreads misinformation, or promotes violence and obscenity. This comprehensive approach signals China’s intent to create a safer environment for users engaging with AI technologies while ensuring that these innovations align with societal values.

The introduction of these regulations highlights the increasing focus on ethical considerations in the rapidly evolving AI landscape. As AI continues to play a more prominent role in everyday life, the need for responsible oversight becomes ever more crucial.