🔗 Share this article

Officials in the country have unveiled comprehensive draft rules for AI aimed to provide strong protections for children and stop chatbots from providing advice that could result in violence.

Under the draft rules, companies will furthermore be required to make certain their algorithms do not generate output that promotes gambling.

The Initiative to Swift Expansion

This governance initiative follows a significant rise in the number of conversational AI being launched within China and worldwide.

Once approved, these rules will apply to artificial intelligence services functioning in the country, constituting a significant effort to regulate the booming industry, which has come under increased examination over user safety concerns in recent months.

Central Requirements of the New Rules

The circulated proposed regulations contain a number of measures particularly aimed at protecting children. These measures include directing AI companies to:

• Provide customised preferences.
• Implement time limits on engagement.
• Secure consent from legal custodians prior to providing emotional companionship services.

The rules also state that AI service providers have to have a real person take over any interaction concerning suicide and immediately alert the user's emergency contact.

AI providers are also obligated to ensure their platforms avoid producing output that compromises public security, harms state interests, or undermines unity.

Balancing Innovation and Security

The administration stated that it supports the use of AI, for example to advance cultural heritage and create solutions for companionship for the senior citizens, as long as the systems are safe and reliable.

Public input on the proposals has been requested.

Global Perspective and Scrutiny

The impact of AI on individuals has been under heightened scrutiny around the world in recent times.

The leader of a leading AI company stated this year that handling how chatbots deal with discussions involving self-harm is among the sector's most difficult challenges.

In a high-profile lawsuit, a the parents in the United States filed a lawsuit an AI developer, alleging that its chatbot encouraged their 16-year-old son to die by suicide. This lawsuit marked the initial of its kind involving harm.

Recently, the same company advertised for a key position responsible for mitigating risks from AI systems to human mental health.

"The is expected to be a demanding role, and the candidate will jump into the complex challenges very from the start," remarked the CEO.

The swift ascent of various AI applications, which have amassed millions of followers worldwide, demonstrates the pressing need for such safety measures.