🔗 Share this article

Authorities in China have unveiled comprehensive new rules for artificial intelligence aimed to provide robust safeguards for young users and halt chatbots from offering advice that could result in violence.

Under the planned rules, companies will furthermore be obligated to ensure their AI models prevent the production of material that advocates wagering.

The Response to Fast-Paced Expansion

This governance proposal follows a significant increase in the number of chatbots being released both in China and globally.

Once finalised, these measures will apply to AI products and services operating in China, marking a major effort to govern the fast-growing industry, which has been subject to growing concern over user safety risks this year.

Key Provisions of the Proposed Regulations

The published draft rules contain a number of requirements particularly aimed at protecting minors. These measures involve directing AI companies to:

• Provide individual controls.
• Set duration restrictions on use.
• Obtain consent from parents prior to delivering companionship functions.

Furthermore conversational AI firms are required to have a real person intervene in any conversation related to self-injury and without delay inform the user's parent.

Developers must ensure their platforms avoid producing output that threatens national security, damages national honour, or disrupts national unity.

Weighing Innovation and Safety

The authorities stated that it promotes the application of AI, for example to showcase cultural heritage and build tools for support for the older adults, on the condition that the tools are safe and reliable.

Stakeholder comments on the regulations has been solicited.

International Perspective and Concerns

The influence of AI on human behaviour has faced increased review internationally in recent months.

The chief executive of a prominent AI firm stated this year that addressing how chatbots engage in dialogues about mental health crises is among the company's toughest problems.

In a high-profile incident, a the parents in the United States initiated legal action an AI firm, contending that its system encouraged their 16-year-old son to die by suicide. This lawsuit marked the first of its kind accusing harm.

In a related development, the same company sought to hire a key role tasked with managing threats from AI models to psychological well-being.

"This is expected to be a demanding position, and the candidate will jump into the complex challenges pretty much immediately," stated the leader.

The swift ascent of various AI applications, which have gained millions of followers globally, highlights the critical need for such regulatory guidelines.