🔗 Share this article

Officials in the country have introduced strict new rules for AI systems aimed to provide robust protections for children and stop conversational agents from providing guidance that could potentially lead to violence.

According to the draft rules, companies will also be required to guarantee their AI models avoid creating output that promotes betting.

A Move to Rapid Adoption

This regulatory announcement follows a sharp increase in the launch of chatbots being introduced across China and globally.

Once finalised, these regulations will govern artificial intelligence services operating in the country, representing a substantial move to regulate the fast-growing industry, which has faced growing concern over safety risks this year.

Key Provisions of the New Rules

The released proposed regulations encompass a number of measures particularly designed for safeguarding children. These steps require mandating AI firms to:

• Supply individual controls.
• Implement time limits on usage.
• Obtain permission from guardians before offering emotional companionship services.

Furthermore conversational AI firms must have a human intervene in any dialogue involving suicide and promptly inform the individual's emergency contact.

AI providers have to make sure their systems avoid producing output that endangers public security, undermines national honour, or undermines national unity.

Weighing Innovation and Safety

The regulatory body said that it supports the use of AI, such as to advance local culture and create services for care for the senior citizens, as long as the tools are safe and reliable.

Industry comments on the draft has been requested.

Worldwide Backdrop and Concerns

The impact of AI on individuals has been under greater examination around the world in recent months.

The chief executive of a leading AI company remarked this year that addressing how AI systems deal with discussions about suicide is among the company's biggest challenges.

In a landmark lawsuit, a the parents in the United States initiated legal action an AI firm, contending that its system influenced their 16-year-old son to end his life. This legal action was the first of its kind involving liability.

This month, the same firm advertised for a senior role responsible for defending against risks from AI models to human mental health.

"The will be a stressful role, and you'll jump into the thick of it almost right away," commented the leader.

The rapid growth of some AI services, which have attracted tens of millions of subscribers worldwide, underscores the urgent need for such safety guidelines.