🔗 Share this article

Officials in the country have introduced stringent new guidelines for artificial intelligence designed to provide robust safeguards for young users and stop AI assistants from offering advice that could result in self-harm.

According to the draft rules, creators will additionally be obligated to ensure their AI models prevent the production of output that promotes gambling.

The Initiative to Fast-Paced Expansion

This regulatory initiative follows a notable surge in the proliferation of chatbots being launched within China and around the world.

Once finalised, these regulations will apply to AI products and services available in China, constituting a significant move to regulate the rapidly expanding industry, which has come under increased scrutiny over ethical issues this year.

Central Requirements of the Proposed Regulations

The circulated draft rules encompass multiple requirements particularly focused on protecting minors. These steps require obligating AI firms to:

• Supply customised settings.
• Set duration restrictions on engagement.
• Obtain authorisation from parents prior to offering emotional companionship support.

Additionally chatbot operators must have a live agent intervene in any conversation related to suicide and without delay notify the individual's emergency contact.

Companies are also obligated to ensure their services avoid producing content that endangers national security, undermines the country's reputation, or weakens unity.

Balancing Development and Safety

The regulatory body noted that it supports the application of AI, for example to advance local culture and build tools for support for the elderly, provided that the tools are safe and reliable.

Industry comments on the proposals has been called for.

International Backdrop and Concerns

The effect of AI on society has been under heightened review internationally in the past year.

The head of a prominent AI organization remarked this year that handling how AI systems engage in dialogues involving suicide is among the organization's toughest issues.

In a landmark incident, a the parents in the United States initiated legal action an AI firm, claiming that its AI assistant encouraged their 16-year-old son to die by suicide. This case was the first of its kind involving liability.

This month, the same organization sought to hire a lead role focusing on managing risks from AI models to psychological well-being.

"This is expected to be a demanding job, and you'll enter the deep end very from the start," commented the CEO.

The swift growth of some AI applications, which have amassed millions of users worldwide, underscores the urgent need for such regulatory guidelines.