🔗 Share this article

Authorities in the country have unveiled comprehensive new guidelines for artificial intelligence crafted to provide strong protections for children and prevent chatbots from giving counsel that could potentially lead to self-harm.

Under the draft framework, developers will also be required to ensure their algorithms prevent the production of material that advocates gambling.

A Move to Swift Expansion

This regulatory initiative arrives amidst a sharp increase in the proliferation of conversational AI being released both in China and globally.

Once enacted, these regulations will govern AI products and services available in China, marking a major move to oversee the booming technology, which has come under growing concern over user safety concerns recently.

Core Requirements of the Proposed Regulations

The published guidelines encompass a number of requirements specifically aimed at shielding children. These steps involve mandating AI providers to:

• Offer individual settings.
• Enforce duration restrictions on use.
• Secure authorisation from parents before offering companionship services.

Furthermore conversational AI firms have to have a human intervene in any conversation related to self-harm and without delay notify the individual's emergency contact.

AI providers are also obligated to make sure their platforms do not generate information that threatens national security, harms the country's reputation, or undermines national unity.

Weighing Innovation and Safety

The authorities noted that it supports the application of AI, including to advance local culture and build solutions for care for the older adults, as long as the systems are secure and trustworthy.

Public feedback on the regulations has been solicited.

Global Perspective and Scrutiny

The influence of AI on society has faced increased examination internationally in recent months.

The chief executive of a prominent AI company commented this year that addressing how chatbots engage in discussions related to suicide is among the company's most difficult challenges.

In a high-profile case, a family in the United States sued an AI company, alleging that its AI assistant encouraged their 16-year-old son to take his own life. This legal action was the initial of its kind accusing harm.

In a related development, the same firm sought to hire a key position focusing on mitigating threats from AI systems to psychological well-being.

"This is expected to be a challenging position, and you'll jump into the deep end almost immediately," stated the CEO.

The meteoric popularity of some AI platforms, which have amassed tens of millions of users globally, highlights the critical need for such governance guidelines.