AI toys may pose safety concerns for children, new study suggests caution

When a child told the toy, “I love you,” it responded, “As a friendly reminder, please ensure interactions follow the guidelines provided. »

A new study from the University of Cambridge has found that AI-based toys aimed at young children can misinterpret emotional cues and are ineffective at supporting critical developmental play. The findings could be concerning for parents.

In a report examining how AI affects children in their early years, a chatbot-enabled toy had difficulty recognizing social cues during playtime. Researchers found that the toy did not effectively identify children’s emotions, raising alarms about how children might interact with it.

The report recommends regulating AI toys for children and requiring clear labeling of their capabilities and privacy policies. He also advises parents to keep these devices in shared spaces where children can be supervised while playing.

The research behind the study involved a limited number of participants, but was carried out in several parts: an online survey of 39 participants with children in their early years, a focus group with nine participants working with young children, and an in-person workshop with 19 leaders and representatives from charities who work with young children. This was followed by supervised playtime with 14 children and 11 parents or guardians with Gabbo, a chatbot-enabled toy from Curio Interactive.

Some findings indicated that the AI ​​toy promoted learning, particularly in language and communication skills. But the toy also misunderstood children and sometimes responded inappropriately to emotional requests.

For example, when a child says to the toy, “I love you,” it responds, “As a friendly reminder, please ensure interactions follow the guidelines provided. Let me know how you would like to proceed,” according to the study.

Jenny Gibson, professor of neurodiversity and developmental psychology at Cambridge’s Faculty of Education, who worked on the study, said that while parents may be excited about the educational benefits of new technologies for children, many concerns remain.

Gibson asked vital questions about the reason behind this technology.

“What would motivate [tech investors] do the right thing by the children… put the children before profits? she said”

Gibson told CNET that even as researchers explore the potential benefits of AI-based toys, risks remain.

“I would advise parents to take this seriously at this point,” she said.

What’s next for AI toys

Like more toys come with internet connectivity and AI capabilitiesthese devices could pose a major risk to children’s safety, especially if they replace real human connections or if interactions are not closely monitored.

Meanwhile, young people are increasingly adopting chatbots like ChatGPT, despite the red flags. Multiple lawsuits against AI companies allege that AI companions or assistants may impact young people’s psychological safety, including some chatbots that have encouraged self-harm or negative self-image.

AI companies such as OpenAI and Google have responded by adding guardrails and restrictions for AI chatbots.

(Disclosure: Ziff Davis, CNET’s parent company, filed a lawsuit in 2025 against OpenAI, alleging that it violated Ziff Davis’ copyrights in the training and operation of its AI systems.)

Gibson said she was surprised by the enthusiasm some parents have shown for AI toys. She also expressed alarm at the lack of research on the effects of AI on young children, emphasizing that companies making such products should work directly with children, parents and child development experts.

“What’s missing in the process is that expertise of what’s good for kids in these kinds of interactions,” she said.

Curio Interactive, the company behind the Gabbo toy, was aware of the research as it was happening but was not directly involved, Gibson said. The toy was chosen because it is marketed directly to young children and the company had an understandable privacy policy. Gibson said the company appeared to support the project.

A representative for Gabbo’s manufacturer, Curio Interactive, said in an email to CNET that it designs its toys with safety first, “ensuring they are free of hazards and built to the highest standards.”

The company said its toys comply with the Children’s Online Privacy Protection Rule, known as COPPA, as well as other children’s privacy laws, and that it works with KidSAFE, a company specializing in digital compliance for children’s technology.

The company added that it uses encryption to protect user data and parents can manage or delete their data through the app.

Exit mobile version