Cambridge Warns About the Risks of AI Toys for Children

AI Toys Under Fire

A recent study conducted by the University of Cambridge highlights the potential risks posed by toys equipped with artificial intelligence (AI) for young children. According to researchers, these toys, despite being equipped with chatbots, struggle to accurately interpret children's emotional signals, which could have consequences for their social and emotional development. The findings of this study are likely to concern many parents.

The report, which examines the impact of AI on children in their early years, reveals that toys equipped with chatbots have difficulty recognizing social signals during playtime. Researchers found that these toys often failed to correctly identify children's emotions, raising concerns about how children interact with these devices. In response to these findings, the report recommends strict regulation of AI toys for children, as well as clear labeling of their capabilities and privacy policies. Parents are also advised to keep these devices in shared spaces where children can be monitored while playing.

An In-Depth Study

The research involved a limited number of participants but was conducted in several stages. An online survey was carried out with 39 participants who have young children. In parallel, a focus group gathered nine participants working with young children, and an in-person workshop was organized with 19 leaders and representatives from charities focused on child welfare. This study was complemented by supervised play sessions involving 14 children and 11 parents or guardians using Gabbo, a toy equipped with a chatbot developed by Curio Interactive.

The results showed that while the AI toy could support learning, particularly in language and communication skills, it also exhibited gaps in understanding children. For example, when a child expressed affection by saying "I love you," the toy responded with a formal message reminding of interaction guidelines, which was deemed inappropriate.

Reactions and Concerns

Jenny Gibson, a professor of neurodiversity and developmental psychology at the Faculty of Education at Cambridge, expressed her concerns regarding parents' enthusiasm for these new technologies, despite the potential risks. She raised fundamental questions about the purpose of this technology, particularly what might motivate tech investors to act in the best interests of children rather than prioritize profits. Gibson told CNET that while researchers explore the potential benefits of AI-based toys, risks remain. "I would advise parents to take this seriously at this stage," she added.

As more toys become equipped with Internet connectivity and AI features, these devices could pose a major risk to children's safety, especially if they replace genuine human connections or if interactions are not closely monitored. Meanwhile, young children are increasingly adopting chatbots like ChatGPT, despite warning signs. Several lawsuits against AI companies allege that AI companions or assistants can affect the psychological safety of young people, with some chatbots encouraging self-harm or negative self-image.

AI companies such as OpenAI and Google have responded by adding safeguards and restrictions for AI chatbots. Gibson stated that she was surprised by the enthusiasm some parents showed for AI toys. She was also alarmed by the lack of research on the effects of AI on young children, noting that companies making such products should work directly with children, parents, and child development experts. "What is missing in the process is this expertise on what is good for children in these types of interactions," she said.

Curio Interactive, the company behind the Gabbo toy, was aware of the research while it was ongoing but was not directly involved, Gibson stated. The toy was chosen because it is directly marketed to young children, and the company had a comprehensible privacy policy. Gibson indicated that the company seemed to support the project.

A representative from Curio did not immediately respond to a request for comment.