AI Sex Toys Infiltrate Children's Toys: An Alarming Report

Adult Technologies in Children's Toys

A recent report from the PIRG Education Fund highlights an unexpected issue in the children's toy industry. It reveals that artificial intelligence technologies, originally designed for adult use, are being integrated into products intended for younger audiences. These AIs, similar to those used in connected sex toys and relational chatbots, are present in educational toys that promise an interactive and educational experience.

Modern toys, such as talking dolls and educational robots, incorporate AI chatbots capable of conversing in natural language. These devices are designed to answer children's questions and tell stories, creating an illusion of human conversation. However, the report emphasizes that these systems are not always suitable for children, as they rely on models designed for adults. While these technologies are innovative, they do not always properly filter interactions with a minor audience, which can pose problems.

Risks of Inappropriate Interactions

The generative AI models used in these toys function by statistically assembling words. This can lead to inaccurate or inappropriate responses for a young audience. Children, often trusting the information provided by their toys, may be misled by incorrect or unsuitable answers. The report highlights that some AI toys can generate confusing or age-inappropriate responses, which can have significant consequences.

Unlike a search engine, these systems create the illusion of a genuine conversation, which enhances their influence on children. This situation particularly concerns researchers, as young children have a harder time discerning reliable information from AI-generated responses. AI becomes a sort of pseudo-companion, reinforcing the influence of its answers. For a six-year-old talking to their favorite robot, the consequences of an inappropriate response can be vastly different from those for an adult.

Data Collection Issues

Another concerning aspect is the collection of personal data. AI toys often operate via the cloud, sending children's voices to external servers for analysis. This raises questions about the management and protection of this data. In some cases, these systems may record voice commands, conversations, or other personal information. What happens to this data, and how is it protected?

Manufacturers' privacy policies often lack clarity, leaving parents responsible for potential consequences. The PIRG report calls for greater transparency and stricter standards to protect children. Privacy advocates point to a lack of transparency, and some manufacturers even specify that AI responses may be inaccurate or inappropriate, thereby implicitly shifting responsibility to parents.

Towards a Revision of Regulations

Current laws, such as COPPA in the United States, do not adequately cover these new technologies. Consumer protection associations are calling for an update to regulatory frameworks to impose more rigorous standards. This would include content filtering, transparency regarding data collection, and the development of AI specifically designed for children.

The full report from PIRG details these gray areas and the limitations of current protections. It also shows that many companies recycle existing technologies rather than developing AIs specifically designed for children. Current regulations poorly cover new uses, and authorities will need to review their regulatory frameworks to better protect children. The goal would not be to ban smart toys but to impose stricter standards to ensure the safety and privacy of young users.