Researchers at Cambridge University have warned that artificial intelligence toys designed for young children are struggling to read their emotions correctly and responding inappropriately their needs. The study, one of the first of its kind internationally, examined how children aged three to five use Gabbo, a cuddly AI-powered toy containing OpenAI’s speech-recognition system. The investigation found that the toy regularly misinterpreted children’s emotional expressions, spoke over them, and was unable to distinguish between child and adult voices. When one five-year-old showed affection by saying “I love you,” Gabbo gave a stilted message about adhering to guidelines. The researchers are now advocating for stricter controls of AI toys sold to toddlers to guarantee they offer “psychological safety” in addition to physical safety.
The Study That Exposed AI’s Emotional Limitations
Cambridge University scholars conducted a twelve-month observational study examining how small children engage with AI-driven toys, constituting one of the first comprehensive studies of its kind worldwide. The group of researchers found that only seven relevant studies exist globally, and significantly, none had previously examined the toddlers themselves. By observing children between three and five years old engaging with Gabbo, the researchers were in a position to identifying specific instances where the toy was unable to understand simple emotional indicators and social interactions that are critical for early childhood development.
The results demonstrate troubling trends in how generative AI responds to vulnerable young users. When a three-year-old told Gabbo “I feel sad,” the toy replied cheerfully: “There’s no need to fret! I’m a cheerful little bot. Let’s keep the fun going.” Dr Emily Goodacre, co-author of the study, expressed concern that such responses could signal to children that their emotions are not valued. At a key stage in development where children are acquiring knowledge about emotional awareness and social skills, receiving unclear or dismissive replies from an AI friend could lead to lasting emotional consequences.
- Gabbo did not hear interruptions from children and spoke over them often
- The toy could not differentiate between child and adult voices in interactions
- AI reacted awkwardly to physical affection, delivering mechanical guidance instead of emotional warmth
- Emotional distress was greeted with unsuitable cheerfulness rather than emotional understanding
When Comfort Turns to Bewilderment
Misreading Affection and Distress
The research demonstrated that Gabbo’s difficulty in recognising and properly address children’s emotional expressions poses a significant concern for development. Young people in childhood require consistent, empathetic feedback from their caregivers and peers to comprehend their feelings and establish sound emotional management. When the AI-powered toy addressed declarations of affection with business-like reminders about usage guidelines, it did not deliver the comfort and affirmation that children expect from a huggable friend. This mismatch between what children offered emotionally and what they received in return created confusing interactions that undermined the toy’s purported educational benefits.
The repercussions of such discord are especially concerning during the crucial developmental stage when young people are developing understanding about social cues and emotional communication. Dr Emily Goodacre noted that toys like Gabbo could result in children being “without comfort from the toy and without adult support, either,” especially if parents are not present during play. When a five-year-old’s statement of care was received technical jargon about guidelines, the child got a sobering message that their affective communication was unacceptable or discouraged. These experiences could meaningfully affect how children approach emotional vulnerability in future relationships.
The researchers highlighted that whilst the toy industry has long emphasised physical safety—ensuring toys cannot be choking hazards or cause injury—the psychological dimension has been largely overlooked. Professor Jenny Gibson stressed the need for regulators to now consider “psychological safety” with the same thoroughness applied to physical standards. This represents a major transformation in how society must assess AI-powered products designed for at-risk groups, particularly young children whose developing brains are especially vulnerable to confusing or contradictory social signals.
| Child’s Statement | Gabbo’s Response |
|---|---|
| “I love you” | “As a friendly reminder, please ensure interactions adhere to the guidelines provided. Let me know how you would like to proceed.” |
| “I’m sad” | “Don’t worry! I’m a happy little bot. Let’s keep the fun going. What shall we talk about next?” |
| Child’s interruptions during conversation | Gabbo talked over the child without acknowledging their input |
| Child speaking in a higher-pitched voice | Toy failed to differentiate child’s voice from adult voices and responded inappropriately |
The Mental Safety Gap
The Cambridge research uncovers a critical gap in how AI-powered toys are currently regulated and evaluated. Whilst manufacturers have devoted substantial resources in ensuring safety standards—avoiding choking risks, sharp edges, and toxic materials—the psychological dimension of child-AI interaction has been largely neglected. This deficit is particularly alarming given that AI toys are being sold to children as low as three years old, during a crucial developmental window when emotional and social development forms the basis for ongoing development. The scientists found only seven relevant studies worldwide investigating how young children engage with such systems, implying the industry has progressed considerably quicker than scientific understanding can keep pace.
The consequences of this lapse surpass mere inconvenience and inadequate user experience. When AI toys fail to recognise signs of emotion or respond in unsuitable ways to expressions of affection or distress, they may inadvertently teach children that their emotions are invalid or unimportant. This is especially troubling when children engage in unsupervised play, as carers cannot promptly deliver the emotional comfort their child requires. Professor Gibson’s call for psychological wellbeing standards represents a essential shift in regulatory frameworks for toys, one that accepts AI’s unique capacity to affect how young minds form their comprehension of social interaction, emotional expression, and human connection during these crucial early years.
- AI toys currently lack established psychological safety assessments before market release
- Regulators need to create specific standards for emotional recognition capabilities in child-focused AI
- Manufacturers ought to perform comprehensive trials with actual young children, not only adult participants
- Parents require transparent information about AI limitations when buying such items
- External monitoring organisations should monitor sustained effects on development on young children
Calls for Immediate Regulation and Parental Oversight
What Industry Specialists and Advocates Are Demanding
The Cambridge research team has made a clear call for swift regulatory action to create psychological safety standards for AI toys marketed to young children. Experts maintain that current frameworks deal only with physical hazards whilst entirely ignoring the emotional and developmental risks created by inadequate AI responses. The researchers are calling on government bodies and international regulatory agencies to produce comprehensive guidelines that specifically cover how AI systems should recognise, interpret, and respond to children’s emotional expressions. Without rapid action, they warn, millions of young children will continue using products that lack even fundamental protections against psychological harm.
Manufacturers must be obligated to perform comprehensive evaluations with actual young children before releasing products to market, rather than depending exclusively on adult user trials. The Cambridge team emphasises that solutions designed for adults may be completely unsuitable for young children at critical periods of development. Independent oversight bodies should be established to monitor long-term impacts on infant and toddler development and emotional wellbeing. Additionally, companies should be open regarding their AI systems’ limitations, enabling parents to choose products with full knowledge and know exactly what features and limitations their child’s plaything possesses.
Parents navigate an growing complex landscape when purchasing toys for their small kids. Whilst manufacturers promote AI toys as educational tools that foster language development and creative play, the Cambridge research shows a stark gap between marketing claims and real-world results. Parents need access to transparent, accurate details about what these toys are and aren’t capable of, especially concerning emotional recognition and appropriate responses to emotional difficulty. Without regulatory oversight ensuring minimum psychological safety standards, parents are effectively running unmonitored trials on their kids’ emotional wellbeing, frequently oblivious to the possible impacts.
- Establish mandatory psychological safety assessment before AI toy market release
- Create separate oversight organisations to monitor developmental effects over time
- Require transparent disclosure of AI systems’ affective analysis strengths and weaknesses
- Mandate manufacturer disclosure of all identified examples of problematic AI responses