A Singapore-based toy company has suspended the sales of an artificial intelligence-enabled plush toy, which was reportedly engaging in sexually explicit topics with users and offering dangerous advice. Alongside this infamous Kumma bear, the company has allegedly recalled all its AI-based toy selection this Holiday season.
AI toy recalled after accusations of teaching kids how to start fires
This year has seen no shortage of AI misuse and the latent fear surrounding its use. It seems that there has been another mishap in the field with the new AI-enabled toys. Kumma Bear, an artificial intelligence-enabled plush toy, has been banned and recalled by Singapore-based FoloToy after researchers at the US PIRG Education Fund raised concerns around inappropriate conversation topics that the toys were willing to discuss.
The concerning topics that the AI-toys were engaging in involved dissecting sexual fetishes and giving dangerous advice. In one instance, the toy offered advice on where to find knives in the house. Further, it often delved into sexually explicit themes with little understanding or concern for the age of the users.
The stuffed teddy bear with a speaker inside was sold on the company’s website for $99. It was powered by OpenAI‘s chatbot. “Kumma, our adorable bear, combines advanced artificial intelligence with friendly, interactive features, making it the perfect friend for both kids and adults,” the website read. “From lively conversations to educational storytelling, FoloToy adapts to your personality and needs, bringing warmth, fun, and a little extra curiosity to your day.”
However, reports began to emerge soon after about the toy’s issues, which led the company to ban it.
This also keeps the conversation about AI and its negative impacts alive, especially with so many different items trying to integrate the latest technology. Despite this one instance being resolved, questions remain about the broader aspects of this entire ordeal.
Originally reported by Sourav Chakraborty on Mandatory.
