The UK data watchdog has warned that it could close down Snapchat's AI chatbot feature due to potential privacy risks, especially to children.
The Information Commissioner's Office (ICO) has accused the social media app of a "worrying failure" to assess the potential privacy risks the feature poses to its users.
In response, Snapchat said it was "closely reviewing" the provisional findings.
The tool lets users message a computer which mimics human conversation, BBC News reports.
We have issued Snap, Inc and Snap Group Limited with a preliminary enforcement notice over a potential failure to properly assess the privacy risks posed by its generative AI chatbot ‘My AI’.
— ICO - Information Commissioner's Office (@ICOnews) October 6, 2023
Read more about the case: https://t.co/MAuHAH0h8B pic.twitter.com/BawISttPJN
Snapchat describes it as an "evolving feature" which is powered by ChatGPT, an online AI tool which uses new technology to convincingly imitate realistic responses.
The feature launched earlier in 2023.
ICO concerned about privacy risks for teenagers who use Snapchat
Snapchat has 21 million users in the UK, many of whom are children in the 13 to 17-year-old range.
The ICO stressed that findings are “provisional” and conclusions should not yet be drawn.
However, it said that if a final enforcement notice were to be adopted, Snap might not be able to offer the My AI function to UK users until the company carries out “an adequate risk assessment”.
UK Information Commissioner John Edwards said: “The provisional findings of our investigation suggest a worrying failure by Snap to adequately identify and assess the privacy risks to children and other users before launching My AI.
“We have been clear that organisations must consider the risks associated with AI, alongside the benefits.
“Today’s preliminary enforcement notice shows we will take action in order to protect UK consumers’ privacy rights.”
A spokeswoman for Snapchat's parent company Snap said: “In line with our standard approach to product development, My AI went through a robust legal and privacy review process before being made publicly available.
“We will continue to work constructively with the ICO to ensure they’re comfortable with our risk assessment procedures.”
Comments: Our rules
We want our comments to be a lively and valuable part of our community - a place where readers can debate and engage with the most important local issues. The ability to comment on our stories is a privilege, not a right, however, and that privilege may be withdrawn if it is abused or misused.
Please report any comments that break our rules.
Read the rules here