US teenagers are reportedly able to access artificial intelligence (AI) apps that generate nonconsensual nude imagery, despite parental controls on Apple and Google's app stores. A report from the digital advocacy group Tech Transparency Project (TTP) found that researchers, using test accounts set up for 13-year-olds, could download 135 such apps.
The TTP researchers created four test accounts, two for Apple and two for Google, indicating the account holders were 13 years old. They searched for image-editing or face-swapping apps using terms like “AI video generator” or “adult AI”. These accounts allowed them to download apps with features to digitally undress people or swap faces onto nude bodies.
The report states that many of these 'nudify' apps were inaccurately rated as suitable for minors, meaning they could be accessed even when parental controls were active. For example, one face-swapping app, advertised with an image of a woman performing oral sex, was rated appropriate for ages four and up. Researchers were able to subscribe to this app from a 13-year-old's account without a parental alert.
Apple and Google both prohibit these types of apps on their platforms and often age-gate content. However, TTP found that the companies largely rely on developers to determine age appropriateness. Following TTP's contact regarding the findings, Apple implemented changes to strengthen content moderation guidelines, now requiring developers to preemptively prevent and remove nonconsensual intimate imagery, including AI-generated images. Apple also stated it has taken action on apps mentioned in the report.
Google stated it regularly takes proactive steps to detect and remove apps with harmful content. A spokesperson confirmed that when violations are detected or reported, the company investigates and takes swift action, including suspending violating apps and restricting related search terms.