A new investigation reveals that Apple and Google’s app store ecosystems are still being exploited by AI “nudify” apps, despite strict policies against non-consensual explicit content.
|
Concerns rise over AI-generated “nudify” apps appearing in Apple App Store and Google Play systems.
|
Apple and Google are facing renewed scrutiny after a report from the Tech Transparency Project (TTP) found that their search and advertising systems have been surfacing so-called “nudify” AI applications, which generate non-consensual explicit imagery using artificial intelligence.
Despite official policies banning sexual or exploitative content, the investigation suggests that these apps have still managed to appear in search results, autocomplete suggestions, and even paid advertisements across both the App Store and Google Play ecosystem.
AI “Nudify” Apps Bypass Platform Safeguards
The report highlights that users searching for related terms can still encounter multiple apps capable of generating explicit deepfake content. While both companies claim to enforce strict moderation policies, automated discovery systems appear to occasionally surface problematic applications.
More concerning is the role of recommendation algorithms, which in some cases have suggested similar search terms or promoted apps through advertising systems, raising questions about how effectively these platforms enforce their own rules at scale.
According to mobile analytics data cited in the report, the identified apps have collectively reached hundreds of millions of downloads and generated significant revenue, highlighting the scale of the issue.
Growing Concerns Over Safety and Age Ratings
The investigation also found cases where some of these apps were labeled with general audience or minor-friendly ratings, despite their ability to generate explicit content. This has intensified criticism from digital safety advocates and regulators.
Following the report, Apple and Google reportedly began removing several flagged applications from their platforms. Both companies stated that they continue to enforce policies against sexual exploitation and will take action against violations when identified.
Ongoing Challenges in AI App Moderation
Despite enforcement efforts, the fast-moving nature of AI apps makes moderation difficult. New applications can quickly reappear under different names or disguised descriptions, making detection and removal an ongoing challenge for platform operators.
Regulators in multiple regions are now exploring stricter rules targeting AI-generated explicit content, while pressure continues to mount on major tech companies to improve their automated search and advertising safeguards.
As AI tools become more advanced and widely accessible, balancing innovation with user safety remains one of the most complex challenges facing the digital ecosystem.