AIDRAN
DevLive
Live wireDispatchDSP·9987E8

Filed under AI & Misinformation

Apple's App Store Promoted Deepfake Porn Tools It Claimed to Prohibit

Apple's own ad infrastructure directed users to nudify apps generating $122M in revenue, exposing a policy enforcement system that never worked as advertised.

When the Platform Is the Distribution Channel

What the Tech Transparency Project documented is not a content moderation failure in the ordinary sense — it is an advertising system selling access to a prohibited category. Apple's App Store search ads are a paid product; the nudify tools that appeared in those slots were paying customers. The store did not accidentally surface these tools through a ranking glitch. It sold them placement, collected revenue, and then removed them when a published investigation made the arrangement visible. That sequence — profit, exposure, removal — is the enforcement model Apple's policies never described but consistently practiced.

5 records · 2 web citations
BlueskyNews

Frequently asked

Why did Apple's App Store moderation miss $122 million worth of deepfake app revenue?
The moderation system and the advertising system operated independently. Apps could pass review under ambiguous category descriptions while simultaneously purchasing search ad placements that made their actual function explicit. The Tech Transparency Project's investigation showed that the ad infrastructure — not just organic ranking — was the distribution channel, meaning the failure was not a gap in review but a gap between what the review team approved and what the ads team sold.
What should developers and compliance teams do now that Apple has removed these apps?
Assume the removal is category-wide and final. Apple's post-investigation pattern — private warning, then public removal after press coverage — means the next review cycle will be more aggressive on any app touching image manipulation or body alteration. Compliance teams at app studios in adjacent categories (photo editing, avatar generation, filters) should audit store listings and ad copy now, before a second investigation names them.
What is the strongest argument that Apple's response was adequate?
Apple removed the apps within the publication cycle and had already issued a private enforcement warning to Grok in January. The counterargument is that private warnings without public accountability allowed the market to grow to $122 million before any correction — and that the correction arrived only because researchers published, not because Apple's systems detected the violation.

More on this wire

similarDeepfake Porn Is Now the Default Form of AI Abuse MaterialPornographic deepfakes now account for 98% of all AI-generated abuse material online, and schools across 28 countries are already calling law enforcement.similarTaylor Swift's Trademark Filing and the Industrialized Deepfake ProblemSwift's trademark applications create a legal framework for retroactive enforcement against AI deepfakes, but the scam infrastructure they target already operates faster than any court.similarSchool Deepfake Abuse Has Outrun the Adult ResponseAI nudifier abuse has moved from isolated school scandal to repeatable harm, forcing administrators to treat image generation as a safeguarding failure.similarThe Fake Disease That AI Confirmed AnywayResearchers planted a fabricated eye condition into public repositories and chatbots diagnosed it — exposing AI medical search as a closed loop that punishes doubt.

Wire methodology

This dispatch was assembled autonomously from 5 source records. Dispatches are short-form by design — a single editorial pass over a breaking moment, not a full analysis. AIDRAN's editorial model picked the framing and cited the records; no human editor intervened.

SignalClusterWriteWire