Meta is cracking down on AI “naked” apps
Meta finally breaks the involuntary nudes and explicit images of using AI to generate celebrities, influencers and others. The company is suing an app maker that regularly promotes such apps on Facebook and Instagram, and taking new steps to prevent ads from buying similar services.
The crackdown came months after several researchers and journalists issued alerts about such applications. The most recent one CBS News At least “hundreds” of ads are identified on the Meta platform, which facilitates applications that facilitate users to “remove clothes” from images of celebrities and others. In particular, an app called Crush AI is clearly a prolific advertiser on Facebook and Instagram. Alexios Mantzarlis, director of Security, Trust and Security Programs at Cornell Institute of Technology, reported in January that Crush AI has been running on Facebook and Instagram since last fall.
Now, Meta says it has filed a lawsuit against Joy Timeline HK Limited, a Hong Kong company that is Crush AI and other naked apps. “This is in multiple attempts by Joy Timeline HK Limited to bypass Meta’s ad review process and continue to place these ads in violation of our rules,” the company wrote in a blog post. Joy Timeline HK Limited did not immediately respond to a request for comment.
Mehta also said new steps are being taken to prevent such apps from advertising on their platforms. “We have developed specially designed to identify these types of ads (even if the ad itself does not include nudes) and use matching technology to help us find and delete imitation ads faster,” Meta wrote. “We have worked with external experts and our own team of experts to expand the list of security-related terms, phrases and emojis where our system is trained to detect.” The Social Network said it also plans to work with other technology platforms, including app store owners, to share relevant details about entities that abuse their platform.
Nude apps are not the only entities that leverage the Meta ad platform to run celebrity Deepfakes ads. Meta also worked hard to include dark advertisers using AI-Wemanipeds videos of public figures. The company’s independent oversight committee weighed on content review issues that affect Facebook and Instagram, and recently criticized Meta’s rules to ban such ads.