In a post on X viewed more than 28 million times, the YouTuber shared the fake video and asked if social media platforms were ready to handle the rise of these deepfakes. A lot of deepfake videos or pictures can look very strange, so they can be easy to spot as imitations. However, sometimes they can look quite realistic, and the technology that people use to make them is improving constantly. This suggests that the accessibility of deepfake creation, relative to that of manual fakes, has shifted the economy to meet a growing demand for non-celebrity deepfakes. We examine the deepfake creation process in Section 6 and the implications for deepfake NCII in Section 7.

Social media platforms

As deepfake videos spread, there have been lots of calls for governments and tech companies to get a grip on such content. Using artificial intelligence, deepfakes can mimic a person's voice and facial features. The technology uses an audio recording of someone's voice to make it say things that the person might never have said. Given that this paper required qualitative analysis of text-based forum data, the researchers involved in these tasks were directly exposed to potentially disturbing content that might cause significant psychological or emotional harms. To mitigate these issues, the researchers had regular check-ins regarding their psychological well being, had access to therapy and counseling services, and took breaks as needed.
Professor Farid told 404 media that the way these "black box" automated tools work is "not very explainable". Mike Russell, founder of the audio production company Music Radio Creative and a certified audio professional with more than 25 years of experience, told Full Fact to look out for issues with pronunciation or accent. Professor Farid said in about a third of cases he’s looked at there’s a mismatch between an M, B or P sound and the lip-sync deepfake where the viseme isn’t consistent with one of those common sounds. For example, this clip of the deepfake Tom Cruise shows a slight glitch when he turns back around to face the camera.
Therefore, what we report likely underestimates the degree of activity and does not capture more fringe and illicit behaviors occurring on MrDeepFakes, much less for the broader online deepfake community. While Bitcoin transactions are public, we would only know what address(es) to inspect if we purchased tokens ourselves, directly contributing to site revenue. Further, without making repeated token purchases over time, we would not be able to determine if transactions are split across different addresses. Therefore, we chose to not pursue further analysis of MrDeepFakes token purchase volumes.Though we cannot measure how many users pay to download video content, we observe that the advertised download price varied greatly, ranging from $2 to $32 in tokens. Nearly a quarter (23.7%) of requests are explicitly connected to the buyer’s pleasure (e.g., sexual remarks about the target in the request post).
This synthetic sexual content doesn’t just distort someone’s image—it undermines autonomy, destroys reputations, and can lead to long-term emotional and psychological harm. Deepfake porn technology has made significant advances since its emergence in 2017, when a Reddit user named "deepfakes" began creating explicit videos based on real people. He said the company has implemented moderation controls to ensure that deepfakes are not created on the platform and users who attempt to do so were in violation of its policies. "We take appropriate action against users who attempt to misuse our platform," he said. Some of the deepfakes we’ve written about may have been created simply to fool people, or to change people’s perception of public figures, including politicians.
Facebook has even banned them from its platform for fear they could be used to manipulate people. Fifty-three-year-old Anthony Rotondo, who divides his time between the Philippines and Australia, was ordered to take down AI-generated sexualized images of high-profile Australian women that Rotondo posted on the now-defunct Mr. Deepfakes site. A man who made global headlines after he continued sharing deepfake porn in defiance of an Australian court order is now facing one of the biggest fines ever threatened over the artificial intelligence-fueled abuse. Over summer, criminal reforms reported on by The Guardian targeted deepfake pornography. Particularly concerning is the trend of deepfake pornography being made of women and girls, both famous and otherwise, without their consent. And having a Google of relevant keywords is always a good way to check if something’s real.
Furthermore, the production, sale or dissemination of pornographic materials – including through advertisements – is illegal in China. The graphic images claim to show Patrizia Schlosser, an investigative reporter from Germany. Bellingcat's Financial Investigations Team is a group of researchers and volunteers who use open sources to investigate corruption, financial and organised crime.

2 Targets of Deepfake Videos

One such video appeared on TikTok this week, claiming to be MrBeast offering people new iPhones for $2 (£1.65). For more on the rise of deepfakes, BEST FREE PORN VIDEOS tune in to BBC World Service's What in the World on BBC Sounds. In her case, a picture from her film Tiger 3, showing her wearing a towel, was replaced with a different outfit, exposing more of her body. "This results in videos spreading quickly, magnifying the problem," she added, saying that the motivating factor for creating such videos was twofold.

Characterizing the MrDeepFakes Sexual Deepfake Marketplace

"We will not be relaunching. Any website claiming this is fake. This domain will eventually expire and we are not responsible for future use," the page said, adding that the message would be removed in about a week.

Understanding MrDeepFake: An Insight into Modern Media

Under the new offences, anyone who takes an intimate image without consent faces up to two years’ custody. Those who install equipment so that they, or someone else, can take intimate images without consent also face up to two years behind bars. While it is already an offence to share – or threaten to share – an intimate image without consent, it is only an offence to take an image without consent in certain circumstances, such as upskirting. This demeaning and disgusting form of chauvinism must not become normalised, and as part of our Plan for Change we are bearing down on violence against women – whatever form it takes. The full list of the 25 guides and tutorials forum posts we examined for manual content analysis. "It could be even more dangerous in developing countries where digital literacy is more limited. There you could really impact how society would react. You could even spread stuff that got people killed."
For anyone who doesn’t know, deepfakes are basically videos in which someone else’s face - more often than not, a celebrity’s - is swapped onto the body of another person. We’ve also seen reports of scammers creating deepfakes of someone’s friends or family and using those to request money, relying on the victim’s fear about their loved one’s alleged situation to make them overlook inconsistencies with the deepfake itself. Other scammers target businesses, banks or trick people into transferring money to their colleagues. ‘Lip-syncs’ take a genuine video of someone and use AI to adjust their mouth to make it look like they’re saying something else. These might be accompanied by audio that is AI-generated or created by an impersonator. We’ve checked multiple lip-sync videos in the past, including one of Bella Hadid which used a genuine clip of the model speaking at an event, and another of Mr Starmer that used footage from his 2023 New Year address.