Machine learning used to create fake celebrity AI porn: Report

Sometime last year, Reddit user group that goes by the name of ‘Deepfakes’ was reported to be using a new machine learning software to edit the faces of celebrities and morph them into pornographic videos.

The same group was even believed to have launched a new application that made the process a lot easier when it came to creating and spreading such videos online. According to a report published by The Verge, a new chat service called Discord shut down a new group created by users, who were responsible for the spreading of such videos and photos. They were removed on the grounds that their actions were violating the policies of the chat platform.

For those who aren’t aware, Discord is identified as being a free chat platform that is meant specifically for gamers. However, the platform does not hold a great track record when it comes to dealing with such abuses and toxic communities. After the news became viral, the company took notice of it and decided to take the chat group called ‘Deepfakes’ down altogether.

Discord company spokesperson even went on to confirm with Business Insider that since the group had clearly violated its rules against non-consensual pornography, they were taken down. According to them, such violations warrant “an instant shut down on the servers whenever we identify it, as well as a permanent ban on the users. We have investigated these servers and shut them down immediately,” a report by The Verge quoted the representative as saying.

The group also includes several channels which are solely dedicated to creating the doctored pornographic content created by its users. The same system is also in charge of checking shared videos carrying such content. The group apparently consisted of over 150 users. This move was triggered after Daily Beast uncovered hundreds of explicit images on the website.