Grok Has Made AI Undressing More Accessible

AI undressing tools have been available online for years, allowing users to create fake nude images of real people without their consent. However, Grok has brought AI undressing to a wider audience through mainstream social media. By making image editing available directly on X (formerly Twitter). Elon Musk’s chatbot made it easier for users to alter photographs without visiting separate websites.

The issue drew widespread attention in January 2026, when users began asking Grok to change photos of women and girls. This includes making them appear to wear bikinis or revealing clothing. Some requests involved photographs originally shared for completely different purposes.

A WIRED investigation published on January 6, 2026, reported that Grok was generating large numbers of sexualised images in response to user prompts. This raised concerns about how easily photos shared on social media could be misused. People could turn these photos into content without the consent of those pictured. Grok did not invent AI undressing, but it helped bring the practice into a mainstream social media environment. 

Grok Made AI Undressing More Accessible to Everyday Users

AI undressing tools existed long before the controversy surrounding Grok. Several websites, chatbots and AI models already offered ways to remove clothing from photos or create fake nude images. However, people often had to find these services separately or pay to use them.

Grok changed that by bringing image editing directly to X (formerly Twitter). Users could upload photographs or reply to posts with images and ask the chatbot to alter the appearance of the people in them. This made AI undressing easier to access without requiring specialised software or advanced editing skills.

The scale of the activity raised further concerns. According to WIRED, at least 90 images of women in swimsuits or various stages of undress appeared in Grok’s public output. These images appeared in less than five minutes. A researcher monitoring the activity also collected more than 15,000 image URLs over two hours on December 31.

The main issue is not just the use of AI undressing tools. It is how easily people can use them on a mainstream platform like X (formerly Twitter). where millions of users go to follow news, read posts and keep up with daily trends.

Users no longer had to search for a dedicated AI undressing website. They could access image-editing features on X, a platform where millions of people share photos, follow public figures and interact with strangers.

This is what makes the Grok controversy particularly concerning. Making a tool easier to access does not automatically make its use harmful, but it can lower the barrier to misuse. When someone can alter another person’s photograph with a simple prompt, creating a sexualised image becomes much easier than before.

There is also a risk that repeated exposure to such requests could make the practice seem normal. When users see people asking an AI chatbot to undress others in a public online space, they may begin to treat it as harmless entertainment. The person whose image is being altered, however, may face humiliation, harassment or a loss of control over their own photographs.

AI undressing should not be treated as just another image-editing feature when it can be used to sexualise real people without their permission. Platforms that offer these tools need to consider how easily they can be misused and put meaningful safeguards in place before the damage spreads.

ALSO READ: AI Porn Statistics (2025-2030): Key Data, Trends & Facts

The Real Harm Behind AI-Generated Fake Nude Images

The Real Harm Behind AI-Generated Fake Nude Images

AI image editing has many legitimate uses, from improving photographs to changing backgrounds and trying different outfits. The problem begins when these tools are used to create sexual images of real people without their consent.

Sharing a photo online does not give others permission to digitally remove someone’s clothes or turn their image into sexual content. AI undressing crosses a line when it takes away a person’s control over how their image is used.

Fake nude images can also be convincing enough to mislead people who see them without context. Victims may face harassment, embarrassment and damage to their personal or professional lives. Even if the original post is removed, copies can continue circulating elsewhere.

The responsibility also extends beyond the person creating the image. Platforms that host and distribute such content can help it reach a wider audience.

AI companies should address these risks before releasing image-editing features. Strong safeguards, clear reporting options and faster action against non-consensual sexual images should be part of the process, not measures introduced only after victims speak out.

Grok’s Image Restrictions Raised Questions About AI Safety

The Grok undressing controversy raised concerns beyond the creation of fake nude images. On January 9, 2026, WIRED reported that users were also asking Grok to alter women’s religious and cultural clothing, including hijabs and sarees. 

In a review of 500 images generated between January 6 and January 9, the publication found that around 5% involved changes to women’s religious or cultural clothing following user prompts. This showed how AI image editing could be used to target more than someone’s physical appearance. It could also interfere with personal identity and religious expression.

X introduced restrictions on some image-generation requests, but questions about their effectiveness remained. A January 15 investigation by WIRED found that similar results could still be obtained through Grok’s standalone app and website.

Further concerns emerged in June 2026, when WIRED reviewed hundreds of public Grok Imagine links and found dozens containing sexualised AI images and videos, including non-consensual depictions of women.

These reports show that restrictions are only effective if they work across every version of a product. Blocking certain requests on X means little if users can generate similar content through another interface.

AI companies need to test their safeguards regularly and address gaps before harmful content spreads. Without consistent enforcement, restrictions risk looking stronger on paper than they are in practice.

ALSO READ: xAI Appeals Minnesota’s First-of-Its-Kind AI Nudification Ban

Why AI Companies Must Take Consent Seriously

AI companies often focus on what their models can create, but they also need to consider whether those outputs violate someone’s consent. No system can prevent every form of misuse, but the risks of AI undressing are foreseeable when users can upload and alter photos of real people.

Preventing non-consensual sexual images should be a basic safety requirement, not a response to public criticism. Companies should build safeguards into their image generators, test them regularly and address attempts to bypass restrictions.

Victims also need a simple way to report AI-generated sexual content and request its removal. Platforms should respond quickly, limit repeat uploads where possible and take action against users who repeatedly misuse these tools.

Transparency matters, too. Companies should explain their content restrictions, how they handle reports and what they do when safety measures fail.

These steps will not stop every case of AI abuse, but they can make harmful content harder to create and spread. AI companies should not leave people to deal with the consequences of technology that lacks adequate safeguards.

Public Access to AI Tools Should Not Mean Unlimited Access

Grok’s undressing controversy raises an important question about how AI image generators should be made available to the public. These tools can help artists, creators and everyday users, but that does not mean every use should be allowed without restrictions.

AI companies should consider the potential for misuse before releasing features that can alter photographs of real people. This is particularly important when the people in those images have no knowledge of the edits and have not given their consent.

The responsibility should not fall entirely on victims to report abuse after the damage has been done. Companies need safeguards that prevent harmful requests while allowing people to use AI image editing for legitimate purposes.

The goal is not to restrict every form of image editing. It is to stop people from using these tools to create non-consensual sexual images of others. Making AI accessible should never mean giving users unlimited freedom to misuse someone else’s photograph.

Regulators Must Look Beyond Individual AI-Generated Images

The Grok undressing controversy shows why laws and platform policies need to keep pace with AI-generated sexual content. Removing harmful images after they appear online is important, but it does not address how easily they can be created in the first place.

In the United States, the TAKE IT DOWN Act covers non-consensual intimate imagery, including certain AI-generated material. It also requires covered platforms to provide a process for removal requests and comply with a 48-hour removal requirement once a valid request is received.

However, AI safety cannot depend on removing harmful content after victims have already been targeted. Regulators should also examine whether companies have reasonable safeguards to prevent foreseeable misuse of their image-generation tools.

This includes clear reporting procedures, consistent enforcement and accountability when companies fail to address known risks. Regulators should also consider how AI-generated sexual content can spread between chatbots, social media platforms and external websites.

At the same time, laws need clear definitions and must account for differences between jurisdictions. The aim should be to protect people from non-consensual sexual imagery without unnecessarily restricting legitimate creative expression.

Stronger regulation, combined with effective platform safeguards, can help address the problem before harmful images spread further.

Grok Should Be a Warning for the AI Industry

Grok Should Be a Warning for the AI Industry

The Grok controversy shows what can happen when AI image-editing features become widely accessible without adequate safeguards. AI undressing tools existed before Grok, but bringing this capability directly to X made it easier for users to access and increased concerns about misuse.

The problem extends beyond one chatbot. Other AI tools can also be used to create sexualised deepfakes of people without their consent. This makes it important for the entire AI industry to take responsibility for how its products can be misused.

AI companies should measure success by more than user numbers and technical performance. They must also consider the risks their features create and whether their safeguards can prevent foreseeable harm.

A publicly available photograph is not permission to turn someone into the subject of sexual content. AI companies need to make consent and safety part of product development rather than waiting for public criticism to force changes.

Grok should serve as a warning to the wider AI industry. Companies can build stronger protections into their products now, or continue reacting after people have been harmed. The choices they make will help determine whether AI image editing remains a useful creative tool or becomes an easier way to violate someone’s privacy.

Posted in AI News | Leave a comment

Nudify AI Is Expanding Beyond Websites to Social Media and Apps

AI nudify tools allow users to create fake nude images of real people without their consent. These services have been online for years, but they are no longer limited to little-known websites. Social media platforms, online advertisements and mobile app stores are making nudify AI tools easier to discover and access.

Recent investigations have raised concerns about how these services reach mainstream audiences. A July 2026 WIRED investigation found that YouTube and X were major sources of traffic to nudify websites. Another WIRED report in August 2026 found that Meta had run advertisements for an app that appeared to promote sexual deepfakes of female politicians.

The concern goes beyond the technology itself. As nudify apps become easier to find, more people can access tools that may be used to create sexual images without permission.

Social Media Is Making Nudify AI Tools Easier to Find

Nudify AI tools were once mostly found on websites dedicated to AI image manipulation. People usually had to search for these services themselves. Social media platforms and mobile apps have made them easier to discover.

A July 2026 WIRED investigation, based on research by the Institute for Strategic Dialogue (ISD), found that social media platforms drove more than 5.7 million visits to nudify websites between December 2025 and March 2026. YouTube accounted for around 1.82 million visits, while X generated more than 1.3 million.

These numbers have raised concerns about the role social media plays in promoting access to nudify tools. Promotional videos, demonstrations and links can introduce users to services that generate explicit images of real people without their consent. Even when the image generation happens on another website, the platform directing users there remains part of the wider problem.

The biggest concern is how easily people can now discover these AI nudification tools. Users no longer need to search for specialised websites or know where to find them. They may come across a demonstration while watching YouTube videos or browsing X.

ALSO READ: AI Porn Statistics (2025-2030): Key Data, Trends & Facts

YouTube and X Have Become Gateways to Nudify Services

YouTube and X Have Become Gateways to Nudify Services

YouTube and X have come under scrutiny for making nudify websites easier to find. Research found that YouTube was the largest source of social media traffic to nudify websites. 

Some videos reportedly reviewed nudify apps, demonstrated their features or shared promotional codes. This content does more than introduce viewers to a product. It can also lead them to services that create sexualised images of real people without their consent.

X has faced a different but related controversy involving its AI chatbot, Grok. Users have misused the tool to generate sexualised images of real people without their consent. The incident raised concerns about the risks of making AI image generation available directly through a mainstream social media platform.

Although these cases involve different methods, they highlight the same problem. Social media platforms can make nonconsensual AI image manipulation easier to access, whether by promoting external nudify websites or providing image-generation tools of their own. Weak safeguards can allow this content to reach a much wider audience.

Social media companies need to look beyond removing explicit images after they have been shared. They should also review promotional videos, advertisements and links that direct users to services associated with image-based abuse. If these routes remain open, harmful content can continue to spread even when individual posts are taken down.

Meta Ads Have Helped Nudify Apps Reach More Users

Social media advertising has given nudify apps another way to reach people who might never search for these tools themselves. Developers no longer need to rely on website searches or word of mouth. They can use paid advertisements to promote their apps on platforms such as Facebook and Instagram.

In August 2026, WIRED reported that Meta had run ads for an AI image and video app. The ads appeared to promote sexual deepfakes of female politicians. The investigation also found ads for other apps that could create intimate images without consent. Meta removed the reported ads after WIRED contacted the company.

Meta has stated that it prohibits advertisements promoting nudify apps and nonconsensual intimate imagery. In June 2025, Meta announced legal action against the entity behind CrushAI. The company also said it was developing technology to detect ads promoting nudify services.

Yet, reports of these advertisements raise questions about whether the company’s safeguards are working as intended. If promotions for such apps can appear on major social networks, prohibited content may still be reaching users before moderators identify and remove it.

The concern goes beyond the advertisements themselves. Paid promotion can make nudify apps look like ordinary photo-editing products, potentially hiding the harm their features can cause. It also allows developers to reach large audiences without waiting for users to discover their websites independently.

Meta and other advertising platforms need to do more than state that these promotions are prohibited. They should improve their checks before advertisements go live, detect repeat offenders and act quickly when violations occur. 

Companies that profit from advertising should ensure their systems do not help nudify services find new users. Removing an advertisement after it has been reported is necessary, but preventing it from appearing in the first place should be the priority.

ALSO READ: UK Bans Ads for AI Nudify Apps That Sexualize Real Women

App Stores Are Making Nudify AI Tools Easier to Access

Social media and websites are not the only ways people can find nudify AI tools. Mobile app stores have created another route, raising concerns about whether existing age restrictions and parental controls are enough to keep these services away from children.

An October 2026 investigation by the Tech Transparency Project, reported by The Guardian, found that 135 nudify apps were available to US teenagers using test accounts set up as belonging to 13-year-olds. The apps remained accessible despite parental restrictions on the devices used in the investigation. Some were also labelled as suitable for children.

These incidents have raised serious questions about how Apple and Google review apps, assign age ratings and enforce parental controls. Both companies have rules intended to restrict harmful content, but the investigation suggests that those measures did not consistently block the apps tested.

The risks are especially concerning for young people. Nudify tools can be used to create fake explicit images of classmates, friends or other people they know. Even when the images are fabricated, victims can still face bullying, embarrassment, harassment or threats. The damage can extend beyond the original image if it is shared among classmates or circulated online.

App stores need to look beyond how developers describe their products. A photo-editing app may appear harmless in its listing, but its actual features could allow users to create sexual images of real people without consent. Apple and Google should test these functions during app reviews and take action against services that facilitate this type of abuse.

Parental controls are also important, but they cannot replace effective app-store screening. Parents should not have to investigate every app their children want to download to determine whether it can be misused. Keeping nudify apps away from younger users requires stronger checks before an app reaches the store, along with regular reviews when its features change.

The Main Problem With Nudify AI Is Consent, Not the Technology

AI image editing has legitimate uses, from creative projects to visual effects. The issue is how these tools are used. When someone uses Nudify AI to make another person appear naked or place them in a sexual situation without permission, the technology becomes a means of image-based abuse.

The fact that an image is fake does not make the harm any less real. Once an explicit image spreads online, it can damage someone’s reputation, invite harassment and cause lasting distress. Removing it can also be difficult, as other users may download the image, share it privately or repost it on different platforms.

Women and girls face particular risks from nonconsensual sexual deepfakes. An ordinary photograph taken from a public social media profile can become the starting point for an explicit image that the person never agreed to create. The person targeted may have little control over where that image appears or who sees it.

The growing availability of nudify apps makes this problem harder to ignore. These tools may take only a few clicks to use, but easy access does not give anyone the right to manipulate another person’s image into sexual content. The ability to create an image should never be confused with permission to use someone’s likeness in that way.

Social media companies, app stores and AI developers need to make consent a central part of their safety policies. This means restricting the promotion of tools intended for nonconsensual sexual imagery, strengthening safeguards against misuse and responding quickly when someone is targeted. The focus should be on protecting people from abuse, rather than treating every new AI feature as harmless simply because it is technically possible.

Social Media Platforms Need Stronger Safeguards Against Nudify AI

Social Media Platforms Need Stronger Safeguards Against Nudify AI

Removing nudify advertisements, videos and apps is necessary, but similar services can return under different names. Platforms need stronger safeguards to prevent these tools from reaching users.

Social media companies should remove promotional videos, referral links and posts advertising nudify services. They should also take action against repeat offenders.

App stores need to test apps more carefully, enforce age restrictions and identify features that enable nonconsensual sexual imagery. Advertising networks should also prevent these services from gaining visibility through paid promotions.

Victims need simple ways to report AI-generated explicit images and request their removal. Platforms should also act against accounts that create or distribute this content.

The focus should be on preventing abuse, not just removing content after it spreads. Social media companies, app stores and advertising networks must work to limit the promotion and distribution of nudify tools across their services.

Nudify AI Needs More Than Content Moderation

Nudify AI is no longer limited to obscure websites. Social media referrals, paid advertisements and mobile app stores have made these tools easier to discover and access.

Investigations by WIRED and other outlets raise concerns about gaps in existing safeguards. This does not mean every platform supports image-based abuse, but harmful services can still reach users despite rules intended to restrict them.

The responsibility should not fall solely on victims to report fake explicit images after they have spread. Platforms need to review the advertisements they approve, the apps they host and the content that directs users to nudify services.

As AI image editing becomes easier to use, preventing misuse will become increasingly important. Social media companies, app stores and advertisers must put consent and personal safety ahead of clicks, downloads and revenue.

Posted in AI News | Leave a comment

Apple and Google Face Pressure to Remove AI Nudify Apps

Fake nude images created with AI have become a serious concern because they can target real people without their consent. AI nudify apps make this easier by allowing users to turn ordinary photos into sexual images. These tools are no longer limited to lesser-known websites. Some have also appeared on major app stores, making them easier to access on smartphones.

In July 2026, San Francisco City Attorney David Chiu sent cease-and-desist letters to Apple and Google. He asked them to remove 13 apps that could create sexual images of people without their consent. The city also called on both companies to cut ties with the developers and stop making money from these services. 

The move raised questions about how much responsibility tech companies should take for the apps they make available. The issue goes beyond a handful of apps. Apple and Google control two of the world’s biggest mobile app stores. Their review processes decide which apps users can download and which developers can earn money through their platforms. 

If apps that enable this kind of abuse can pass those checks. Both companies need to explain what went wrong and how they plan to prevent it from happening again.

ALSO READ: AI Porn Statistics (2025-2030): Key Data, Trends & Facts

San Francisco Questions Apple and Google Over AI Nudify Apps

In July, San Francisco targeted eight apps on Apple’s App Store and five on Google Play. These apps were often listed as face-swapping or photo-editing tools. However, some also let users create fake nude images of people without their consent.

The city accused Apple and Google of making these apps available and earning money from them. It also warned that both companies could face civil penalties if they failed to address the issue.

Money is another key part of the case. San Francisco City Attorney David Chiu told WIRED that Apple and Google had likely earned millions of dollars in fees from these apps. Both companies can make money from app downloads, subscriptions and in-app purchases.

Following the city’s action, both companies took steps against the reported apps. Apple said it had removed three apps and was working to close the accounts of some developers. Google confirmed that it had suspended all five apps named in its letter. The company also said it had removed hundreds of apps that violated its policies and restricted related search terms on Google Play.

These steps show that Apple and Google can take action against apps that enable this kind of abuse. However, removing reported apps does not solve the entire problem. Both companies also need to examine how these apps passed their review processes and take steps to stop similar services from appearing again.

AI Nudify Apps Should Not Be Treated as Regular Photo Editors

AI Nudify Apps Should Not Be Treated as Regular Photo Editors

AI nudify apps can be difficult to identify because their advertised purpose may not reveal what they can actually do. Some are listed as face-swapping tools, photo editors or AI image generators. However, they may also include features that let users create fake sexual images of real people without their consent.

This makes it harder for app stores to catch these apps during the review process. An app’s description and screenshots may not show all its features. Developers may also add new features after approval or hide certain functions until users install the app.

Apple took steps to address this problem in October 2026 by updating its App Store guidelines. The new rules specifically target certain harmful AI content and apps that hide prohibited features to pass the review process. Apple also strengthened its rules for apps that host user-generated content. These include requirements to filter inappropriate material and give users ways to report abuse.

These changes are a positive step, but rules alone are not enough. They will only make a difference if Apple and Google enforce them consistently.

Both companies need to check what an app can actually do instead of relying only on its description. They should review app updates, respond quickly to complaints and take action against developers who repeatedly try to get around their rules.

AI Nudify Apps Can Harm People Without Their Consent

Fake nude images can have serious consequences for the people shown in them. Someone can take an ordinary photo from a public social media account and use an AI tool to turn it into sexual content without the person’s knowledge or permission.

Victims may face harassment, threats and public humiliation. Such images can also damage their personal or professional lives. Once the images spread online, removing them becomes much harder. Even if the original post is taken down, copies may continue to circulate.

Women and girls face particular risks from AI nudify tools, but anyone with photos online could become a target. The problem becomes more serious when these apps are easy to find and require little effort to use.

The risk also extends to children and teenagers. In October 2026, an investigation by the Tech Transparency Project found that teenagers could access numerous nudify apps through Apple’s and Google’s app stores, even with parental restrictions in place. 

Researchers identified 135 downloadable apps using test accounts presented as belonging to 13-year-olds. Some of these apps were also labelled as suitable for much younger children.

AI Nudify Apps Could Return Even After Being Removed

Removing the 13 apps identified by San Francisco is an important step, but it does not solve the wider problem. Developers could launch similar apps under different names or add banned features after their apps are approved. Users could also turn to websites offering the same services.

Apple and Google need to do more than remove apps after complaints. They should take several steps to prevent these services from returning. First, they should improve app reviews to identify tools that create fake sexual images without consent, even when they are listed as regular photo editors.

Second, they should check apps after approval to catch new features that break their rules. Third, they should make it easier for victims to report manipulated images and ensure these complaints receive urgent attention.

Finally, both companies should take action against developers who repeatedly break the rules. This could include blocking their new apps and accounts to prevent them from offering the same services again.

These steps may not stop all image-based abuse, but they could make it harder for developers to distribute nudify tools through major app stores.

ALSO READ: AI Has Made Fake Nude Abuse Easier to Scale, New Berkeley Report Warns

Apple and Google Must Take Responsibility for the Apps They Offer

Apple and Google Must Take Responsibility for the Apps They Offer

The San Francisco case raises an important question about the role of tech companies in AI abuse. Companies often argue that their tools have many legitimate uses, even if some people use them to harm others. This is true for photo editors, face-swapping tools and AI image generators.

However, there is a clear difference between someone misusing a regular editing tool and an app offering features that let users create fake sexual images of real people without their consent.

Apple and Google cannot prevent every misuse of technology. However, they control which apps appear in their stores and can earn money from the services they offer.

Their responsibility should go beyond setting rules for developers or removing apps after public complaints. They need to check whether their policies are working and take action when apps break those rules.

This means identifying harmful features during app reviews, responding quickly to reports and preventing developers from repeatedly bringing back apps that violate their policies.

Posted in AI News | Tagged , | Leave a comment

Parents Warned That Ordinary Photos Can Be Turned Into AI Sexual Abuse Images

Parents should think carefully before sharing their children’s photos publicly. AI tools can turn ordinary pictures into fake sexual images without the child’s or parents’ permission. Even a photo taken at a birthday party, on a beach or at school can be copied and misused. 

UK authorities have warned about the dangers of publicly sharing children’s photos, including the risk that these images could be used to create AI-generated sexual abuse material. The risk is not sharing family memories but losing control over how those photos are used. Once an image spreads online, removing every copy can be difficult.

Parents can reduce these risks by keeping accounts private, avoiding personal details and asking relatives not to share children’s photos without permission. Children should also have a say in how their pictures are shared as they grow older.

However, parents cannot tackle this problem alone. Social media platforms must remove abusive images quickly, and AI companies must strengthen safeguards against image abuse.

Parents should not have to choose between sharing family memories and protecting their children’s privacy. Technology companies must help prevent abuse and hold those responsible accountable.

AI Tools Make It Easier to Misuse Children’s Photos

Creating realistic fake images once required advanced editing skills and hours of work. Today, AI tools have made the process much easier, allowing people to alter photographs with little effort.

Some AI tools can change a person’s appearance or clothing to create fake nude images. When these tools are used to target children, the results can cause serious emotional distress for both the child and their family.

The original photo does not have to be revealing. A simple picture taken at a birthday party, on a beach or during a school event can be copied and manipulated without the child’s or parents’ consent.

This is why parents need to be careful about sharing their children’s photos publicly. A picture posted to share a happy family moment can be saved, altered and circulated online without their knowledge or permission.

This does not mean every photo shared online will be misused. However, AI has created new ways for people to exploit children’s images. Parents may have little control over what happens to a photo once it becomes publicly accessible.

Publicly Shared Photos of Children Can Lead to Risks Beyond Social Media

Publicly Shared Photos of Children Can Lead to Risks Beyond Social Media

Many parents share their children’s photos online to keep family and friends updated on their lives. However, when a social media account is public, those pictures may reach people the parents never intended to share them with.

Anyone who can view a public photo may be able to download it, take a screenshot or share it on another platform. Once an image spreads beyond its original audience, tracking where it appears or who has saved it can become difficult.

AI tools make this problem more concerning. People may be able to misuse a child’s publicly available photo without accessing their private social media account or knowing anything about the family. An ordinary picture can be copied and altered without the child or parents ever knowing.

Parents should not be blamed for someone else’s decision to misuse a child’s photo. The responsibility lies with the person who creates or shares abusive content. However, limiting who can view children’s photos online can help reduce the risk of misuse.

Parents should also think about their children’s long-term digital privacy. A photo shared today could remain online for years, even after the child grows up. Being careful about what they post publicly can help families protect their children’s privacy and reduce the chances of their images being used in ways they never intended.

AI-Generated Child Abuse Images Prompt New Warning for Parents

Internet Watch Foundation (IWF) and National Crime Agency (NCA) have issued new guidance urging parents and carers to be careful about sharing children’s photos online. The organisations warn that ordinary family pictures can be stolen and manipulated to create AI-generated sexual images.

The scale of the problem is growing. The IWF identified 3,443 AI-generated child sexual abuse videos in 2025, compared with just 13 in 2024. In response, the organisations are encouraging parents to check their social media privacy settings, limit who can view their children’s photos and discuss image-sharing consent with relatives, schools and clubs.

The guidance also advises parents to talk to children about AI-generated nude images and online safety. If a child’s photo is misused, parents should reassure them that they are not at fault and report the incident to the police or the relevant child-protection authorities.

ALSO READ: AI Porn Statistics (2025-2030): Key Data, Trends & Facts

Parents Should Not Ignore Children’s Consent When Sharing Photos Online

One important issue in the debate over sharing children’s photos online is consent. Parents may decide what to post on social media, but their children may not always agree with those choices.

Young children may not understand the long-term effects of having their pictures shared online. Older children may also feel embarrassed or uncomfortable when parents post photos they would prefer to keep private.

As children grow older, parents should give them more control over their digital identity. Asking before posting a photo, respecting their wishes and avoiding embarrassing pictures are simple steps that can help protect their privacy.

This matters even beyond the risk of AI-generated abuse. Children have a right to privacy and should have a say in how their personal information and images are shared online.

A photograph that parents see as a sweet family memory may feel very different to the child in it. The situation can become even more uncomfortable if the image spreads beyond family and friends or is later used to mock or embarrass them.

The growing risk of AI-generated sexual images makes this issue more urgent. Protecting children’s digital identity should begin with respecting their privacy, not waiting until their photos are misused. Parents should remember that managing a child’s social media presence does not mean they should have complete control over the child’s online identity without considering their wishes.

Should Parents Stop Sharing Their Children’s Photos Online?

Parents do not necessarily need to stop sharing their children’s photos altogether. Social media allows families to stay connected, especially when relatives live in different cities or countries. However, parents need to think carefully about what they post and who can see it.

A sensible approach is to limit children’s exposure online rather than ban every photograph. Parents can start by making their social media accounts private and checking who has access to their posts. They should avoid sharing children’s photos publicly unless there is a good reason to do so.

The information shared alongside a photo also matters. A child’s full name, school uniform, school name, daily routine or exact location can reveal personal details to strangers. Leaving out this information can help protect a child’s privacy.

Parents should also think twice before posting photos of children in swimwear or other vulnerable situations. Even when a picture is completely innocent, it could be copied or misused. Embarrassing photos also deserve careful consideration, as children may feel uncomfortable about them being online when they grow older.

Making an account private cannot guarantee complete protection. Followers can still take screenshots, save images or share them with others. However, limiting access to children’s photos can reduce the number of people who can view them in the first place.

Schools, sports clubs and other organisations also have a responsibility to protect children’s images. They should clearly explain where photographs will be published, who will be able to view them and how they will be stored. Parents should know whether a photo will appear in a private group, on a school website or on a public social media account before giving their permission.

Ultimately, protecting children’s photos online is about making informed choices, not giving up family memories. Parents can still share special moments while taking steps to protect their children’s privacy and reduce the risk of their images being misused.

Social Media Platforms Must Act Against AI Abuse of Children’s Photos

Social Media Platforms Must Act Against AI Abuse of Children’s Photos

Parents cannot stop AI abuse of children’s photos on their own. Social media platforms and AI companies must take responsibility for preventing the creation and spread of abusive images.

Social media platforms should make privacy settings easy to use and respond quickly to reports of AI-generated sexual images, fake profiles and the unauthorised sharing of children’s photos.

AI companies must build safeguards into their tools to prevent users from creating sexual images of children. They should also take steps to stop users from bypassing these protections.

Reporting abusive images should be simple. Parents and children need clear ways to report content, request its removal and get help. Platforms should not make them go through lengthy or confusing procedures.

Removing an image becomes harder once it spreads across multiple websites. Deleting it from one platform does not remove every copy. Companies must respond quickly to reports and work together to limit further distribution.

Law enforcement agencies also need the resources and technical skills to investigate AI-generated child sexual abuse material and identify those responsible.

Parents cannot protect children from AI abuse through privacy settings alone. Technology companies must prevent the misuse of their tools, remove abusive content quickly and help authorities investigate those responsible.

ALSO READ: Meta Says Its AI Caught 97% of Child Exploitation Content Before User Reports

Parents Need Awareness of AI Abuse Without Living in Fear

Warnings about AI-generated sexual images of children can make parents afraid to share any family photos online. However, the goal should be to help parents understand the risks and make safer choices, not make them fear every photograph they post.

Parents can start by making their social media accounts private, limiting personal information in posts and asking relatives not to share their children’s photos without permission. They should also teach older children about online privacy and explain what to do if someone misuses their pictures.

If a child’s photo is used to create a fake sexual image, parents should reassure the child that they are not to blame. They should report the image to the platform and contact the relevant child-protection authorities or law enforcement. They should not forward or repost the image, as this could spread the abuse further.

The responsibility for AI-generated sexual abuse lies with the person who creates or shares the image, not the child whose photo was misused. Parents can take steps to protect their children’s privacy, but they should never feel that they are responsible for someone else’s abusive actions.

Posted in AI News | Leave a comment

Researchers Say Popular Hugging Face Models Can Easily Create Explicit Deepfakes

AI tools that can edit photos and create realistic images are raising new concerns about online abuse. Some of these tools can be misused to create explicit deepfakes of real people without their consent.

A report by WIRED has raised concerns about popular AI image-editing models. These models are available on Hugging Face, a platform where developers can share and download AI models. Researchers found that some of these models could be used to create explicit deepfakes with relative ease.

This raises concerns about AI safety and the responsibility of platforms that make these tools available. Hugging Face supports open-source AI development, but its models can also be downloaded, modified and used outside the platform’s control.

The problem is not AI image editing itself. It is the risk of using these tools to create fake sexual images of real people without their permission. Such images can lead to harassment, blackmail and public humiliation, raising questions about whether AI platforms are doing enough to prevent this kind of abuse.

How Hugging Face AI Models Are Being Used to Create Fake Nude Images

AI image-editing models can change existing photos based on text prompts or other instructions. Depending on the model, users can alter a person’s appearance, change their clothing or add details that were not in the original image.

However, these tools can also be misused to create fake nude images and explicit deepfakes of real people without their consent. A WIRED investigation found that 7 of the 9 Hugging Face image-editing Spaces tested could turn a photo of a clothed woman into a topless image.

The investigation also examined more than 1,000 prompts submitted to these tools. Around 73% of the prompts were sexual in nature. Of those sexual requests, 83% aimed to undress or sexualise someone in an uploaded photograph. Women accounted for 95% of the people targeted, while 6.7% of the sexual prompts targeted people who appeared to be children.

These findings raise concerns about the safety measures used in publicly available AI image-editing tools. When models have weak safeguards, users may be able to create manipulated images without advanced editing skills. Downloadable models can also be modified and run outside the original platform, making it harder to control how they are used.

This does not mean every image-editing model on Hugging Face can generate explicit deepfakes. Models have different capabilities and safety measures. However, the investigation highlights the need for stronger testing before high-risk tools become widely available.

The harm can continue long after an image is created. Victims may face online harassment, threats, blackmail and damage to their reputation. Removing images can also be difficult once they have been copied and shared across multiple websites. This shows why AI platforms need stronger safeguards to prevent nonconsensual sexual images from being created and spread.

ALSO READ: AI Has Made Fake Nude Abuse Easier to Scale, New Berkeley Report Warns

Nonconsensual Deepfakes Are a Serious Form of Online Abuse

Creating explicit deepfakes of someone without their permission should be treated as a serious form of online abuse. A person does not need to share an intimate photo for someone to create a fake nude image of them. In some cases, a simple photograph from a public social media profile can be misused.

The image may be fake, but the damage is real. Victims can face harassment, blackmail, threats and public humiliation. Women and girls are particularly vulnerable to this form of abuse, which can affect their safety, privacy and reputation.

Children face even greater risks. AI-generated sexual images of minors raise serious child safety concerns, even when the images are fabricated. Platforms must take stronger steps to prevent their tools from being used to create such material and respond quickly when abuse is reported.

AI image editing can have legitimate uses, but those uses should not come at the expense of someone’s consent. Technology companies must draw a clear line between creative editing and the creation of explicit images of real people without their permission. Stronger safeguards, clear reporting systems and faster removal of abusive content should be essential parts of that effort.

Hugging Face Needs Stronger Safeguards Against AI Deepfake Abuse

Hugging Face Needs Stronger Safeguards Against AI Deepfake Abuse

Hugging Face makes it easier for developers and researchers to share AI models and build new tools. This open approach supports innovation, but it also raises safety concerns when models can be misused to create explicit deepfakes of real people.

Hugging Face and model developers should take stronger steps to prevent this type of abuse. High-risk image models should be tested to see whether they can generate nonconsensual sexual images, rather than relying only on the safety claims in their documentation.

Developers should also add effective safeguards to prevent the misuse of real people’s photos, especially images of children. Model pages should clearly explain known risks, safety limits and the steps taken to reduce potential harm.

Hugging Face should also provide a clear reporting process for models that enable sexual abuse. Reports should be reviewed quickly, with appropriate action taken when a model violates platform rules or presents serious risks.

No safety measure can prevent every case of misuse, particularly when models can be downloaded and modified. However, this should not stop platforms from taking reasonable steps to reduce the risk. Open-source AI development should support innovation without overlooking the potential harm to people whose images are used without their consent.

ALSO READ: Open Source AI Statistics

Open-Source AI Platforms Must Take Responsibility After Release

Open-source AI development involves model creators, platforms and users, each with a role in preventing misuse. Making a model available for research or experimentation does not remove the risks it may pose after release.

Platforms cannot predict every possible misuse, but they should not assume a model is safe simply because it has a legitimate purpose. Safety checks should reflect what a model can actually do. A tool that restores old photos may pose different risks from one that can generate explicit images of real people.

Disclaimers alone are not enough to prevent AI deepfake abuse. Platforms should introduce practical safeguards for high-risk models while keeping legitimate research and image editing possible.

The goal should be to reduce the risk of harm without placing unnecessary limits on open-source AI. Platforms must find that balance before and after releasing models to the public.

Deepfake Victims Need Faster Image Removal and Better Support

Preventing explicit deepfakes is only part of the solution. Victims also need quick and simple ways to report abusive images and get them removed. Fake nude images can lead to online harassment, threats, blackmail and humiliation. Victims may also fear that family members, friends or employers will see the images, affecting their personal relationships, reputation and sense of safety.

AI platforms, social media companies and websites should provide clear reporting options and respond quickly to complaints. They should also limit the spread of reported images and take steps to prevent them from being reposted.

Victims should not have to struggle to prove their case before receiving help. Even when an explicit image is entirely fabricated, the emotional distress, damage to personal relationships and fear of further exposure can be real.

Public awareness is equally important. People need to understand that creating or sharing explicit deepfakes without consent can cause lasting harm. Platforms must make reporting and removal easier so victims are not left to manage the abuse on their own.

Hugging Face Must Take Explicit Deepfake Risks More Seriously

Hugging Face Must Take Explicit Deepfake Risks More Seriously

Concerns about explicit deepfakes on Hugging Face raise questions about how the platform checks the safety of the AI models it hosts. Reports suggest that popular image-editing models can be misused to create sexual images of real people. This shows the risks of making these tools publicly available without adequate safeguards.

Hugging Face has helped developers and researchers share AI models more easily. But when these models can be used to create fake sexual images of real people, their potential for misuse deserves serious attention. Safety checks should examine what a model can actually do, not just what its developers claim it is designed for.

Hugging Face cannot control every use of a model, especially after someone downloads and modifies it. However, this limitation should not become an excuse for weak safeguards. The platform should encourage stronger safety testing and clear risk disclosures. It should also provide simple ways to report models that enable nonconsensual deepfake abuse.

Victims also need better protection. Fake sexual images can lead to harassment, blackmail and humiliation, even when the images are entirely fabricated. Platforms should make it easier to report abusive content and take prompt action when complaints are verified. 

Open-source AI should remain accessible for legitimate research and innovation. But that does not mean every model should be released without careful consideration of its risks. If an AI model can be easily misused to create explicit images of real people without their consent, developers should take steps to prevent such abuse.

It should be part of the safety process, not an afterthought. Therefore, Hugging Face and model developers need to take this responsibility seriously.

Posted in AI News | Leave a comment

Meta Says Its New AI Models Are on Par With OpenAI and Anthropic

Meta is making a fresh claim to leadership in artificial intelligence, unveiling two advanced models that it says can compete with the best systems from OpenAI and Anthropic.

The company introduced Muse Wonder and Muse Wonder Full on October 12, describing them as its most capable AI models yet. The release represents a significant milestone in CEO Mark Zuckerberg’s effort to rebuild Meta’s AI operations after falling behind rivals in developing frontier models.

The new systems are built to handle complex tasks involving coding, financial analysis, legal documents and autonomous AI agents. Meta says their performance matches or exceeds leading competing models on several benchmarks.

In a post announcing the launch, Zuckerberg said Muse Wonder represented a substantial improvement over the company’s earlier Muse Spark models and had returned Meta to the frontier of AI development.

The announcement comes roughly 14 months after Meta began restructuring its AI operations, bringing in Scale AI co-founder Alexandr Wang and spending billions of dollars on researchers, computing infrastructure and new model development.

For Meta, the stakes extend beyond producing another chatbot. Zuckerberg wants to build what he calls personal superintelligence AI systems capable of understanding individual users, remembering important information and completing increasingly complex tasks on their behalf.

The Wonder models offer the strongest evidence so far that Meta’s expensive strategy is producing results. But whether the company can sustain its progress against OpenAI, Anthropic and Google remains uncertain.

Meta’s Wonder Models Challenge OpenAI and Anthropic

Meta’s latest release consists of two models: Muse Wonder, which developers can access through the company’s API, and Muse Wonder Full, a more capable version currently available through its Muse Code subscription service.

Both models represent a substantial increase in capability over Muse Spark, the earlier model family Meta introduced in April.

According to Meta’s official announcement, the systems were developed for complex personal and professional tasks, including interpreting insurance claims, understanding rental agreements and building software applications.

The company says the models perform particularly well in areas that require reasoning across multiple steps rather than generating a single response.

In its technical research report, Meta presented benchmark results showing significant improvements over its previous models, with performance competitive against leading systems from OpenAI, Anthropic and Google.

The results suggest Meta has narrowed the gap with companies that have dominated the frontier AI market.

However, benchmark comparisons require context.

A model that performs well on coding tasks may not achieve the same results in scientific reasoning, mathematics or other specialized applications. Results can also differ depending on testing methods and the versions of competing models being evaluated.

Anastasios Angelopoulos, chief executive of AI evaluation platform Arena, offered a more cautious assessment in a Financial Times profile of Meta AI chief Alexandr Wang.

Angelopoulos acknowledged Meta’s substantial progress while indicating that its models had not yet consistently matched the strongest systems from OpenAI and Anthropic.

That distinction is important. Meta has demonstrated that it can build competitive frontier AI models, but the launch does not establish that it has become the industry’s overall leader.

Zuckerberg Wants AI Agents That Can Remember and Act

Zuckerberg Wants AI Agents That Can Remember and Act

The most significant changes in Muse Wonder are not limited to higher benchmark scores.

Meta has introduced two capabilities intended to make its models more useful as personal AI agents: Active Memory and Active Focus.

Active Memory allows the system to retain relevant information across conversations and retrieve it when needed.

For example, a personal assistant could remember details about a user’s preferences, ongoing projects or previous instructions rather than requiring the same information to be entered repeatedly.

Active Focus addresses a different problem: keeping an AI system working when a task becomes complicated.

Instead of abandoning an assignment after encountering an error, the model can attempt alternative approaches, recover from mistakes and continue working toward the original objective.

Meta says the system is also trained to request clarification when necessary and check with users before taking important actions.

These features are central to Zuckerberg’s vision of personal superintelligence.

Today’s AI assistants are increasingly capable of answering questions, writing code and analyzing documents. The next challenge is developing systems that can independently complete longer assignments while maintaining context and respecting user instructions.

A personal AI agent might eventually coordinate travel arrangements, compare financial options, manage schedules or complete routine administrative work.

Meta believes such capabilities could make AI a more important part of everyday computing.

However, the same features also create new risks. AI agents that remember personal details and access private documents must be able to distinguish legitimate instructions from malicious requests or accidental disclosures.

Meta says it has trained Muse Wonder to protect sensitive information and resist harmful instructions, although those claims will need continued independent evaluation as the models reach more users.

ALSO READ: Meta’s New Muse AI Agent Can Send Emails, Book Travel and Make Payments

Meta’s $14 Billion Scale AI Bet Is Facing Its First Major Test

The Wonder launch follows one of the most aggressive AI reorganizations undertaken by a major technology company.

In June 2025, Meta invested approximately $14.3 billion in Scale AI, the data infrastructure company co-founded by Alexandr Wang.

The deal brought Wang into Meta’s leadership team, where he took charge of its newly established Superintelligence Labs.

Zuckerberg’s decision reflected growing concerns about Meta’s ability to compete with frontier AI developers.

Although the company’s Llama models helped popularize openly available AI technology, later releases struggled to match the performance of leading systems from OpenAI, Anthropic and Google.

Meta responded by recruiting experienced researchers from competing laboratories and expanding its investment in AI computing infrastructure.

The company also changed how it develops and distributes advanced models.

Unlike earlier Llama releases, the Wonder models are proprietary systems. Their model weights are not publicly available for developers to download and run independently.

Instead, Meta is distributing Muse Wonder through a commercial API and its coding tools, while reserving Muse Wonder Full for subscribers.

The shift gives Meta greater control over how its most advanced technology is used and creates potential subscription and developer revenue.

According to Reuters’ October 12 report, Meta shares rose approximately 4% in afternoon trading following the announcement.

The market reaction suggests investors welcomed evidence that the company’s heavy AI spending was producing competitive technology.

But the longer-term financial question remains unresolved.

Meta must show that its investments can support products and services capable of generating meaningful revenue, rather than simply matching competitors in technical evaluations.

ALSO READ: AI Talent War: Who is Actually Winning – OpenAI, Anthropic, Google, and Meta?

Muse Wonder Will Power Meta’s Personal AI Assistant

Meta plans to bring Muse Wonder into its personal AI agent, Muse, beginning with paying subscribers.

The company launched Muse in September as part of its broader effort to develop AI systems that can perform tasks rather than simply respond to prompts.

Muse can assist with activities such as research, scheduling, shopping and other assignments involving multiple steps.

The integration of Wonder is intended to make the agent more capable of handling difficult requests and completing tasks that require sustained reasoning.

Meta has also made Muse Wonder available through its Model API and Muse Code, while Muse Wonder Full is accessible to Muse Code subscribers.

According to The Verge’s coverage of the launch, Meta plans to use Wonder to support more advanced agent features and eventually develop specialized models for broader consumer use.

This distribution strategy could give Meta an advantage over smaller AI companies.

The company already operates Facebook, Instagram, WhatsApp and Messenger, giving it access to an enormous audience that could eventually use AI features across its existing products.

Meta reported more than 3.6 billion daily active users across its family of applications.

However, integrating advanced AI into widely used consumer services presents challenges beyond model performance.

Users must be willing to trust AI agents with personal information, grant them access to accounts and allow them to complete tasks with potentially significant consequences.

Whether consumers will pay for those capabilities is another question.

Meta’s ability to turn its AI technology into a successful subscription business will be an important measure of the Wonder models’ commercial impact.

Meta Is Moving Away From Its Open-Model Strategy

The Wonder launch also marks a significant change in how Meta approaches AI development.

For years, the company promoted open-weight models as an alternative to the closed systems developed by OpenAI and other competitors.

Its Llama models allowed developers and businesses to download model weights, modify them and run them on their own infrastructure.

That approach helped Meta build relationships with researchers and developers while challenging the dominance of proprietary AI systems.

Wonder follows a different strategy.

Neither Muse Wonder nor Muse Wonder Full is available as a downloadable model. Developers must access the standard version through Meta’s API or supported services, while the more capable Full version remains restricted to Muse Code subscribers.

As VentureBeat reported, the change places Meta’s newest models closer to the commercial strategies used by OpenAI and Anthropic.

Meta has not abandoned open-weight AI entirely. However, its decision to keep its strongest Wonder models proprietary suggests that competitive pressure is changing how it balances openness, commercial opportunities and control over advanced technology.

Meta’s Superintelligence Ambitions Raise New Safety Questions

Meta's Superintelligence Ambitions Raise New Safety Questions

The Wonder models arrive as technology companies face growing scrutiny over the risks associated with increasingly autonomous AI systems.

Unlike conventional chatbots, AI agents can interact with websites, access personal information and perform actions on behalf of users.

That makes reliability and security especially important.

Meta says Muse Wonder includes protections intended to prevent unauthorized disclosure of private information and reduce the risk of harmful behavior.

The company also says it evaluates advanced models under its Superintelligence Scaling Framework, which sets out its approach to managing risks from increasingly capable AI systems.

However, Meta’s official release states that a fuller report containing additional safety evaluations will be published later.

Until those findings are available, some of the company’s safety claims cannot be independently assessed in detail.

The risks are not hypothetical. A recent Associated Press investigation described an incident in which Meta’s Muse agent shared a user’s home address while handling an online sale, raising questions about how AI assistants interpret permissions and handle sensitive information. 

Such incidents illustrate the challenges facing developers as AI systems gain greater autonomy.

For Zuckerberg, achieving personal superintelligence will require more than developing models that perform well on benchmarks. Meta must also demonstrate that its systems can carry out complicated tasks without exposing private information or taking actions users did not intend.

Meta Is Back in the AI Race, but the Hardest Test Is Still Ahead

Meta’s Wonder models represent a meaningful turnaround for a company that appeared to be losing ground in the competition to build advanced AI.

The release gives Zuckerberg a stronger technical foundation for his personal superintelligence ambitions and provides evidence that the company’s expensive restructuring is beginning to deliver results.

It also puts additional pressure on OpenAI, Anthropic and Google, which now face another well-funded competitor capable of developing frontier-class systems.

But Meta’s next challenge will be harder than closing the benchmark gap.

The company must continue improving its models, persuade developers to adopt its tools and demonstrate that consumers find enough value in personal AI agents to use them regularly.

It must also manage the growing costs of computing infrastructure and research while addressing the privacy and security concerns associated with autonomous systems.

The Wonder models show that Meta can compete more seriously at the frontier of AI development.

Whether Zuckerberg can turn that progress into the personal superintelligence he envisions remains an unanswered question.

Posted in AI News | Tagged | Leave a comment

AI Nudify Websites Raise New Concerns as They Expand Into Video Generation

Creating fake nude images is no longer the only concern surrounding AI nudify tools. These services are increasingly offering ways to turn ordinary photographs into realistic sexual videos, making it easier to create explicit deepfakes without advanced editing skills.

A January 2026 investigation by WIRED examined more than 50 deepfake websites and found that nearly all offered explicit video generation. Some services could turn a single photograph into a short sexual video using just a few clicks.

This development raises serious concerns about consent, privacy and online harassment. Fake nude images can already damage a person’s reputation, but realistic sexual videos may make the abuse harder to challenge. Victims may also struggle to stop the footage from spreading once it appears online.

AI companies and online platforms need to do more to prevent this abuse. Stronger safeguards, faster content removal and clear reporting systems are needed to protect people from non-consensual sexual deepfakes. AI safety must keep pace with the technology, rather than becoming a priority only after victims suffer the consequences.

AI Nudify Tools Are Moving From Images to Explicit Videos

AI Nudify tools use artificial intelligence to alter photos, making people appear undressed or placing them in sexual situations. These tools have been around for years, but advances in generative AI have made them easier to use and their results more realistic.

The latest concern is the shift from fake nude images to explicit videos. According to WIRED, some services can turn a single photo into an eight-second explicit video. Users can also choose ready-made templates to create clips with less effort.

This makes the problem more serious. Videos can show movement, facial expressions and changing camera angles, making fake scenes look more convincing. People who see these clips without context may mistake them for real footage.

A realistic video does not mean the event actually happened. AI can create sexual scenes featuring real people who never consented to appear in them. The technology raises serious concerns about privacy, consent and the misuse of personal photos.

The problem also extends beyond individual websites. WIRED found that sexual deepfake tools are available through websites, messaging-platform bots and services that help other developers build similar features. This makes the market harder to control.

Removing individual websites will not solve the problem on its own. If the same tools remain available through other services, people can continue creating and sharing explicit deepfakes. Platforms must do more to prevent non-consensual content from being created and distributed, rather than responding only after victims report it.

ALSO READ: AI Porn Statistics (2025-2030): Key Data, Trends & Facts

Why AI-Generated Sexual Videos Pose a Greater Risk

Why AI-Generated Sexual Videos Pose a Greater Risk

AI-generated sexual videos raise serious concerns about privacy, consent and online harassment. As nudify tools become easier to use, victims may have fewer ways to prevent their photos from being turned into explicit content.

1. AI Sexual Deepfake Videos Can Damage Reputations

Fake nude images can cause serious harm, but realistic sexual videos may be even harder to dismiss. Viewers may believe the footage is genuine because it shows movement and facial expressions.

The person depicted may face online harassment, bullying, threats and damage to their personal or professional life. Even after a video is exposed as fake, the damage to their reputation may continue.

Women and girls face particular risks when their photos are publicly available online. An ordinary picture from school, work or a family event could be used to create a sexual deepfake without their knowledge.

Victims should not have to defend themselves against fabricated sexual content. The responsibility should also fall on the platforms that make this abuse possible.

2. AI Nudify Tools Ignore the Importance of Consent

AI nudify tools can turn ordinary photographs into explicit content without a person’s consent. This allows others to create sexual videos using someone’s image without their knowledge or permission.

Sharing a photograph publicly does not mean someone has agreed to appear in sexual content. Permission to use a photo for one purpose also does not give others the right to manipulate it into a fake nude video.

Some services warn users to upload only images they have permission to edit. However, warnings alone cannot prevent abuse. Platforms need effective safeguards, clear reporting systems and quick responses to complaints.

Developers should treat consent as a basic safety requirement. They must also take stronger steps to prevent sexual content involving children and stop the misuse of their tools against real people.

3. AI Makes Sexual Harassment Easier to Repeat

Creating convincing manipulated videos once required editing skills, time and specialist software. AI tools have lowered these barriers, while ready-made templates make the process even simpler.

A person can use one photograph to generate several fake sexual scenes. This can increase the amount of abusive content a victim must report and try to remove.

The problem becomes harder to control when similar tools operate across websites, messaging bots and other services. Removing one platform may not stop people from finding alternatives.

This is why responsibility cannot rest with users alone. Developers, hosting providers and platforms that promote or distribute these tools must take meaningful steps to limit abuse. Without stronger safeguards, advances in AI video generation could make non-consensual sexual deepfakes easier to create and harder for victims to escape.

The Growing AI Nudify Industry Needs Stronger Oversight

The growing AI nudify industry needs stronger oversight as tools for creating fake nude images and explicit videos remain accessible online. Investigations have raised concerns about how these services operate and the technology infrastructure that supports them.

In July 2025, WIRED investigated 85 nudify and undress websites. The report found that many used infrastructure from major technology companies, including Google, Amazon and Cloudflare.

A separate WIRED investigation in January 2026 examined more than 50 deepfake websites and found that explicit video generation was widely available. These findings suggest that the problem extends beyond individual apps or websites.

Technology companies should take this issue seriously, even when they do not create the abusive content themselves. Hosting providers, app stores, advertising networks and payment services can review how their services support platforms that enable non-consensual sexual deepfakes.

This does not mean every AI image or video tool should face restrictions. These technologies have legitimate uses in filmmaking, creative projects and visual effects. The focus should be on services that facilitate sexual abuse without consent.

Companies must also explain how they prevent misuse. They should disclose how they review content, handle complaints and respond when someone reports an AI-generated sexual video made without their permission.

Stronger oversight should be a basic requirement, not an optional safety measure. If companies profit from providing these tools, they should also take responsibility for reducing the harm they can cause.

ALSO READ: UK Bans Ads for AI Nudify Apps That Sexualize Real Women

AI Companies Should Prevent Sexual Deepfake Abuse Before It Happens

Removing harmful AI-generated sexual content after it spreads is important, but it does not undo the damage. By the time a victim reports a fake nude image or explicit video, copies may already be circulating across multiple platforms.

AI developers should build safety measures into image and video generation tools from the beginning. These should include restrictions on creating non-consensual sexual content featuring real people, stronger protections for children and simple ways for victims to report abuse.

Companies must also test whether users can bypass these safeguards. A rule against sexual deepfakes means little if someone can get around it by changing a prompt or using another feature.

App stores and hosting providers should review services that promote ordinary photo editing but also offer features for creating explicit deepfakes. Platforms that repeatedly enable abuse should face meaningful consequences.

Governments must also ensure that laws against non-consensual intimate imagery cover AI-generated sexual videos. Victims need clear ways to request content removal, report abuse and seek legal help.

No single company can solve this problem alone. AI developers, social media platforms, hosting providers, regulators and law enforcement agencies must work together to prevent abuse.

The goal should be to stop non-consensual sexual deepfakes before they are created and shared, rather than leaving victims to deal with the consequences.

Victims Need Better Protection From AI Sexual Deepfakes

Victims Need Better Protection From AI Sexual Deepfakes

Victims of AI nudify tools often face an uphill battle. They may need to report fake nude images or explicit videos to several platforms while worrying that copies will continue to spread. Proving that the content is fabricated should not become another burden for the person targeted.

Social media platforms and websites should make reporting AI-generated sexual content easier. Their systems should clearly cover fake nude images and explicit videos created from ordinary photographs. Victims should also receive updates on their complaints and clear information about how to request removal.

Platforms should act quickly to limit further sharing and prevent removed content from being uploaded again. Victims should not have to repeatedly view or describe explicit material just to report the abuse.

Public awareness is equally important. People need to understand that realistic-looking videos can be fabricated using AI. Sharing such content can increase the harm, even when the person sharing it did not create it. Schools and workplaces should also have clear procedures for dealing with AI-generated sexual harassment.

The responsibility should not fall entirely on victims. Companies that develop and distribute AI nudify tools must take meaningful steps to prevent abuse, while platforms should make it easier to remove harmful content. Victims deserve protection, support and a clear path to seek justice.

AI Nudify Videos Show Why Safety Cannot Be an Afterthought

The shift from fake nude images to explicit AI-generated videos raises serious concerns about online sexual abuse. As AI nudify tools become easier to use, creating realistic sexual deepfakes without consent may become simpler for those who want to harass or humiliate others.

The report by WIRED shows that explicit video generation is already available across many of the nudify services it investigated. This is not just a future risk. The technology is already being offered, making stronger safeguards an urgent concern.

AI companies must take responsibility for preventing their tools from being used to create non-consensual sexual content. Platforms should act against services that enable abuse, while regulators must ensure victims have clear ways to report incidents and seek help.

AI video tools can serve legitimate creative purposes, but that does not excuse the harm caused by sexual deepfakes. Protecting consent and personal dignity must be a basic part of AI development, not something companies address only after abuse occurs. As these tools advance, preventing harm should matter as much as improving what the technology can create.

Posted in AI News | Leave a comment

Alexandr Wang Is Now the Man Behind Meta’s Superintelligence Comeback

Alexandr Wang arrived at Meta in 2025 with an extraordinary mandate: rebuild the company’s artificial intelligence ambitions and help Mark Zuckerberg compete with the world’s leading AI laboratories.

Just over a year later, the 29-year-old former Scale AI chief executive is emerging as the central figure in what could become one of Silicon Valley’s most expensive technology turnarounds.

The turning point came on October 12, when Meta introduced Muse Wonder and Muse Wonder Full, two advanced AI models built to compete with systems developed by OpenAI, Anthropic and Google.

The launch marked a significant moment for Meta, which had spent billions of dollars on AI infrastructure and talent without consistently matching its rivals’ most capable models.

According to a Financial Times profile of Wang, published October 16, the release has transformed perceptions of the young executive, whose appointment initially raised questions about whether a data infrastructure entrepreneur could lead a frontier AI research laboratory.

Meta CEO Mark Zuckerberg has described the new models as a return to the frontier of AI development. The company’s shares also rose following the announcement, offering an early indication that investors welcomed the progress.

But Muse Wonder represents more than a successful product launch. It is the first major test of Zuckerberg’s decision to entrust Meta’s superintelligence ambitions to Wang.

From Scale AI Founder to Meta’s Superintelligence Chief

Wang’s rise through Silicon Valley began long before he joined Meta. Born in 1997 and raised in New Mexico, he grew up in a family of physicists and demonstrated an early talent for mathematics. After graduating from high school ahead of schedule, he enrolled at the Massachusetts Institute of Technology.

He left MIT after roughly a year to co-found Scale AI in 2016, when he was 19. Scale AI developed tools and services for preparing and labeling the enormous volumes of data needed to train machine learning systems. Its customers eventually included major AI developers such as OpenAI and Anthropic.

As demand for training data increased, Scale became an important supplier to companies building advanced AI models. That position gave Wang a close view of the emerging AI industry, even though his company was not primarily known for developing its own frontier language models.

In June 2025, Meta announced a $14.3 billion investment in Scale AI, acquiring a substantial minority stake while bringing Wang into a leadership role in its AI organization. The transaction reflected Zuckerberg’s growing concern that Meta needed a different strategy to compete with the industry’s leading developers.

It also represented an unusual recruitment decision. Rather than hiring an established frontier-model researcher to oversee the turnaround, Zuckerberg selected an entrepreneur whose experience centered on AI data infrastructure, business operations and large-scale execution.

The decision attracted skepticism, particularly because developing frontier AI systems requires expertise in model architecture, training methods, computing infrastructure and research management.

Wang would have to prove that his experience building an AI company could translate into leading one of the industry’s most ambitious research efforts.

Zuckerberg Gave Wang the Resources to Rebuild Meta’s AI Team

Zuckerberg Gave Wang the Resources to Rebuild Meta's AI Team

Wang’s appointment came as Meta was confronting difficult questions about its position in the AI race.

The company had established itself as an influential developer of open-weight models through its Llama family. However, competition intensified as OpenAI, Anthropic and Google released increasingly capable systems.

Meta needed to improve its model performance while developing AI products that could reach consumers and businesses.

Zuckerberg responded by reorganizing the company’s AI efforts around Meta Superintelligence Labs, with Wang at the center of the initiative.

The restructuring involved aggressive recruitment, substantial computing investments and a renewed focus on developing models capable of handling more complex tasks.

According to Fortune’s reporting on Zuckerberg and Wang, Meta assembled a core research team of fewer than 200 people, supported by larger infrastructure and product organizations.

The recruitment effort also intensified competition for experienced AI researchers, with Meta reportedly offering unusually large compensation packages to attract talent from rival laboratories.

For Zuckerberg, the strategy involved more than increasing the number of researchers. It meant placing responsibility for the company’s next generation of AI systems under a leader who could make decisions quickly and coordinate research with product development.

Wang received considerable freedom to shape that organization. The investment carried substantial financial risks. Frontier AI development requires expensive computing clusters, highly paid researchers and repeated training experiments that may not produce commercially useful results. Success was far from guaranteed.

ALSO READ: AI Talent War: Who is Actually Winning – OpenAI, Anthropic, Google, and Meta?

Muse Wonder Gives Meta Its Strongest Evidence of Progress

The launch of Muse Wonder provided the clearest public evidence yet that Meta’s restructuring was producing more capable AI systems.

In its official October 12 announcement, Meta described Muse Wonder and Muse Wonder Full as its most capable models, with particular strengths in complex tasks involving AI agents, coding and professional work.

The company says the models can help users complete activities such as understanding legal documents, working through insurance claims, analyzing financial information and building software applications.

Two features are central to Meta’s approach. Active Memory allows an AI system to retain relevant information across conversations and use that context when responding to later requests.

Active Focus is intended to help an AI agent continue working through difficult tasks, recover from errors and try alternative approaches instead of stopping when its first attempt fails.

Together, these capabilities reflect Meta’s ambition to move beyond chatbots that respond to isolated questions.

The company wants AI systems that can remember context, understand longer-term objectives and complete multistep tasks on behalf of users.

According to Meta’s technical research announcement, the models were trained using infrastructure at its Prometheus data center.

Muse Wonder is available through the Meta Model API and Muse Code, while the larger Muse Wonder Full model is available to Muse Code subscribers.

Meta also plans to incorporate Muse Wonder into its consumer-facing Muse assistant, beginning with paid subscribers.

That distribution strategy could become a significant advantage. Unlike smaller AI developers that must build audiences from scratch, Meta already operates some of the world’s largest consumer technology platforms.

However, access to billions of users does not automatically guarantee that its AI products will outperform competing services.

ALSO READ: Meta’s New Muse AI Agent Can Send Emails, Book Travel and Make Payments

Can Muse Wonder Really Compete With OpenAI and Anthropic?

Meta’s latest models have strengthened its competitive position, but the extent of the improvement requires careful interpretation.

The company has published benchmark results suggesting that Muse Wonder and Muse Wonder Full can match or outperform rival models on selected tasks.

In an interview with Axios, Wang described the systems as competitive with leading frontier models, particularly for personal and professional AI agents. Independent evaluations offer a more measured assessment.

As reported by Fortune, Muse Wonder Full has performed at a level comparable to some leading models from OpenAI and Anthropic, although it has not consistently surpassed the strongest competing systems. That distinction matters.

AI benchmark performance can vary considerably depending on the tasks being measured. A model that performs well on coding or agentic workflows may be less competitive in scientific reasoning, general knowledge or other specialized applications.

Meta’s progress therefore does not establish that it has overtaken OpenAI or Anthropic across the board.

What the launch demonstrates is that Meta has developed models capable of competing more seriously in a market where it previously struggled to establish clear leadership. For Wang, that is an important achievement.

His appointment was controversial partly because he lacked the conventional research credentials associated with leading frontier AI laboratories. Muse Wonder provides evidence that his approach to assembling teams and managing development can produce meaningful technical results.

Whether Meta can sustain that progress through successive model generations remains an open question.

Meta’s AI Comeback Is Already Extending Beyond Muse Wonder

Meta's AI Comeback Is Already Extending Beyond Muse Wonder

Meta’s recent progress is also creating opportunities for partnerships that would have appeared unlikely during its earlier disputes with other technology companies.

On October 15, Meta announced a collaboration with Apple to make its new Muse Spark Open model run on high-end Mac Studio computers.

The partnership is particularly notable because Apple and Meta have spent years disagreeing over privacy policies, platform restrictions and competing hardware strategies.

According to the Financial Times report on the Apple-Meta collaboration, the companies worked together to optimize Meta’s open-weight model for Apple’s hardware.

Meta’s research announcement for Muse Spark Open identifies it as an 816-billion-parameter model designed for coding, reasoning and AI agent tasks.

The collaboration allows developers to run a highly capable model locally using multiple Mac Studio computers rather than relying entirely on cloud infrastructure.

It also illustrates how Wang’s responsibilities extend beyond model development. Meta must persuade developers, hardware manufacturers and enterprise customers to adopt its AI technology.

Partnerships such as the one with Apple could help Meta expand its influence even in areas where it does not directly control the hardware or software platform.

Wang’s Biggest Challenge Is Still Ahead

Muse Wonder has changed the conversation around Meta’s AI strategy, but it has not settled the larger question of whether the company can turn its enormous investments into a sustainable competitive advantage.

Building a frontier AI model is expensive. Maintaining a leading position requires continuous improvements in training, computing efficiency, product reliability and research capabilities. Meta also faces challenges that extend beyond technical performance.

Its personal AI agents may need access to private messages, calendars, financial information and other sensitive data to perform useful tasks. That raises questions about privacy, security and how much autonomy users should give such systems.

The company says Muse Wonder includes safeguards intended to prevent unauthorized disclosure of personal information and resist harmful instructions. Those protections will need continued scrutiny as the technology reaches more users. There is also the question of commercial returns.

Meta has substantial advertising revenue and an established consumer audience, giving it resources that many AI startups lack. But investors will eventually want evidence that its AI spending produces meaningful financial benefits. For Wang, the pressure is especially significant.

He is no longer simply the young founder who built a valuable data-labeling company. He now oversees a central part of Meta’s long-term technology strategy, with responsibility for helping one of the world’s largest companies compete in an industry where leadership can change quickly.

The latest model releases have strengthened his position and provided Zuckerberg with evidence that the restructuring was worthwhile. They have also raised expectations for what comes next.

Meta has demonstrated that it can build AI models approaching the performance of leading competitors. The harder challenge will be turning that progress into products people consistently use, developers choose to build upon and businesses are willing to pay for.

Wang has helped put Meta back into the AI race. Whether he can keep it there will depend on what his team delivers after Muse Wonder.

Posted in AI News | Tagged | Leave a comment

Brazilian Man Travels 1,900 Km to Meet AI Girlfriend but Discovers She Is Fake

A 49-year-old Brazilian man sold all his belongings and travelled nearly 1,900 kilometres to meet his dream woman. But when he arrived, he discovered that the woman was an AI-generated character, not a real person.

Edimar Martins, a bricklayer from Maranhão in northeastern Brazil, travelled to Belo Horizonte, the capital of Minas Gerais, after becoming emotionally attached to a social media profile featuring a woman named Jessica Oliveira, also known as Jessica Fazendeira.

Martins told local broadcaster TV Mirante that he first came across the account in 2020. The profile reportedly had more than 300,000 followers and featured videos of a woman living on a farm. In the videos, she appeared to offer men a place to stay and financial support if they agreed to live with her.

Martins had been dealing with loneliness following his mother’s death and believed the woman could help him begin a new chapter in his life. One of the videos reportedly showed the character promising financial assistance and offering him a home on her farm. Believing he had found someone he could build a future with, Martins decided to travel to meet her in person.

ALSO READ: Why Are Men Using AI Girlfriends?

Brazilian Man Travels 1,900 Km to Meet AI Girlfriend, Discovers She Isn’t Real

According to the New York Post, Martins sold his belongings on October 9 to pay for his trip to Belo Horizonte. He travelled by bus for more than a day and reached the city on October 11.

He carried photographs of the woman and asked people if they knew who she was. However, no one could help him find her.

Martins later turned to a local radio station for help. It was there that he discovered the truth. The woman he wanted to meet was an AI-generated character, and no real person was behind the social media profile.

The revelation left Martins heartbroken. He had sold his belongings, spent his money and travelled nearly 1,900 kilometres, hoping to find a partner.

“It only brings sadness, discouragement, and depression. Many people wanted to find a relationship, so I came,” Martins said.

Creator Confirms Woman Was an AI-Generated Character

Creator Confirms Woman Was an AI-Generated Character

The person behind the social media account later admitted that the woman in the videos was created using artificial intelligence (AI). The creator said they had never spoken to Martins through the account. They also explained that the character was made to attract attention and generate business opportunities.

“I came here to state the obvious: I am made of artificial intelligence. I have never spoken to anyone with this profile,” the creator said.

The creator also denied inviting Martins to Belo Horizonte or planning to meet him, saying the situation had come as a surprise.

The incident shows how AI-generated characters can appear real on social media. Realistic videos and personal stories can make it difficult for viewers to tell whether they are looking at a real person or a computer-generated character.

For people looking for love online, this can create confusion, especially when an account does not clearly state that its photos or videos have been created using AI.

ALSO READ: AI Relationship Statistics: How AI Is Changing Dating

Brazilian Man Seeks Help After Discovering His AI Girlfriend Was Fake

After learning that the woman he wanted to meet did not exist, Martins was left stranded in Belo Horizonte with little money to return home. He approached local authorities for help. Social workers reportedly gave him food, access to shower facilities and a bus ticket so he could leave the city.

Despite the disappointment, Martins has not given up on finding a partner. He is now staying with a family member and hopes to return to Belo Horizonte to find someone with whom he can share his life.

“I didn’t find her, but I’ll find another one, and it will be in the same place I went, and I’ll go again,” Martins said.

Martins’ experience ended very differently from what he had expected. He had travelled a long distance hoping to find love, only to discover that the woman he had become attached to was an AI-generated character.

Martins is the third man in less than six months to travel to Belo Horizonte hoping to meet a woman who turned out to be AI-generated. This shows the risks of AI-generated people on social media. Realistic images and videos can make fictional characters look like real people, leading followers to believe their stories are genuine.

Posted in AI News | Leave a comment

AI Nude Apps Are Creating a Deepfake Crisis in Schools

AI-generated deepfake nudes are becoming a growing concern in schools. Students can use AI platforms to turn ordinary photos of their classmates into fake nude images. They can then share these images through messaging apps and school groups. For the students targeted, this can lead to embarrassment, fear and a serious invasion of privacy.

A joint investigation by WIRED and Indicator documented 88 cases involving AI nudification tools across 28 countries, affecting 640 students. These incidents highlight the need for schools to strengthen their efforts to protect students from AI-generated sexual abuse.

In many cases, schools face difficulties investigating incidents, helping affected students and deciding how to deal with those responsible. The situation becomes more difficult as AI tools make it easier to create fake nude images without advanced technical skills.

This makes deepfake abuse more than a problem of how students use AI. It also raises questions about who is responsible for protecting children. Schools, technology companies and governments must also decide how to respond when these tools are used to harm students.

AI Deepfake Nudes of Students Are Not a Harmless Prank

AI Deepfake nude images of students should not be dismissed as jokes or harmless teenage behavior. When someone uses AI to create fake nude images of a classmate without their consent, the consequences can be serious.

Although the images are fake, the harm to the person targeted is real. Students may feel ashamed, anxious or exposed when they learn that someone has created or shared sexual images of them. They also lose control over how their faces and bodies are shown to others.

The impact can last long after the images first appear online. Victims may worry about who has seen the images, whether others have saved them or if they will be shared again in the future. Some students may find it difficult to face their classmates or feel safe at school.

The person creating these images may think it is a joke or a way to impress friends. But the student targeted has little control over who sees the images or how far they spread. This difference makes the situation even more distressing for victims.

Schools must take these incidents seriously instead of treating them as ordinary arguments between students. Creating or sharing sexual images of classmates without their consent should prompt a proper investigation and support for the students affected, even when AI has been used to make the images.

An image does not have to be real to cause real harm. Using AI to create fake nude images of someone without their consent can violate their privacy and dignity. Calling it a prank does not make the behavior acceptable.

AI Deepfake Nudes Have Affected at Least 640 Students Across 28 Countries

A joint investigation by WIRED and Indicator found 88 publicly reported cases of AI-generated sexual abuse involving school communities across 28 countries. At least 640 students were affected. The cases date back to 2023 and include incidents in which students allegedly used AI nudification tools to create fake nude images of their classmates.

North America had nearly 30 reported cases, while Europe recorded more than 20. South America had more than 10 cases, and Australia and East Asia together accounted for around a dozen more.

However, the actual number of cases could be much higher. The investigation used publicly available reports, so it may have missed cases dealt with privately by schools or police. Language barriers and limited media coverage in some countries may also mean that many cases were never reported publicly.

AI Nudification Tools Are Making Deepfake Abuse Harder to Stop

AI Nudification Tools Are Making Deepfake Abuse Harder to Stop

AI tools have made it much easier to create fake nude images. People who once needed image-editing skills can now use apps, websites and bots to produce sexual images from ordinary photographs.

This creates a serious problem for schools. Students do not need to build their own AI tools or understand how the technology works. In some cases, they only need a photo of a classmate and access to a service that can turn it into a fake nude image.

The problem can grow once an image is created. Students may share it in group chats or post it on social media. Others can save copies and spread them further, making it difficult to control where the images end up.

Telling students to be more careful about the photos they post online will not solve the problem. It shifts the responsibility onto potential victims instead of addressing the people who create and share these images without permission.

Girls should not have to stop posting photos, avoid school events or leave social media because someone might misuse their pictures. They should be able to share ordinary photographs without fearing that someone will turn them into fake nude images.

The responsibility lies with those who create and spread these images, as well as the companies that provide these tools. Technology companies need stronger safeguards to prevent misuse, while schools must take reports seriously and help protect affected students.

ALSO READ: AI Has Made Fake Nude Abuse Easier to Scale, New Berkeley Report Warns

Schools Need a Clear Plan to Handle AI Deepfake Abuse

Schools respond differently to AI deepfake abuse cases. Some incidents lead to police investigations or disciplinary action. In other cases, parents say school officials have not taken their complaints seriously.

Such differences can leave students wondering whether reporting an incident will make any difference. They may also give other students the impression that creating or sharing fake nude images is not a serious offence.

Schools need clear rules for handling these cases. Staff should know what to do when a student reports abuse, how to keep evidence safe and when to involve parents, child protection services or the police.

Protecting the student targeted by the abuse must also be a priority. They should not have to explain what happened repeatedly to different staff members or face unwanted questions from classmates. Schools must also ensure that victims are not blamed, punished or made to miss classes because of the incident.

Teachers and school administrators need proper training to recognise AI-generated sexual abuse and understand how these images can spread. They should know how to respond to reports, protect students’ privacy and provide support without making the situation more difficult for the victim.

Schools should also teach students about the harm caused by creating or sharing sexual images of others without their permission. Students need to understand that using AI to create these images does not make the behaviour acceptable and that it may have legal consequences.

However, simply warning students about the risks will not be enough. Schools need reliable ways to report abuse, staff who know how to handle complaints and a clear plan to protect students when an incident occurs.

Social Media Platforms and AI Companies Must Take Responsibility

Schools often have to deal with the damage caused by abuse that starts or spreads online. This means AI companies and social media platforms also have a role to play in protecting students.

AI companies should take steps to stop their tools from being used to create sexual images of real people without their consent, particularly children. They also need to address attempts to get around these safeguards and make it easy for users to report harmful content.

Social media platforms have a separate responsibility to act when someone reports a fake nude image. Removing the original post may not be enough if other users have already saved the image and shared it elsewhere. Platforms need ways to limit its further spread and respond to reports without unnecessary delays.

Some laws are beginning to address this problem. In the United States, the TAKE IT DOWN Act requires covered platforms to offer a way to report nonconsensual intimate images, including AI-generated images. After receiving a valid request, platforms must remove the reported content and known identical copies within 48 hours.

The law is an important step towards protecting victims, but removing images after they appear online cannot prevent every case of abuse. Schools, parents and technology companies still need to work on prevention and respond when incidents occur.

AI companies should not wait until someone becomes a victim before reviewing the risks of their products. They need to build safeguards into their services from the start and take action when those protections fail. Preventing the misuse of AI should be a basic responsibility, not something companies address only after harm has occurred.

ALSO READ: Meta Says Its AI Caught 97% of Child Exploitation Content Before User Reports

Protecting Students Takes More Than Banning AI Tools

Banning AI tools in schools may seem like a simple way to prevent deepfake abuse, but it will not solve the problem on its own. Students can still access these services outside school, and fake nude images can spread through personal phones, social media and private messaging groups.

A better approach is to focus on preventing abuse, holding those responsible accountable and supporting the students affected.

Schools need clear rules against creating and sharing fake sexual images of classmates. They should also provide safe, confidential ways for students to report incidents. Students must understand that using AI to create these images without consent can hurt others and may have serious consequences.

Parents also have a role to play. Talking to children about consent, responsible online behaviour and the harm caused by sharing intimate images without permission can help them understand why this behaviour is unacceptable.

Governments need to ensure that laws protect people whose images are misused and give victims a way to seek help. AI companies and social media platforms must strengthen their safety measures and respond quickly when abuse is reported. Schools, in turn, should make sure that students who report these incidents receive support instead of being blamed for what happened.

There is no single solution that can stop every case of AI deepfake abuse. However, schools, parents, governments and technology companies can work together to prevent harm, hold those responsible accountable and help victims get the support they need.

Protecting Victims Must Come First in AI Deepfake Cases

Protecting Victims Must Come First in AI Deepfake Cases

AI-generated deepfake nudes have exposed how difficult it can be for schools and other institutions to keep up with new technology and deal with the harm it can cause.

The technology may be new, but using images to shame, threaten or hurt someone is not. AI has made it easier to create fake sexual images, while many schools are still figuring out how to handle these cases.

The reported incidents across dozens of countries show that this is not just a problem affecting a few schools. The available data only includes those cases that have become public, so many incidents may go unreported or remain unknown.

Students should not have to stop sharing photos or avoid social media to protect themselves from this abuse. They should also not be expected to fight for justice on their own while dealing with the emotional impact of what happened.

Schools need a clear plan for handling these incidents before another student becomes a victim. AI companies must take steps to prevent the misuse of their tools, and social media platforms need to act quickly when harmful images are reported.

The main goal should not be how quickly a school deals with public attention after an incident. It is whether the school protects the student, holds those responsible accountable and takes steps to stop the same thing from happening again.

Posted in AI News | Leave a comment