TikTok has deleted 20 accounts after a BBC inquiry that revealed a troubling trend of artificially created black female avatars being used to encourage users to engage with sexually explicit content. The social media platform took action after the BBC and researchers from the independent AI publication Riddance identified numerous accounts across Instagram and TikTok displaying highly sexualised digital characters with exaggerated proportions and darkened skin tones. The accounts, which were not labelled as AI-generated in clear violation of platform policies, employed racist tropes in their naming conventions and promotional language. Whilst TikTok has acted swiftly, Meta, Instagram’s parent company, said it was investigating but has failed to confirm taking similar action against the accounts operating on its platform.
The Revelation: Numerous Misleading Accounts
The BBC’s investigation, conducted in collaboration with Riddance researchers Jeremy Carrasco and Angel Nulani, revealed a complex scheme operating across numerous platforms. The team discovered 60 accounts mainly found on Instagram that held links that directing users to commercial adult content on external sites. Notably, whilst these third-party sites labelled the imagery as AI-generated, the Instagram accounts themselves offered no comparable clarification, creating a deliberate deception for unaware individuals. The research revealed an significantly broader network of comparable profiles across both Instagram and TikTok that did not link to commercial material, indicating the problem extends far beyond commercial exploitation.
The accounts employed a calculated strategy to escape notice and build followings rapidly. The vast majority of accounts were concentrated on Instagram, with around one in three also operating accounts on TikTok. Account names deliberately invoked race-related terms, featuring words like “black”, “noir”, “dark” and “ebony”, paired with content advancing stereotypical depictions and sexualisation. A significant number of accounts maintained connections to each other, forming a coordinated web that increased their visibility and online presence. This systematic pattern indicates deliberate coordination rather than individual cases, highlighting critical issues about the scale and sophistication of the operation.
- AI avatars displayed distorted physical proportions and artificially darkened skin tones
- Account names contained racially charged language and stereotyped characterisations about white men
- Videos were unlabelled as AI-created, contravening platform guidelines
- Many accounts engaged in mutual following, forming interconnected networks for reach enhancement
Abuse Through Artificial Generation
Stolen Content and Technological Distortion
The examination uncovered a deeply troubling aspect to the enterprise: the wholesale theft of creative work from genuine creators. One channel that gathered three million subscribers within weeks of its December launch had systematically appropriated content from real people, most notably Malaysian model Riya Ulan. The offenders superimposed the artificial avatar’s face—displaying an darkened skin tone—onto Riya’s body, precisely duplicating her actions, clothing and background settings. This flagrant act of digital theft exacerbated the original exploitation, transforming genuine creative work into fuel for fraudulent accounts.
Riya’s experience illustrated the individual harm fundamental to such methods. After learning her videos were appropriated and redistributed, she communicated her frustration to the BBC: “I was upset. Of course my videos are widely distributed… It doesn’t mean that you can grab it and repurpose it and share it as your own.” Her concern exposes a major weakness in safety measures, where content makers need adequate safeguards against their images being stolen for fake profiles. The case shows how AI technology can amplify present dangers, allowing malicious users to scale their exploitation across many creators at once.
The misuse extended beyond basic content piracy. Accounts intentionally created synthetic characters employing exaggerated appearance traits and synthetically modified skin tones to produce eye-catching, visually arresting material intended to drive interaction. These digital constructs were presented as genuine content creators, complete with fabricated backstories and personalities, whilst simultaneously reinforcing damaging ethnic prejudices and sexualised stereotypes. The intricacy of the manipulation meant many users consumed the posts believing they were engaging with genuine individuals, not automated creations engineered to funnel engagement toward exploitative paid content.
- Avatar’s face superimposed over pirated content from genuine content creators
- Artificially darkened skin tones and exaggerated features created for engagement
- Accounts positioned as authentic influencers with false backgrounds and identities
Racist Depictions and Damaging Stereotypes
The accounts uncovered by the BBC and Riddance researchers exhibited a troubling pattern of racist abuse through their intentional account names and messaging. Account identifiers included terms such as “black”, “noir”, “dark” and “ebony”, whilst posts consistently displayed racialized commentary and fetishizing content. Many featured comments such as “loves white men” and “why I need a white guy in my life”, sustaining racist tropes and reducing Black women to sexualized objects. This communicative structure converted the accounts into dehumanized depictions, reinforcing centuries-old racist tropes that objectify and strip of humanity Black femininity.
The graphic depiction intensified these language-based injuries. The avatars were consistently depicted in exposed swimming attire and skimpy clothing, their bodies algorithmically altered into exaggerated proportions created to enhance engagement through sexualisation. Skin tones were synthetically deepened to produce a fabricated, near monstrous look that had scant similarity to genuine human diversity. This mix of distorted characteristics, revealing attire and synthetically altered characteristics created algorithmic stereotypes that operated like contemporary racist performance, transforming racist imagery into computational material designed for widespread distribution and financial gain.
Why AI Magnifies the Problem
Artificial intelligence technology has fundamentally transformed the scale and sophistication of racist exploitation online. Previously, such harmful content demanded considerable effort and manual effort to produce; AI generation democratises the creation of racist caricatures, enabling bad actors to produce hundreds of convincing fake accounts at minimal cost. The technology’s ability to create photorealistic imagery imparts unwarranted credibility to racist tropes, making them appear credible to unsuspecting users. This technological advantage transforms what might have been fringe exploitation into a widespread, lucrative enterprise.
The algorithmic structure of social media platforms amplifies these harms exponentially. AI-generated content optimised for engagement—particularly content that leverages racial and sexual stereotypes—proliferates quickly through algorithmic distribution mechanisms built to maximise user interaction. Platforms struggle to moderate the sheer volume of AI-generated content, whilst the absence of required transparency markers means users are unable to differentiate authentic creators from algorithmic constructs. This creates an environment where racist stereotypes proliferate unchecked, obscured by the veneer of digital advancement and framed as entertainment rather than exploitation.
Platform Responsibility and Accountability
| Platform | Action Taken |
|---|---|
| TikTok | Banned 20 accounts following BBC investigation; removed AI-generated black female avatars driving users to sexually explicit content sites |
| Parent company Meta stated it was investigating but had not confirmed taking action at time of BBC publication; dozens of accounts remained operational | |
| Both platforms | Failed to implement mandatory AI disclosure labels, breaching their own guidelines requiring identification of artificially generated content |
TikTok’s swift action in removing 20 accounts demonstrates a rare example of platform action, yet it emphasises the reactive nature of content management in the digital age. The removals occurred only after ongoing media investigation and public backlash, indicating that in the absence of external investigation, these accounts would have continued operating unchecked. Notably, TikTok’s response was confined to one platform, whilst numerous problematic accounts sustained active accounts on Instagram, where they continued harvesting followers and sending users to harmful third-party platforms. This piecemeal strategy demonstrates the insufficiency of isolated platform measures to widespread challenges.
Meta’s assertion that it is investigating, paired with its refusal to communicate tangible measures, exposes the disconnect between company accountability claims and actual implementation. The company’s delayed response contrasts sharply with the pressing need to tackle swiftly spreading damaging material. Both platforms have established guidelines stipulating the announcement of AI-generated imagery, yet these rules remained unenforced across vast numbers of user accounts. This implementation shortfall points to the reality that without legislative action and juridical responsibility, platforms will keep favouring user engagement and ad income over user safety and the defence of disadvantaged populations from coordinated abuse and discriminatory content.
Extended Implications for Digital Authenticity
The rapid growth of unidentified AI-generated material on leading social networks raises key questions about online integrity and user trust. As AI technology becomes increasingly sophisticated, telling apart genuine human creators and artificial personas becomes significantly harder for ordinary users. This loss of genuineness undermines the foundational premise upon which online communities are built—the assumption that accounts represent actual individuals posting authentic content. When millions of users interact without realising with artificial identities designed to exploit them, the platforms’ credibility as reliable platforms for connection deteriorates significantly. The absence of mandatory disclosure mechanisms deliberately misleads users and compromises conscious agreement.
Beyond personal deception, the widespread deployment of artificially created black female avatars constitutes a particularly insidious exploitation of racial representation in online environments. These synthetic personas weaponise harmful stereotypes and hypersexualised racial tropes whilst simultaneously appropriating authentic creators’ work and intellectual property. The practice reinforces the commodification of black femininity within algorithmic systems designed to maximise engagement and profit. This technological racism operates at scale, affecting vast populations whilst staying largely undetected to content moderation departments. Without robust regulatory structures mandating transparency, verification protocols, and meaningful consequences for violations, online platforms will keep enabling systematic harm against marginalised communities.
- AI disclosure requirements should be legally enforceable on every platform worldwide
- Authentication systems ought to validate creator authenticity before monetisation or follower accumulation
- Racial discrimination within AI-generated content requires clear bans with continuous identification
- Platforms should establish live monitoring systems with penalties aligned to content seriousness