X Cracks Down on Pakistan-Based AI War Video Network Spreading Misinformation

Elon Musk's social media platform X identified and dismantled a network of 31 accounts operated from Pakistan that were sharing AI-generated videos about the Iran conflict. The platform's head of product, Nikita Bier, stated the accounts were hacked and renamed to impersonate war monitors. In response, X announced a new policy suspending users from its revenue program for 90 days if they post AI-generated war content without a clear disclosure. This crackdown aims to preserve information authenticity during the ongoing West Asia conflict, which was triggered by US-Israel strikes.

Key Points: X Bans AI War Videos from Pakistan Operator, Tightens Rules

  • Pakistan operator ran 31 hacked accounts
  • AI-generated videos on Iran war spread misinformation
  • X imposes 90-day revenue bans for undisclosed AI content
  • Policy aims to ensure authentic info during conflicts
  • Network also impersonated "IDF Girl" accounts
3 min read

X exposes Pakistani operator running 31 accounts to share AI-generated Iran war videos

Elon Musk's X suspends a Pakistan-based network sharing AI-generated Iran conflict videos, announces 90-day monetization bans for undisclosed AI content.

"We are getting much faster at detecting this - and also eliminating the incentive to do this. - Nikita Bier"

Islamabad, March 6

Elon Musk-owned social media platform X has found a Pakistan-based operator handling 31 accounts to share AI-generated war videos on the ongoing conflict in Iran.

In a post, X's head of product, Nikita Bier said that the accounts were hacked and their usernames renamed to "Iran War Monitor" or some derivative on February 27.

"Last night, we found a guy in Pakistan that was managing 31 accounts posting AI war videos. All were hacked and the usernames were changed on Feb 27 to "Iran War Monitor" or some derivative. We are getting much faster at detecting this - and also eliminating the incentive to do this," Nikita Bier posted on X.

Bier mentioned that accounts on X were not only impersonating Iran-related monitors but also posed as several "IDF Girl" accounts which were also operated in Pakistan.

Replying to another post on X, Bier wrote, "In 99 per cent of cases, it's just people looking to game monetization. But to answer your question, yes we did a sweep of "IDF Girl" accounts that were run out of Pakistan recently. The only thing they care about is what gets impressions - not the political leaning."

In response, X announced tougher rules. Nikita Bier said that users who shared AI-generated videos of an armed conflict without adding a disclosure that it was made with AI will be suspended from Creator Revenue Sharing for 90 days. He stressed that it is important that people amid the war have access to authentic information from the ground.

"Today we are revising our Creator Revenue Sharing policies to maintain authenticity of content on Timeline and prevent manipulation of the programme. During times of war, it is critical that people have access to authentic information on the ground. With today's AI technologies, it is trivial to create content that can mislead people," Nikita Bier posted on X.

"Starting now, users who post AI-generated videos of an armed conflict - without adding a disclosure that it was made with AI - will be suspended from Creator Revenue Sharing for 90 days. Subsequent violations will result in a permanent suspension from the program. This will be flagged to us by any post with a Community Note or if the content contains meta data (or other signals) from generative AI tools. We will continue to refine our policies and product to ensure X can be trusted during these critical moments," he added.

The decision of X comes amid the ongoing conflict in West Asia which started after joint US-Israel strikes on Iran, aimed at degrading Tehran's missile capabilities and broader military infrastructure.

The opening wave of the operation killed senior figures in the Iranian leadership, including Supreme Leader Ayatollah Ali Khamenei, triggering a sweeping response from Iran in the form of drone and missile attacks targetting US assets, regional capitals and allied forces across West Asia.

- IANS

Share this article:

Reader Comments

S
Sarah B
The monetization angle is so cynical. Creating fake war videos for profit while real people suffer is despicable. The 90-day suspension is a good first step, but permanent bans should come faster.
P
Priyanka N
AI-generated content is becoming a huge problem. It's not just about Iran. We need global social media regulations. What stops the same operators from targeting Indian elections next? We must be vigilant.
R
Rahul R
Respectfully, while the policy is good, X's detection needs to be proactive, not reactive. The accounts were active from Feb 27. That's a lot of time for misinformation to spread. The platform's response time must improve.
A
Aman W
"IDF Girl" accounts run from Pakistan... says a lot about the nature of online influence ops. It's always about creating chaos and division. Hope our cyber agencies are taking notes.
K
Kavya N
As someone with family in the Gulf, this is terrifying. We rely on social media for updates during crises. Platforms have a responsibility to ensure what we see is real. This policy is a step in the right direction. 🙏

We welcome thoughtful discussions from our readers. Please keep comments respectful and on-topic.

Leave a Comment

Minimum 50 characters 0/50