Instagram Tightens Oversight of AI-Generated Accounts

As users increasingly rely on generative AI tools to create content, the lines have begun to blur between what is real and what is artificial on social media platforms. In a move aimed at restoring some measure of transparency, Instagram has announced a new policy regulating how accounts based on entirely AI-generated personas are displayed, while imposing restrictions on accounts that hide this fact from their followers.

A Clearer New Label

The platform has decided to change the old label previously known as "AI Content Creator" to become "AI-Generated Account." Instagram says this new name is more direct and easier to understand, as it clearly informs users that the persona appearing in the account was created or largely made using AI tools, rather than being a real person of flesh and blood.

Penalties for Those Who Hide the Truth

The most prominent core of the new policy is linking an account's reach to its commitment to disclosure. Accounts that display fictional personas without clarifying this will see a decline in their reach to audiences, while users who comply by applying the correct label will not face any penalty simply because their accounts rely on artificial personas.

The platform clarified that this label is not required for every use of AI, but is limited to accounts whose focus is a generated persona. The following cases do not require the label:

• Editing and enhancing images using AI tools.
• Drafting or refining text and comments.
• Creating graphics and visual designs.
• Making minor creative edits to content.

Responding to User Concerns

This decision came partly in response to complaints from users who discovered that accounts they thought belonged to real people were in fact nothing more than entirely artificial personas. Instagram noted that people are not comfortable with the idea of interacting with an account that appears human, only to later find out that the displayed persona is the creation of algorithms, expressing their desire to know this in advance.

Alarming Examples Driving Regulation

This move gains particular importance amid the growing controversy over so-called "fake influencers" who have become increasingly widespread on social media platforms. Earlier this year, a journalistic investigation revealed a network of AI-generated male influencers promoting a certain app, with the investigation identifying more than twenty accounts following this pattern, some of which communicated directly with potential users to push them to sign up.

Health and wellness content is among the most dangerous areas in this context, as journalistic reports identified hundreds of accounts of doctors, therapists, and wellness figures entirely generated by AI, promoting dietary supplements or making health claims directed at users without any reliable scientific basis.

Within a Broader Context of Pressure

This announcement comes after a wave of criticism the platform faced over a tool that allowed users to generate images based on the features of other people, which sparked widespread objections to the use of public content without explicit consent, ultimately prompting the parent company to remove that feature.

These developments also coincided with the parent company reaching a settlement worth around $18 billion with a number of U.S. states, over allegations related to the two platforms' impact on children and teenagers. The settlement included new measures, most notably imposing a default daily usage limit for teenagers of no more than two hours, along with a "nighttime" mode, muting notifications during school hours, and other restrictions.

A Step Toward Digital Trust

These policies collectively reflect a growing awareness among major platforms that transparency is no longer an option but a necessity to maintain user trust in an era where AI is increasingly integrated into everyday content creation. The biggest challenge remains in Instagram's ability to enforce these rules effectively and detect violating accounts before they spread and mislead a wide audience.

✦ بقلم فريق دروب أيديا