RoomsLibraryToursPeopleCompareSourcesAbout
Gemini
Exit|2 of 4 in Facebook & Teen Well-Being
advertorialsocial·2021

Explore algorithm rabbit holes into anorexia

The Public RegisterOctober 2021
Nick CleggVP of Global Affairs, Facebook, CNN State of the Union Interview
Our algorithms are like giant mirrors reflecting human nature. Our systems work around the clock to detect and downgrade harmful content and connect teens with safe communities.
The Private Artifact2021
Instagram User Experience Researchersproduct safety audit, Internal Memo: 'Algorithms & Body Dissatisfaction'
Our Explore recommendations algorithm acts as a spiraling mechanism. Teens who search for diet tips are pushed into severe anorexia, restrictive eating, and self-harm loops within three sessions.
Exhibit: Haugen_Senate_Exhibit_B

The Split:Clegg framed the algorithm as a neutral mirror reflecting society back to itself. Facebook's internal audit proved the algorithm was an active accelerator that aggressively pushed vulnerable users into self-harm funnels.

The Tell (How to spot this next time):

The 'mirror' metaphor is used whenever a recommendation engine is caught maximizing engagement at the expense of user welfare.

whistleblower pipeFrances Haugen disclosures to SEC and Congress.