Snapchat’s Troubled Safety Record

Snap likes to position its Snapchat app as "an antidote to social media," claiming it was "designed to be safe" for kids. However, creating a platform with safety in mind and effectively ensuring it remains safe are two different things. This contrast is becoming painfully clear, as revealed by an unredacted complaint filed today by the New Mexico Attorney General.

The complaint, part of a lawsuit launched last month, unveils internal messages that show Snap’s staff were aware of the vast amount of child sexual abuse material (CSAM) circulating on Snapchat. Disturbingly, these messages indicate the company knew it wasn’t taking sufficient action to combat the issue.

This isn't the first time Snapchat’s safety measures have been called into question. In July, I reported on the company’s struggles to protect young users. Current and former trust and safety employees disclosed that Snap had knowledge of drug sales on its platform long before a high-profile teen death in 2021 sparked a “code red” response. Additionally, they revealed that the company received hundreds of reports of sextortion per day, months before they began addressing the problem.

The lawsuit uncovers even more damning evidence. In March 2023, Snap’s director of security engineering commented on a fix for users selling drugs or posting CSAM on the app: "that's fine, it's been broken for ten years, we can tolerate tonight." Another employee, frustrated with the ongoing issue of sextortion, vented in a private channel: "We've twiddled our thumbs and wrung our hands all f---ing year."

In January, Snap CEO Evan Spiegel sent a memo to employees stating, "We’re certainly far from perfect, but while our competitors are connecting pedophiles, fueling insurrection, and recommending terrorist propaganda, we know that Snapchat makes people happy." However, this memo may not have been the best message given the current revelations.

Snap’s challenges are undeniably complex, but the company has been slow to make the tangible changes needed. A Snap spokesperson responded by emphasizing the company’s ongoing work to evolve safety policies, leverage advanced technology, and collaborate with law enforcement.

Still, one quote from the complaint stands out: an internal email from Snap’s senior director of public policy international, who wrote in March 2022, "There's only so many times we can say 'safety-by-design' or 'we’re kind.' Politicians and regulators are looking for tangible substantive progress/initiatives." This statement highlights the growing need for Snap to back up its promises with real action.