YouTube has announced a clampdown on disturbing and inappropriate children’s videos, following accusations that the site enabled “infrastructural violence” through the long-run effects of its content recommendation system.
The new policy, announced on Thursday evening, will see age restrictions apply on content featuring “inappropriate use of family entertainment characters” like unofficial videos depicting Peppa Pig “basically tortured” at the dentist. The company already had a policy that rendered such videos ineligible for advertising revenue, in the hope that doing would reduce the motivation to create them in the first place.
“Earlier this year, we updated our policies to make content featuring inappropriate use of family entertainment characters ineligible for monetisation,” said Juniper Downs, YouTube’s director of policy. “We’re in the process of implementing a new policy that age restricts this content in the YouTube main app when flagged. Age-restricted content is automatically not allowed in YouTube Kids. The YouTube team is made up of parents who are committed to improving our apps and getting this right.”
Age-restricted videos can’t be seen by users who aren’t logged in, or by those who have entered their age as below 18 on both the site and the app. More importantly, they also don’t show up on YouTube Kids, a separate app aimed at parents who want to let their children under 13 use the site unsupervised.
But for the age restrictions to apply, the content does first have to be flagged for review by a normal user. The content is then reviewed by what YouTube says is one of thousands of moderators working around the world.
YouTube Kids features a greatly restricted subset of videos available on the main site. That subset is not hand curated, however. Instead, it’s selected automatically, YouTube says, using machine learning and algorithms. If something slips through the net, it can again be flagged and reviewed by a specialist YouTube Kids team of moderators. The company says less than 0.005% of videos viewed in the Kids app were removed for being inappropriate in the last 30 days.
The question of what defines “inappropriate” content is still an open one. YouTube says videos that feature adult themes, including graphic violence, will be age restricted. But the company did not detail what exactly the line would be, nor provide examples of previously unrestricted videos which would now be flagged.
On Monday, in a widely-shared article, campaigning technology-focused artist and writer James Bridle detailed the vast industry of low-quality, algorithmically-guided children’s content created for youtube. “Someone or something or some combination of people and things is using YouTube to systematically frighten, traumatise, and abuse children, automatically and at scale, and it forces me to question my own beliefs about the internet, at every level,” Bridle wrote.
But as Bridle and others noted, defining what, precisely, renders a video such as “BURIED ALIVE Outdoor Playground Finger Family Song Nursery Rhymes Animation Education Learning Video” disturbing and upsetting in a way that a Tom and Jerry cartoon isn’t is hard, for algorithmic or human moderators.
YouTube says it has been working on the age restriction policy change since before it was accused of infrastructural violence against minors.