Skip to main content

Is this the end of deepfakes? | TechScape

How the UK's online safety bill aims to clean up the internet

How the UK's online safety bill aims to clean up the internet | Technology | The Guardian

Support the Guardian

Fund independent journalism

TechScape

How the UK's online safety bill aims to clean up the internet

It's complicated, contentious and sweeping. As the landmark legislation becomes law, here's a guide to its key rules on everything from pornographic content to protecting children

Don't get TechScape delivered to your inbox? Sign up here

Picture of a young boy staring at a mobile phone in the dark
The online safety bill will, in part, attempt to protect children from harmful internet content, and will be regulated by Ofcom. Photograph: Leon Neal/Getty Images

Deepfakes, viral online challenges and protecting freedom of expression: the online safety bill sprawls across many corners of the internet and it's about to become official. The much-debated legislation is due to receive royal assent, and therefore become law, imminently.

The purpose of the act is to make sure tech firms have the right moderating systems and processes in place to deal with harmful material. "This means a company cannot comply by chance," says Ben Packer, a partner at the law firm Linklaters. "It must have systems and processes in place to, for instance, minimise the length of time for which illegal content is present."

Packer adds that if those systems and processes are deemed to be not up to scratch, platforms could be in breach of the act. "Even if a platform has no illegal content present on its service, it could still be in breach of the legislation. Likewise, the mere fact that illegal content does appear on a service does not mean it is necessarily in breach."

The act is complicated and, as you will see below, contentious.

The duties under the bill

The bill is based on three fundamental duties: protecting children; shielding the public from illegal content; and helping adult users avoid harmful – but not illegal – content on the biggest platforms.

A company is within the scope of the bill if it distributes user-generated material to other users or is a search engine. So it will cover an array of platforms, from X to Facebook, Instagram, YouTube and TikTok as well as Google.

To comply with those child and illegal content duties, companies will have to carry out risk assessments on whether that content appears on their service.

All of this will take place under the oversight of communications regulator Ofcom, which will issue guidance on what content to focus on preventing and the systems needed to deal with it. Companies can adhere to Ofcom's codes of practice for dealing with this content or come up with their own methods of dealing with such material.

But the bill makes clear that if they follow the code of practice, they won't be in danger of breaching relevant sections of the act. According to the act, they'll be "treated as complying with a relevant duty if the provider takes or uses the measures described in a code of practice".

In a nod to concerns about the bill being a "censor's charter", all companies within scope have a duty to protect "users' right to freedom of expression" and their privacy.

Protecting children

The government messaging about the legislation has focused on protecting children. There are two categories of content harmful to children that tech firms must deal with. The first one is "primary priority content", such as pornography and the promotion of suicide and eating disorders (albeit below the threshold of criminality). If sites allow such content, children must be prevented from encountering it and the act expects age-checking measures to be used for this – measures that either target specific pieces of content or cover a specific section of a platform.

The second type is "priority content" such as bullying and posts that encourage children to take part in dangerous stunts or challenges. Children in age groups judged to be at harm from such content – an area where risk assessments will be key – must be protected from encountering this kind of material. Ofcom will set out the steps for doing this in a code of practice that it will draw up.

Illegal content

The act lists a number of criminal offences that constitute "priority illegal content", which means companies within the scope of the bill need to have systems and processes in place to prevent users from encountering such material.

Those priority offences include: child sexual abuse material; terrorist content; revenge or extreme pornography; and threats to kill. The act wants this sort of content to be proactively targeted by platforms' moderation systems and processes.

There are new criminal offences in the act. People who use social media posts to encourage self-harm face criminal prosecution under a new offence introduced by the bill that covers England and Wales. The act will also criminalise the sharing of pornographic "deepfakes" – images or videos manipulated to resemble a person.

Protecting adults from harmful content

This applies to "category one" firms, or platforms with the largest reach and greatest influence over public discourse. So you would expect it to apply to the likes of Facebook, Instagram, Google and TikTok. But after a late change to the bill, it could also apply to niche but risky sites like the rightwing-favoured platform 4chan.

Once the list of category one sites platforms is drawn up by the secretary of state, those companies will have to give adult users the ability to avoid certain kinds of content if they wish to do so.

The sort of content platforms need to protect users from – if the user wishes – is listed on the act: material related to suicide, self-harm and abuse targeted at protected characteristics under the Equality Act (such as age, race and sex). Platforms need to assess how much of that content is on their platforms and put in place a way of shielding users from that content.

So this is not a case of clicking a button on these platforms and all the bad stuff goes away. Platforms will need to offer features that, for example, allow users to avoid abuse. This could be an option to consent to someone following you, or a warning screen appearing for certain content or muting certain words. Many platforms offer these sorts of measures already – but now Ofcom is watching.

Further duties for category one firms include protecting journalistic content and "content of democratic importance".

Pornography

Under the new rules, pornography sites much use age checks.
Under the new rules, pornography sites much use age checks. Photograph: NurPhoto/Rex/Shutterstock

Sites that offer pornographic content must use age-verification measures (jargon for age checks) or age-estimation technology (where you send a selfie to the platform and it gauges whether you are the age you say you are) to ensure users are over 18. This obviously applies to sites like Pornhub and to user-to-user platforms that allow sexual content, like OnlyFans (which already has an over-18 age policy). Sites that are not dedicated pornography services but still allow sexual content, like X, will be expected to apply age-verification or estimation measures either to specific content or a specific section of their service.

Ofcom will provide guidance on what are the most effective forms of age verification or age estimation.

End-to-end encryption

One of the most controversial elements of the bill is a provision on combating child sexual abuse material (CSAM), which empowers Ofcom to order a messaging service to use "accredited technology" to look for and take down such content.

Privacy campaigners and tech firms have warned that the clause poses a fundamental threat to end-to-end encrypted messaging – where only the sender and recipient can read the message – because it could require the scanning of private messages.

In a bid to head off a threatened exodus, the government said in September that Ofcom would only be able to intervene if scanning content was "technically feasible" and if the process met minimum standards of privacy and accuracy. Some observers took this as a climbdown but the government has not changed the wording of the bill, so this still feels like a very live issue with the legislation.

Criminal liability for tech executives

Tech executives face the threat of a two-year jail sentence if they persistently ignore Ofcom enforcement notices telling them they have breached their duty of care to children. The government has stressed to jumpy tech execs that the new offence will not criminalise executives who have "acted in good faith to comply in a proportionate way" with their duties.

Senior employees could also be jailed if they hinder an Ofcom investigation or a request for information.

So what next? This is a complicated and wide-ranging piece of legislation, partly a reflection of the sprawling nature of the field it is trying to regulate. Ofcom – and tech platforms – are going to be busy.

The week in AI

Beyoncé's Halo is one of the songs mentioned in a case alleging that an AI company in the US unlawfully infringed copyright.
Beyoncé's Halo is one of the songs mentioned in a case alleging that an AI company in the US misused song lyrics. Photograph: Kevin Mazur/WireImage for Parkwood

The wider TechScape

Amazon is planning to get drones to deliver parcels in the UK and Italy.
Amazon is planning to get drones to deliver parcels in the UK and Italy. Photograph: Getty Images
  • The sky's not the limit – Amazon is bringing drone delivery to British and Italian doorsteps.

  • Îœeanwhile, Ukraine is losing roughly 10,000 drones a month, the BBC reported, and fears shortages following restrictions on Chinese exports.

  • Elon's first year at Twitter, sorry, X – in 13 tweets.

  • Why you should care about advanced silicon chips. Really.

  • The headline says it all, confirming that app dating is just the worst: Tinder now lets mom pick your next date.

Advertisement

 

… there is a good reason why NOT to support the Guardian

Not everyone can afford to pay for news right now. That is why we keep our journalism open for everyone to read. If this is you, please continue to read for free.

But if you are able to, then there are THREE good reasons to support us today.

1

Our quality, investigative journalism is a scrutinising force at a time when the rich and powerful are getting away with more and more

2

We are independent and have no billionaire owner pulling the strings, so your money directly powers our reporting

3

It doesn't cost much, and takes less time than it took to read this message

Help power the Guardian's journalism for the years to come, whether with a small sum or a larger one. If you can, please support us on a monthly basis from just £2. It takes less than a minute to set up, and you can rest assured that you're making a big impact every single month in support of open, independent journalism. Thank you.

 
You are receiving this email because you are a subscriber to TechScape. Guardian News & Media Limited - a member of Guardian Media Group PLC. Registered Office: Kings Place, 90 York Way, London, N1 9GU. Registered in England No. 908396

Comments

Popular posts from this blog

A message from the Guardian's head of international news

Support our 24/7 global news coverage The Guardian   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ‌   ...

What are Threads and Bluesky really for? | TechScape

The Twitter alternatives need to figure out what they want to be Threads and Bluesky need to figure out what they want to be | Technology | The Guardian Threads and Bluesky need to figure out what they want to be The Twitter alternatives are gaining ground, and it wouldn't take much to steal X's crown as a news-sharing service • Don't get TechScape delivered to your inbox? Sign up for the full article here Bluesky, from former Twitter co-founder Jack Dorsey. Photograph: Jaap Arriens/NurPhoto/Shutterstock Josh Taylor @joshgnosis Every time Elon Musk does something bad, you can see an influx of new users to Bluesky – one of the many social media sites to pop up as a potential Twitter/X alternative. The platform, still invite-only, has more tha...