EU provides £1.8 million in financing for creation of new app intended to decrease internet viewing of child sexual abuse content

When installed on a device, such as a phone, the programme will recognise and prevent the display of offensive images and videos.

It’s believed that it will aid in reducing the "increasing demand" for photographs of child abuse.

Organizations from the EU and the UK have joined forces on the Protech project.

The project’s Salus app, which uses artificial intelligence to identify potentially pornographic information and prevent users from seeing it, is designed to operate in real-time.

The Internet Watch Foundation, an organisation that works to find, flag and remove child abuse material, will help to train the AI technology developed by the UK company SafeToNet.

Tom Farrell of SafeToNet, who worked for 19 years in law enforcement, told the BBC the app was not intended to be a tool to report users to the police: "People who are voluntarily looking to stop themselves seeing child sexual abuse material quite clearly wouldn’t use such a solution if they believe that it was going to report them to law enforcement."

’Practical aid’

Volunteers who download the app will be recruited via organisations working with individuals seeking help because they are drawn to online child abuse images.

One such organisation is British charity the Lucy Faithfull Foundation, which operates a helpline for those who fear they may download illegal images and wish to stop. That includes a significant number of people who admit to being paedophiles, some of whom have already been convicted..

The foundation’s Donald Findlater, said tools such as the new app could help individuals control their behaviour, adding: "it is a practical aid to people who recognise a vulnerability in themselves".

Members of the Protech project hope it could stem the "growing demand for child sexual abuse material online".

A new high of 30,925 offences that involved the possession and sharing of indecent images of children were committed in the year 2021/2022, according to the NSPCC.

Last year a report by the Police Foundation thinktank said that the volume of online child sexual abuse offences had "simply overwhelmed the ability of law enforcement agencies, internationally, to respond".

Project members who spoke to the BBC suggested that policing alone was not going to stop people downloading images.

Mr Farrell argues that the UK has arrested more individuals for possession of child sexual abuse material than any other country in the world since 2014 and in the process has identified some very serious offenders.

But millions of people still view images

"So arrest isn’t going to be the solution. We think we can work on the prevention side and reduce the demand and reduce the accessibility."

’Pilot stage’

Many details of the operation of the app still need to be worked out. No AI is perfect and a balance will need to be struck between over-blocking — which would make legitimate use of a device difficult — and under-blocking — which fails to detect many abuse images.

Mr Farrell says the app will be tested in a "pilot stage" in five countries — Germany, Netherlands, Belgium, the Republic of Ireland and the UK with at least 180 users over an 11-month period.

And experts not involved in the project think the idea has promise.

Professor Belinda Winder of Nottingham Trent University said it was a welcome development that could support people who "want to be helped to resist their unhealthy urges, and who would benefit from this safety net".

As with all new tech tools, the devil would be in the detail and Prof Winder had questions about how it would work in practice but said: "It is a positive step in the right direction."

Share this article: