Facebook reveals it will use AI to fact-check photos and videos for fake news


Facebook is expanding its fake news spotting systems to include photos and videos as part of its ongoing battle to halt the spread of misinformation on its service.

Following successful trials in France, India, and Mexico, the company said it will now roll-out the system in 17 countries worldwide in a bid to staunch what it has branded ‘misinformation in these new visual formats.’

The Artificial Intelligence (AI) system feeds potentially fake content to human fact-checkers, who use visual verification techniques such as reverse image searching and analysing image metadata to check the veracity of photos and videos.

Previously, the company’s efforts to tackle misinformation had been focused on rooting out false articles and webpage links.

Russian agents and other malicious groups seeking to influence democratic elections in the US and elsewhere have repeatedly used images and video.

These carry more visual appeal than text or false articles and are also harder to spot using fake news tracking software, which typically hunts for keywords in text.

Facebook said it has been testing the image fact-checks since the spring, beginning with a trial alongside French news agency AFP.

Now, it will send disputed photographs and videos to 27 fact-checking organisations in 17 countries to verify the flagged content.

The company has remained tight-lipped on the criteria it employs to evaluate photos and videos and how much an image can be edited before it is ruled fake.

Antonia Woodford, product manager at Facebook, said: ‘People share millions of photos and videos on Facebook every day.

‘We know that this kind of sharing is particularly compelling because it’s visual.

‘It also creates an easy opportunity for manipulation by bad actors.

‘We have built a machine learning model that uses various engagement signals, including feedback from people on Facebook, to identify potentially false content.

‘We then send those photos and videos to fact-checkers for their review, or fact-checkers can surface content on their own.’ 

She said Facebook’s fact-checkers and algorithms are searching for three types of fake news commonly spread through images and video.

These include content that has been ‘manipulated or fabricated’, used out of context, or combined with text or audio that makes false claims.

Fact-checkers use visual verification techniques, such as reverse image searching and analysing when and where the photo or video was taken.

The teams combine this research with research from experts, academics and government agencies, Facebook claimed.

‘As we get more ratings from fact-checkers on photos and videos, we will be able to improve the accuracy of our machine learning model,’ Ms Woodford said.

‘We are also leveraging other technologies to better recognise false or misleading content.

‘For example, we use optical character recognition (OCR) to extract text from photos and compare that text to headlines from fact-checkers’ articles.

‘We are also working on new ways to detect if a photo or video has been manipulated.’ 

Russia has repeatedly been accused of using memes and other viral images to influence western elections.

Edited photos and strong visuals were commonly spread on Facebook by Russian agents attempting to interfere with the 2016 US presidential election. 

Facebook is better prepared to defend against efforts to manipulate the platform to influence elections, according to CEO Mark Zuckerberg.

The 34-year-old claimed the platform recently thwarted foreign influence campaigns targeting several countries.

Zuckerberg, posting on his Facebook page, outlined a series of steps the leading social network has taken to protect against misinformation and manipulation campaigns aimed at disrupting elections.

‘We’ve identified and removed fake accounts ahead of elections in France, Germany, Alabama, Mexico and Brazil,’ Zuckerberg said.

‘We’ve found and taken down foreign influence campaigns from Russia and Iran attempting to interfere in the US, UK, Middle East, and elsewhere – as well as groups in Mexico and Brazil that have been active in their own country.’

Zuckerberg repeated his admission that Facebook was ill-prepared for the vast influence efforts on social media in the 2016 US election.

But he added that ‘today, Facebook is better prepared for these kinds of attacks.’

The billionaire also warned that the task is difficult because ‘we face sophisticated, well-funded adversaries. They won’t give up, and they will keep evolving.’ 


Leave A Reply