fbpx
Sunday, June 20, 2021

Indian-origin scientist discovers new way to filter fake news

Reading Time: 2 minutes 

Using machine learning (ML), a team of US researchers led by Indian-American computer scientist Anshumali Shrivastava at Rice University has discovered an efficient way for social media companies to keep misinformation from spreading online.

Their method applies machine learning in a smarter way to improve the performance of Bloom filters, a widely used technique devised a half-century ago.

Using test databases of fake news stories and computer viruses, Shrivastava and statistics graduate student Zhenwei Dai showed their Adaptive Learned Bloom Filter (Ada-BF) required 50 per cent less memory to achieve the same level of performance as learned Bloom filters.

To explain their filtering approach, Shrivastava and Dai cited some data from Twitter.

The social media giant recently revealed that its users added about 500 million tweets a day, and tweets typically appeared online one second after a user hit send.

“Around the time of the election they were getting about 10,000 tweets a second, and with a one-second latency that’s about six tweets per millisecond,” Shrivastava said.

“If you want to apply a filter that reads every tweet and flags the ones with information that’s known to be fake, your flagging mechanism cannot be slower than six milliseconds or you will fall behind and never catch up.”

Source: Twitter

READ ALSO: How Richi Nayak from QUT is making Twitter safer for women

If flagged tweets are sent for an additional, manual review, it’s also vitally important to have a low false-positive rate.

In other words, you need to minimize how many genuine tweets are flagged by mistake.

“If your false-positive rate is as low as 0.1%, even then you are mistakenly flagging 10 tweets per second, or more than 800,000 per day, for manual review,” Shrivastava said.

“This is precisely why most of the traditional AI-only approaches are prohibitive for controlling the misinformation.”

The new approach to scanning social media is outlined in a study presented at the online-only 2020 Conference on Neural Information Processing Systems (NeurIPS 2020).

Shrivastava said Twitter doesn’t disclose its methods for filtering tweets, but they are believed to employ a Bloom filter, a low-memory technique invented in 1970 for checking to see if a specific data element, like a piece of computer code, is part of a known set of elements, like a database of known computer viruses.

A Bloom filter is guaranteed to find all code that matches the database, but it records some false positives too.

“A Bloom filter allows to you check tweets very quickly, in a millionth of a second or less. If it says a tweet is clean, that it does not match anything in your database of misinformation, that’s 100% guaranteed,” Shrivastava noted.

Within the past three years, researchers have offered various schemes for using machine learning to augment Bloom filters and improve their efficiency.

“When people use machine learning models today, they waste a lot of useful information that’s coming from the machine learning model,” Dai said.

IANS

- Advertisement -

Related Articles

1 COMMENT

LEAVE A REPLY

Please enter your comment!
Please enter your name here

- Advertisement -

Podcasts

Ep 9: What do young Indians want from love?

0
Growing up in Indian culture, most of us know that love has never been as popular as marriage. Even in the movies, the main...

Ep 8: Indian links in Indigenous Australian poet Ali Cobby Eckermann’s...

0
To celebrate NAIDOC week 2020 (between 8-15 November) I spoke to Yakunytjatjara poet Ali Cobby Eckermann about her time in India where she taught...

Ep 7: In the case of Sushant Singh Rajput

0
  The torrid and high-octane Sushant Singh Rajput case has been fodder for Indian people and press for the last few months. The actor’s tragic...
- Advertisement -

Latest News

REVIEW: Sherni

0
The film Sherni tackles several diverse issues. It is as much about sexism in sarkari workplace offices as it is about rapid erosion of...
EOFY shopping deals

EOFY deals you can’t miss

0
  It’s THAT time of the year again! June is the month when the whole retail supply chain indulges in a discounting overdrive. So, get...
singh biker club logo

Singh Motorcycle Club: A bikers’ group with a difference

0
  When Mavleen Singh Dhir hops on to his Harley Davidson Fat Boy to ride to Grey Gum Café in the Blue Mountains of NSW...

On the spirit of music: meet Sydney band Goldfynch

0
  If this year has been tough on your travel plans and wanderlust, how about ballooning over Paris instead? For Sydney-based musical duo Niyati and...
VS Collective and Priyanka Chopra Jonas

Victoria’s Secret welcomes ‘VS Collective’

0
  Victoria’s Secret (VS) is a brand renowned for its ‘sexy’ lingerie’s and beauty products amplifying a brand image of Barbie models with the perfect...