Wednesday, January 20, 2021

How Richi Nayak from QUT is making Twitter safer for women

Reading Time: 3 minutes

Social media can be a great place to feel connected to others and express yourself freely, but at its worst, it can become an online platform for hate and abuse. On a daily basis, it’s easy to come across vile content, especially those targeted at women.

Thankfully, a new Twitter algorithm created by Queensland researchers hopes to nip this in the bud.

professor richi nayak from queensland university of technology
Associate Professor Richi Nayak from the School of Computer Science and Centre for Data Science.
- Advertisement -

“Currently, it’s on users to report abuse they receive. With our solution, we can protect women by identifying misogynistic content online,” explained Professor Richi Nayak, a machine-learning researcher at Queensland University of Technology.

“Female users in particular can receive really brutal messages online. Just look at the treatment of female celebrities, or even Australia’s female Prime Minister.”

READ ALSO: Twitter launches dedicated tool to curb domestic violence in India

A deep learning algorithm was created by Nayak along with Professor Nicolas Suzor and research fellow Dr Md Abul Bashar in a collaboration between QUT’s faculties of Law, Science and Engineering, and the Digital Media Research Centre.

The algorithm, called ‘Long Short-Term Memory with Transfer Learning’, mined 1 million tweets and narrowed them down by three abusive words – rape, slut, and whore. The researchers also generated a rule-set to include parameters beyond abusive words.

“We looked at whether the content was targeted to a particular person or group, if there were specific threats or a wish for violence, if it included objectifying or sexual material, if it advocated hateful conduct, and so on,” Prof. Nayak told Indian Link.

This kind of ‘context learning’ has been crucial, as the presence of certain abusive words alone doesn’t mean that the content is misogynistic. Online, such tweets could be meant as a joke, or they could be sarcastic.

“You know how kids talk on social media these days!” the researcher chuckled.

Presently, a phrase like ‘go back to the kitchen’ might not typically be highlighted as problematic content because it doesn’t contain outright abusive language. Most systems would not typically identify such a tweet as misogynistic when it can’t understand the necessary context.

“Our algorithm proves that systems have the capability to understand context. This is crucial as learning misogyny is very different from merely identifying abuses online.”

To combat this hurdle, the Twitter algorithm was taught to identify linguistic patterns.

“It was developed to learn language patterns. It first learnt formal English language patterns, then we added more information like the language patterns employed in tweets which may not always be the most grammatically correct,” Nayak elaborated.

Over time, their model learns and develops its contextual and semantic understanding of language with continued exposure to content.

The research team has currently reported 75 per cent accuracy in identifying misogynistic content through the algorithm.

In the future, there’s scope for such an algorithm to be adapted to understand and identify racist or homophobic tweets too.

“With new described data sets, the algorithm has the ability to understand other context as well,” the researcher confirmed.

READ ALSO: Adelaide’s Prof. Purnendra Jain wins Japan’s highest civilian order

Using Twitter app on phone

According to Nayak, this kind of research can alter the way we utilise social media.

“Currently, social media platforms can identify some patterns, and they have systems in place to get warnings about hateful speech, but they have a huge volume of content to go through. Moreover, there’s been arguments surrounding the freedom to share your views freely online,” she said.

The hope is that such an algorithm can improve a typical female user’s experience on social media.

Although it has been specifically programmed for Twitter at present, the algorithm could eventually be deployed as a plug-in for users. In fact, Nayak says it could be expanded to accommodate misogyny in other languages like Hindi.

“I’m a machine learning researcher, so I use text mining to make sense out of large amounts of data. I was keen on using data science towards social good,” she said with a smile.

- Advertisement -
Rhea Nath
Rhea Nath
Rhea L Nath is a writer, editor, and content creator studying at the University of Sydney.

Related Articles


Please enter your comment!
Please enter your name here


Ep8: Indian links in Indigenous Australian poet Ali Cobby Eckermann’s life

To celebrate NAIDOC week 2020 (between 8-15 November) I spoke to Yakunytjatjara poet Ali Cobby Eckermann about her time in India where she taught...

Ep 7: In the case of Sushant Singh Rajput

  The torrid and high-octane Sushant Singh Rajput case has been fodder for Indian people and press for the last few months. The actor’s tragic...

Ep 6: The Indian LGBTQ+ community in 2020

  It’s been two years since the world’s largest democracy repealed the draconian Section 377 which used to allow discrimination against homosexual people. Only this...

Latest News

AUSvIND: Battered India pull off greatest Test series win of all...

  Ten first-choice players unavailable or injured for at least part of the series, including the talismanic captain who happens to be the best player....
dhoni, rishabh pant, rohit sharma, tim paine, r ashwin, stump mic moments, ashwin sledging, sledging, funny moments, stump mic teasing

Candid convos caught by stump mics

  A lot of the time cheeky stump mics catch candid conversations on the pitch that become immortalised on Youtube. Here are some of those...
cheteshwar pujara

WATCH: Pujara puts his body on the line at the Gabba

  A battered and bruised Indian cricket team is soldiering on as the final day of the 4th cricket test match goes to a thrilling...

Biryani Bonanza: 3 delicious recipes to try this Republic Day

  Talk about biryanis, and you’ll encounter way too many FAQs. Do you cook the rice and meat separately, or together? Do you use the...
curry and rice

“Stop cooking curry”: when neighbours complain about ‘smelly’ Indian food

  When 29-year-old Vaibhav Pokhriyal moved into his new apartment in Dee Why, he never would’ve guessed what a stir (no pun intended) his cooking...