Tuesday, October 19, 2021

How Richi Nayak from QUT is making Twitter safer for women

Reading Time: 3 minutes

Social media can be a great place to feel connected to others and express yourself freely, but at its worst, it can become an online platform for hate and abuse. On a daily basis, it’s easy to come across vile content, especially those targeted at women.

Thankfully, a new Twitter algorithm created by Queensland researchers hopes to nip this in the bud.

professor richi nayak from queensland university of technology
Associate Professor Richi Nayak from the School of Computer Science and Centre for Data Science.

“Currently, it’s on users to report abuse they receive. With our solution, we can protect women by identifying misogynistic content online,” explained Professor Richi Nayak, a machine-learning researcher at Queensland University of Technology.

- Advertisement -

“Female users in particular can receive really brutal messages online. Just look at the treatment of female celebrities, or even Australia’s female Prime Minister.”

READ ALSO: Twitter launches dedicated tool to curb domestic violence in India

A deep learning algorithm was created by Nayak along with Professor Nicolas Suzor and research fellow Dr Md Abul Bashar in a collaboration between QUT’s faculties of Law, Science and Engineering, and the Digital Media Research Centre.

The algorithm, called ‘Long Short-Term Memory with Transfer Learning’, mined 1 million tweets and narrowed them down by three abusive words – rape, slut, and whore. The researchers also generated a rule-set to include parameters beyond abusive words.

“We looked at whether the content was targeted to a particular person or group, if there were specific threats or a wish for violence, if it included objectifying or sexual material, if it advocated hateful conduct, and so on,” Prof. Nayak told Indian Link.

This kind of ‘context learning’ has been crucial, as the presence of certain abusive words alone doesn’t mean that the content is misogynistic. Online, such tweets could be meant as a joke, or they could be sarcastic.

“You know how kids talk on social media these days!” the researcher chuckled.

Presently, a phrase like ‘go back to the kitchen’ might not typically be highlighted as problematic content because it doesn’t contain outright abusive language. Most systems would not typically identify such a tweet as misogynistic when it can’t understand the necessary context.

“Our algorithm proves that systems have the capability to understand context. This is crucial as learning misogyny is very different from merely identifying abuses online.”

To combat this hurdle, the Twitter algorithm was taught to identify linguistic patterns.

“It was developed to learn language patterns. It first learnt formal English language patterns, then we added more information like the language patterns employed in tweets which may not always be the most grammatically correct,” Nayak elaborated.

Over time, their model learns and develops its contextual and semantic understanding of language with continued exposure to content.

The research team has currently reported 75 per cent accuracy in identifying misogynistic content through the algorithm.

In the future, there’s scope for such an algorithm to be adapted to understand and identify racist or homophobic tweets too.

“With new described data sets, the algorithm has the ability to understand other context as well,” the researcher confirmed.

READ ALSO: Adelaide’s Prof. Purnendra Jain wins Japan’s highest civilian order

Using Twitter app on phone

According to Nayak, this kind of research can alter the way we utilise social media.

“Currently, social media platforms can identify some patterns, and they have systems in place to get warnings about hateful speech, but they have a huge volume of content to go through. Moreover, there’s been arguments surrounding the freedom to share your views freely online,” she said.

The hope is that such an algorithm can improve a typical female user’s experience on social media.

Although it has been specifically programmed for Twitter at present, the algorithm could eventually be deployed as a plug-in for users. In fact, Nayak says it could be expanded to accommodate misogyny in other languages like Hindi.

“I’m a machine learning researcher, so I use text mining to make sense out of large amounts of data. I was keen on using data science towards social good,” she said with a smile.

- Advertisement -
Rhea L Nath
Rhea L Nath is a writer, editor, and content creator based in Sydney. In 2020, she was nominated for Young Journalist of the Year (Premier's Multicultural Media Awards)

Related Articles


Please enter your comment!
Please enter your name here

- Advertisement -
- Advertisement -


Ep 9: What do young Indians want from love?

  Growing up in Indian culture, most of us know that love has never been as popular as marriage. Even in the movies, the main...

Ep 8: Indian links in Indigenous Australian poet Ali Cobby Eckermann’s...

  To celebrate NAIDOC week 2020 (between 8-15 November) I spoke to Yakunytjatjara poet Ali Cobby Eckermann about her time in India where she taught...

Ep 7: In the case of Sushant Singh Rajput

  The torrid and high-octane Sushant Singh Rajput case has been fodder for Indian people and press for the last few months. The actor’s tragic death...
- Advertisement -

Latest News

bottled up

Bottled Up: creating conversations around men’s mental health

  When was the last time you took stock of your emotional wellbeing? When was the last time you checked in with yourself? These are...
Sydney's Gopal Garg has partnered up with Indian organisations Deepalaya and Nanhi Kali. Image: supplied

Business for good: Sydney’s Gopal Garg on helping teachers in rural...

  For Sydney entrepreneur Gopal Garg, education, charity, and business have all come together in a recent project that is seeing many thousands of lives...
Here Out West Sydney Film Festival 2021

Indian links at Sydney Film Festival 2021

  It’s been a while since we have had such an interesting bunch of Indian films at the Sydney Film Festival. India’s only all-female newspaper. A...
phone line

NSW’s first multilingual mental health phone line

  The NSW Government has announced a $130 million investment over four years towards sporting clubs and multicultural communities, to support mental health needs from...
Vicky Kaushal in Sardar Udham

Review: Sardar Udham (Amazon Prime)

  The Jallianwala Bagh massacre in Amritsar in 1919 may be an incident etched in the memories of all Indians owing to its mention in...