Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create slurs-occur-every-language.mdx #561

Merged
merged 1 commit into from
May 9, 2024
Merged

Create slurs-occur-every-language.mdx #561

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 23 additions & 0 deletions uli-website/src/pages/blog/slurs-occur-every-language.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
---
name: Online Gender-Based Slurs and Abuses Don't Just Happen in English
excerpt: "On Developing Open Source Slur Lists in Indian English, Hindi, Tamil and Malayalam"
author: "Tattle"
project:
date: 09-05-2024
tags:
---

import ContentPageShell from "../../components/molecules/ContentPageShell.jsx"

<ContentPageShell>

The majority of machine learning investment on online platforms still happens in English.
As Tarunima Prabhakar [commented to Rest of World](https://restofworld.org/2021/newsletter-south-asia-facebooks-language-problem/) back in 2021, there is hardly any prioritisation of other languages. For a country like India, abusive and hateful slurs also happen in vernacular languages. Yet, the lack of a list of these commonly used terms makes it harder to protect people from gendered abuse.

As part of the process of building Uli, Tattle developed one of the largest crowd-sourced slur lists in Indian languages. Indian English was deemed by the team as a distinct enough vocabulary to warrant investment. Tamil and Hindi were the other two languages chosen for the initial phase given team capacity and budgets at the time.
A second round of crowdsourced words during Tattle’s 16 days of activism campaign in November 2023 allowed us to add Malayalam to the list of languages that Uli supports.
Thanks to the work led by Aakash from Citizen Digital Foundation, 50 new slurs were added in Malayalam.
It has been an immense collective effort that now contains over 630 words across the four languages, over 300 of which have been annotated. One of the annotators involved in the process also pointed out that given the number of alphabets that exist in other languages (as opposed to English), creating the lexicon for slur lists is even harder. As people learn to trick the system, the number of spelling and tweaking possibilities means consistently trying to keep up.
The slur list is available on [Tattle’s GitHub](https://restofworld.org/2021/newsletter-south-asia-facebooks-language-problem/) under the Open Data License for use by interested researchers and activists, or Trust and Safety teams.

</ContentPageShell>
Loading