-
-
Notifications
You must be signed in to change notification settings - Fork 29
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Create slurs-occur-every-language.mdx
- Loading branch information
1 parent
1a082c5
commit 9a372e9
Showing
1 changed file
with
23 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,23 @@ | ||
--- | ||
name: Online Gender-Based Slurs and Abuses Don't Just Happen in English | ||
excerpt: "On Developing Open Source Slur Lists in Indian English, Hindi, Tamil and Malayalam" | ||
author: "Tattle" | ||
project: | ||
date: 09-05-2024 | ||
tags: | ||
--- | ||
|
||
import ContentPageShell from "../../components/molecules/ContentPageShell.jsx" | ||
|
||
<ContentPageShell> | ||
|
||
The majority of machine learning investment on online platforms still happens in English. | ||
As Tarunima Prabhakar [commented to Rest of World](https://restofworld.org/2021/newsletter-south-asia-facebooks-language-problem/) back in 2021, there is hardly any prioritisation of other languages. For a country like India, abusive and hateful slurs also happen in vernacular languages. Yet, the lack of a list of these commonly used terms makes it harder to protect people from gendered abuse. | ||
|
||
As part of the process of building Uli, Tattle developed one of the largest crowd-sourced slur lists in Indian languages. Indian English was deemed by the team as a distinct enough vocabulary to warrant investment. Tamil and Hindi were the other two languages chosen for the initial phase given team capacity and budgets at the time. | ||
A second round of crowdsourced words during Tattle’s 16 days of activism campaign in November 2023 allowed us to add Malayalam to the list of languages that Uli supports. | ||
Thanks to the work led by Aakash from Citizen Digital Foundation, 50 new slurs were added in Malayalam. | ||
It has been an immense collective effort that now contains over 630 words across the four languages, over 300 of which have been annotated. One of the annotators involved in the process also pointed out that given the number of alphabets that exist in other languages (as opposed to English), creating the lexicon for slur lists is even harder. As people learn to trick the system, the number of spelling and tweaking possibilities means consistently trying to keep up. | ||
The slur list is available on [Tattle’s GitHub](https://restofworld.org/2021/newsletter-south-asia-facebooks-language-problem/) under the Open Data License for use by interested researchers and activists, or Trust and Safety teams. | ||
|
||
</ContentPageShell> |