Skip to content
Change the repository type filter

All

    Repositories list

    • This dataset contains results from all rounds of Adversarial Nibbler. This data includes adversarial prompts fed into public generative text2image models and validations for unsafe images. There will be two sets of data: all prompts submitted and all prompts attempted (sent to t2i models but not submitted as unsafe).
      Creative Commons Attribution 4.0 International
      31900Updated Sep 30, 2024Sep 30, 2024
    • wit

      Public
      WIT (Wikipedia-based Image Text) Dataset is a large multimodal multilingual dataset comprising 37M+ image-text sets with 11M+ unique images across 100+ languages.
      Other
      4099700Updated Sep 27, 2024Sep 27, 2024
    • This dataset contains synthetic training data for grammatical error correction. The corpus is generated by corrupting clean sentences from C4 using a tagged corruption model. The approach and the dataset are described in more detail by Stahlberg and Kumar (2021) (https://www.aclweb.org/anthology/2021.bea-1.4/)
      Python
      Creative Commons Attribution 4.0 International
      2415300Updated Sep 24, 2024Sep 24, 2024
    • Python
      Apache License 2.0
      13932Updated Sep 19, 2024Sep 19, 2024
    • SeeGULL Multilingual is a multilingual and multicultural dataset of stereotypes. It consists of stereotypes in 20 languages with human annotations across 23 languages, including annotations on their degree of offensiveness.
      Creative Commons Attribution 4.0 International
      1300Updated Sep 19, 2024Sep 19, 2024
    • ToTTo

      Public
      ToTTo is an open-domain English table-to-text dataset with over 120,000 training examples that proposes a controlled generation task: given a Wikipedia table and a set of highlighted table cells, produce a one-sentence description. We hope it can serve as a useful research benchmark for high-precision conditional text generation.
      3743660Updated Sep 11, 2024Sep 11, 2024
    • IndicGenBench is a high-quality, multilingual, multi-way parallel benchmark for evaluating Large Language Models (LLMs) on 4 user-facing generation tasks across a diverse set 29 of Indic languages covering 13 scripts and 4 language families.
      Other
      64100Updated Sep 1, 2024Sep 1, 2024
    • hiertext

      Public
      The HierText dataset contains ~12k images from the Open Images dataset v6 with large amount of text entities. We provide word, line and paragraph level annotations.
      Jupyter Notebook
      Creative Commons Attribution Share Alike 4.0 International
      2426001Updated Aug 30, 2024Aug 30, 2024
    • The CF-TriviaQA dataset accompanies "Hallucination Augmented Recitations for Language Models" paper (https://arxiv.org/abs/2311.07424). It is a counterfactual open book QA dataset generated from the TriviaQA dataset using Hallucination Augmented Recitations (HAR) approach, with the purpose of improving attribution in LLMs.
      Apache License 2.0
      1210Updated Aug 30, 2024Aug 30, 2024
    • The BamTwoogle dataset accompanies "ReST meets ReAct: Self-Improvement for Multi-Step Reasoning LLM Agent" paper (https://arxiv.org/abs/2312.10003). It was written to be a complementary, slightly more challenging sequel to Bamboogle dataset. It addresses some of the shortcomings of Bamboogle we discovered while performing human evals for the paper.
      Creative Commons Attribution 4.0 International
      1300Updated Aug 14, 2024Aug 14, 2024
    • mittens

      Public
      Datasets for measuring misgendering in translation
      Other
      0500Updated Aug 13, 2024Aug 13, 2024
    • visage

      Public
      Visage contains an image dataset of images with human annotations on whether or not certain attributes are present or depicted in the image. The attribute may either be stereotypical or non-stereotypical w.r.t. to the identity group in the image. It also contains a list of attributes in English along with annotations about whether they are visual.
      Apache License 2.0
      2700Updated Aug 13, 2024Aug 13, 2024
    • SPICE

      Public
      SPICE is a stereotype dataset in English containing stereotypes collected in India with community engagement. It spans identity groups and stereotypes unique to India, as well as other stereotypes about gender and nationalities.
      Creative Commons Attribution 4.0 International
      1200Updated Jul 26, 2024Jul 26, 2024
    • cube

      Public
      CUBE is a benchmark to evaluate the Cultural Competence of T2I models
      Creative Commons Attribution 4.0 International
      0400Updated Jul 18, 2024Jul 18, 2024
    • screen_qa

      Public
      ScreenQA dataset was introduced in the "ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshots" paper. It contains ~86K question-answer pairs collected by human annotators for ~35K screenshots from Rico. It should be used to train and evaluate models capable of screen content understanding via question answering.
      Creative Commons Attribution 4.0 International
      78810Updated Jul 18, 2024Jul 18, 2024
    • uicrit

      Public
      UICrit is a dataset containing human-generated natural language design critiques, corresponding bounding boxes for each critique, and design quality ratings for 1,000 mobile UIs from RICO. This dataset was collected for our UIST '24 paper: https://arxiv.org/abs/2407.08850.
      1400Updated Jul 18, 2024Jul 18, 2024
    • This repository contains two datasets with multi-turn adversarial conversations generated by human agents interacting with a dialog model and rated for safety by two corresponding diverse rater pools.
      32310Updated Jul 16, 2024Jul 16, 2024
    • Consists of ~500k human annotations on the RICO dataset identifying various icons based on their shapes and semantics, and associations between selected general UI elements and their text labels. Annotations also include human annotated bounding boxes which are more accurate and have a greater coverage of UI elements.
      Creative Commons Attribution Share Alike 4.0 International
      32010Updated Jun 27, 2024Jun 27, 2024
    • C++
      Apache License 2.0
      4312321Updated Jun 25, 2024Jun 25, 2024
    • MISeD

      Public
      MISeD (Meeting Information Seeking Dialogs dataset) is an information-seeking dialog dataset focused on meeting transcripts. It includes 432 dialogs over transcripts from the QMSum dataset. MISeD is described in detail in the paper: Efficient Data Generation for Source-grounded Information-seeking Dialogs: A Use Case for Meeting Transcripts.
      3800Updated Jun 25, 2024Jun 25, 2024
    • RichHF-18K dataset contains rich human feedback labels we collected for our CVPR'24 paper: https://arxiv.org/pdf/2312.10240, along with the file name of the associated labeled images (no urls or images are included in this dataset).
      29890Updated Jun 25, 2024Jun 25, 2024
    • Images gathered from the Internet in 2023 and some metadata
      HTML
      Other
      1100Updated Jun 24, 2024Jun 24, 2024
    • GeniL

      Public
      GeniL dataset is an effort for detecting various types of generalization in language. This multilingual dataset covers sentences in EN, FR, ES, PT, AR, HI, BN, MS, and ID and is annotated by native speakers of each language. Each sentence is collected from a public corpora of language and contains at least one identity group name and an attribute.
      Creative Commons Attribution 4.0 International
      1000Updated Jun 18, 2024Jun 18, 2024
    • D3code

      Public
      D3code is a large-scale cross-cultural dataset of parallel annotations for offensive language detection by over 4k annotators, balanced across gender and age, from across 21 countries, representing eight geo-cultural regions.
      Creative Commons Attribution 4.0 International
      1000Updated May 22, 2024May 22, 2024
    • scin

      Public
      The SCIN dataset contains 10,000+ images of dermatology conditions, crowdsourced with informed consent from US internet users. Contributions include self-reported demographic and symptom information and dermatologist labels. The dataset also contains estimated Fitzpatrick skin type and Monk Skin Tone.
      Jupyter Notebook
      Other
      46920Updated May 8, 2024May 8, 2024
    • cpcd

      Public
      The Conversational Playlist Creation Dataset (CPCD) contains 917 conversations between two people where users express preferences over sets of songs in natural language and wizards to elicit preferences from users. The dataset includes per-song ratings and can be used to design and evaluate conversational recommendation systems.
      Python
      31011Updated May 3, 2024May 3, 2024
    • thesios

      Public
      This repository describes I/O traces of Google storage servers and disks synthesized by Thesios. Thesios synthesizes representative I/O traces by combining down-sampled I/O traces collected from multiple disks (HDDs) attached to multiple storage servers in Google distributed storage system.
      11810Updated Apr 29, 2024Apr 29, 2024
    • Please see the readme file as well as our 2019 EMNLP paper linked here -->
      5819240Updated Apr 24, 2024Apr 24, 2024
    • This repository contains the annotations from the paper "To Diverge or Not to Diverge: A Morphosyntactic Perspective on Machine Translation vs Human Translation."
      1000Updated Mar 25, 2024Mar 25, 2024
    • QuoteSum

      Public
      QuoteSum is a textual QA dataset containing Semi-Extractive Multi-source Question Answering (SEMQA) examples written by humans, based on Wikipedia passages.
      Python
      Creative Commons Attribution Share Alike 4.0 International
      11200Updated Mar 25, 2024Mar 25, 2024