Cognitive Factor/Situation Factor/Communicative Goal

Generation (Human/AI)

Annotating Strategy

https://aclanthology.org/W19-3512

{L}-{HSAB}: A {L}evantine {T}witter Dataset for Hate Speech and Abusive Language

Hate Speech Detection

3 Levantine native speakers and at a higher educational level (Postdoc/PhD)

https://aclanthology.org/D19-5108

Annotation Process for the Dialog Act Classification of a Taglish {E}-commerce {Q}{\&}{A} Corpus

Dialogue Act Classification

e-commerce website

Tagalog-English

https://aclanthology.org/W15-5602

7x1-{PT}: um Corpus extra{\'\i}do do {T}witter para An{\'a}lise de Sentimentos em L{\'\i}ngua Portuguesa (7x1-{PT}: a Corpus extracted from {T}witter for Sentiment Analysis in {P}ortuguese Language)

Sentiment Analysis

https://aclanthology.org/W15-5614

Sentiment Analysis

https://aclanthology.org/F13-2033

Building and exploiting a {F}rench corpus for sentiment analysis (Construction et exploitation d{'}un corpus fran{\c{c}}ais pour l{'}analyse de sentiment) [in {F}rench]

Sentiment Analysis

hotel, film, amazon websites

https://aclanthology.org/J12-3002

{S}quibs: Fruit Carts: A Domain and Corpus for Research in Dialogue Systems and Psycholinguistics

Collaborative Dialogue

multi-turn dialogue

https://aclanthology.org/2018.jeptalnrecital-court.42

Annotation en Actes de Dialogue pour les Conversations d{'}Assistance en Ligne (Dialog Acts Annotations for Online Chats)

Dialogue Act Classification

multi-turn dialogue

https://aclanthology.org/2020.argmining-1.1

{D}ebate{S}um: A large-scale argument mining and summarization dataset

debate argument

https://aclanthology.org/2020.argmining-1.11

https://aclanthology.org/W19-6113

Annotating evaluative sentences for sentiment analysis: a dataset for {N}orwegian

Sentiment Analysis

five annotators in total (students with background in linguistics and language technology)

sentence with context

https://aclanthology.org/2020.lrec-1.614

review website

automatic (BART annotation tool)

phrase, sentence, whole review

https://aclanthology.org/S12-1018

preference prediction

existing dataset, learning website

two annotators

multi-turn dialogue

https://aclanthology.org/W12-3619

preference prediction

game transcript

multi-turn dialogue

https://aclanthology.org/O16-1027

sarcasm detection

https://aclanthology.org/R19-1125

offensiveness detection

https://aclanthology.org/2021.rocling-1.37

A Corpus for Dimensional Sentiment Classification on {Y}ou{T}ube Streaming Service

Sentiment Analysis, Excitement Analysis

https://aclanthology.org/2020.lincr-1.7

Towards a Multi-Dataset for Complex Emotions Learning Based on Deep Neural Networks

Emotion Classification

existing dataset

automatic(theory)

https://aclanthology.org/2020.lrec-1.194

{G}ood{N}ews{E}veryone: A Corpus of News Headlines Annotated with Emotions, Semantic Roles, and Reader Perception

Emotion Classification

one expert and three annotators on the domain of blog posts

https://aclanthology.org/2022.naacl-main.270

{M}ulti2{WOZ}: A Robust Multilingual Dataset and Conversational Pretraining for Task-Oriented Dialog

Task-Oriented Dialogue

existing dataset

multi-turn dialogue

Chinese, German, Arabic, and Russian

https://aclanthology.org/2020.lrec-1.768

{DAICT}: A Dialectal {A}rabic Irony Corpus Extracted from {T}witter

sarcasm detection

https://aclanthology.org/2020.osact-1.5

From {A}rabic Sentiment Analysis to Sarcasm Detection: The {A}r{S}arcasm Dataset

sarcasm detection

https://aclanthology.org/2020.acl-main.118

sarcasm detection

intended (author), perceived(crowd)

https://aclanthology.org/2020.lrec-1.55

Conversational Question Answering in Low Resource Scenarios: A Dataset and Case Study for {B}asque

Conversational Question Answering

Wikipedia, online session

multi-turn dialogue

https://aclanthology.org/2021.nodalida-main.52

Gender-Bias Detection

existing dataset

single sentence

https://aclanthology.org/2005.sigdial-1.12

A Corpus for Studying Addressing Behavior in Multi-Party Dialogues

Dialogue act classification, addressing behaviour analysis

meeting recording

multi-turn dialogue

https://aclanthology.org/2021.eacl-main.11

open-domain dialogue

multi-turn dialogue

English, German, Dutch, Spanish, Portuguese, Italian, Hungarian

https://aclanthology.org/W18-0618

{RSDD}-Time: Temporal Annotation of Self-Reported Mental Health Diagnoses

Mental Well-being Diagnosis

https://aclanthology.org/2022.naacl-main.5

{E}r{AC}on{D}: Error Annotated Conversational Dialog Dataset for Grammatical Error Correction

Conversational Grammar Correction

two annotators

multi-turn dialogue

https://aclanthology.org/2021.konvens-1.20

{D}e{I}n{S}tance: Creating and Evaluating a {G}erman Corpus for Fine-Grained Inferred Stance Detection

Stance Detection

existing dataset

https://aclanthology.org/2020.nlpcovid19-acl.11

Measuring {Emotions} in the {COVID}-19 {Real} {World} {Worry} {Dataset}

Emotion Classification

https://aclanthology.org/2022.findings-acl.41

{H}ybri{D}ialogue: An Information-Seeking Dialogue Dataset Grounded on Tabular and Textual Data

Grounded Dialogue

multi-turn dialogue

https://aclanthology.org/E17-2092

{E}mo{B}ank: Studying the Impact of Annotation Perspective and Representation Format on Dimensional Emotion Analysis

Emotion Classification

existing dataset

single sentence

https://aclanthology.org/Y14-1024

Automatically Building a Corpus for Sentiment Analysis on {I}ndonesian Tweets

Sentiment Analysis

seed data+automatic

https://aclanthology.org/2021.ranlp-1.34

{RED}: A Novel Dataset for {R}omanian Emotion Detection from Tweets

Emotion Classification

3 annotators (Romanian and psychologist)

https://aclanthology.org/N15-1146

Sentiment Analysis

existing dataset

https://aclanthology.org/E17-2088

Stance Detection

https://aclanthology.org/P14-2066

A Corpus of Sentence-level Revisions in Academic Writing: A Step towards Understanding Statement Strength in Communication

Statement Strength

single sentence

https://aclanthology.org/P14-2070

Depeche Mood: a Lexicon for Emotion Analysis from Crowd Annotated News

https://aclanthology.org/2022.acl-long.234

{T}oxi{G}en: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detection

Hate Speech Detection

machine generate

human validation

single sentence

https://aclanthology.org/2020.lrec-1.71

A Corpus of Controlled Opinionated and Knowledgeable Movie Discussions for Training Neural Conversation Models

multi-turn dialogue

https://aclanthology.org/2021.sigdial-1.37

How Should Agents Ask Questions For Situated Learning? An Annotated Dialogue Corpus

Question Generation

multi-turn dialogue

https://aclanthology.org/W04-2319

Dialogue Act Classification

meeting transcript

multi-turn dialogue

https://aclanthology.org/2020.lrec-1.807

{S}ib{L}ing Corpus of {R}ussian Dialogue Speech Designed for Research on Speech Entrainment

Chitchat with interpersonal relationship

multi-turn dialogue

https://aclanthology.org/K19-1092

Multi-Level Sentiment Analysis of {P}ol{E}mo 2.0: Extended Corpus of Multi-Domain Consumer Reviews

Sentiment Analysis

review website

https://aclanthology.org/W11-3703

Emotion Modeling from Writer/Reader Perspectives Using a Microblog Dataset

Emotion Classification

Plurk (social media)

https://aclanthology.org/C14-1120

single sentence

https://aclanthology.org/2020.lrec-1.180

Multilingual {T}witter Corpus and Baselines for Evaluating Demographic Bias in Hate Speech Recognition

Hate Speech Detection

English, Italian, Polish, Portuguese, Spanish

https://aclanthology.org/P19-1394

Large Dataset and Language Model Fun-Tuning for Humor Recognition

Humor Recognition

existing dataset, joke website

single sentence

https://aclanthology.org/C18-1114

Who Feels What and Why? Annotation of a Literature Corpus with Semantic Roles of Emotions

https://aclanthology.org/P19-1050

{MELD}: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversations

Emotion Classification

multi-turn dialogue

https://aclanthology.org/P19-1057

A Corpus for Modeling User and Language Effects in Argumentation on Online Debating

multi-turn dialogue

https://aclanthology.org/2022.dialdoc-1.21

{T}ask2{D}ial: A Novel Task and Dataset for Commonsense-enhanced Task-based Dialogue Grounded in Documents

commonsense enhanced Task-Oriented Dialogue

multi-turn dialogue

https://aclanthology.org/D15-1302

A Multi-lingual Annotated Dataset for Aspect-Oriented Opinion Mining

existing dataset

English, Italian, Spanish

https://aclanthology.org/2020.lrec-1.193

The {POTUS} Corpus, a Database of Weekly Addresses for the Study of Stance in Politics and Virtual Agents

Socially believable Agent

https://aclanthology.org/W17-1106

A {T}witter Corpus and Benchmark Resources for {G}erman Sentiment Analysis

Sentiment Analysis

https://aclanthology.org/W18-3502

Humor Recognition, humor generation

https://aclanthology.org/2021.wassa-1.18

Hate Towards the Political Opponent: A {T}witter Corpus Study of the 2020 {US} Elections on the Basis of Offensive Speech and Stance Detection

Hate Speech Detection, Stance Detection

https://aclanthology.org/2021.wassa-1.25

{ONE}: Toward {ONE} model, {ONE} algorithm, {ONE} corpus dedicated to sentiment analysis of {A}rabic/{A}rabizi and its dialects

Sentiment Analysis

existing dataset

https://aclanthology.org/2022.woah-1.14

DeTox: A Comprehensive Dataset for {G}erman Offensive Language and Conversation Analysis

Offensive Language Detection

https://aclanthology.org/2022.naacl-main.108

Beyond Emotion: A Multi-Modal Dataset for Human Desire Understanding

Desire Understanding

https://aclanthology.org/2020.lrec-1.62

persuasion, negotiation

sentence with context

https://aclanthology.org/W09-3405

Annotating Dialogue Acts to Construct Dialogue Systems for Consulting

Dialogue Act Classification, consultation

multi-turn dialogue

https://aclanthology.org/2021.emnlp-main.182

Don{'}t be Contradicted with Anything! {CI}-{T}o{D}: Towards Benchmarking Consistency for Task-oriented Dialogue System

Consistency in Task-Oriented Dialogue

existing dataset

multi-turn dialogue

https://aclanthology.org/2020.lrec-1.127

Machine-Aided Annotation for Fine-Grained Proposition Types in Argumentation

debate, social media

human, machine

https://aclanthology.org/P10-1059

Sentence and Expression Level Annotation of Opinions in User-Generated Discourse

review website

https://aclanthology.org/2020.lrec-1.151

An {A}lgerian Corpus and an Annotation Platform for Opinion and Emotion Analysis

Sentiment Analysis, Emotion Classification

https://aclanthology.org/2021.eacl-main.142

{N}ews{MTSC}: A Dataset for (Multi-)Target-dependent Sentiment Classification in Political News Articles

Sentiment Analysis

existing dataset

https://aclanthology.org/2020.lrec-1.618

Sentiment Analysis

https://aclanthology.org/2020.lrec-1.53

{M}ulti{WOZ} 2.1: A Consolidated Multi-Domain Dialogue Dataset with State Corrections and State Tracking Baselines

Dialogue State Tracking

existing dataset

human, machine

multi-turn dialogue

https://aclanthology.org/2020.lrec-1.76

{MPDD}: A Multi-Party Dialogue Dataset for Analysis of Emotions and Interpersonal Relationships

open-domain dialogue enhanced with knowledge on interpersonal relationships

multi-turn dialogue

https://aclanthology.org/2020.lrec-1.79

{PACO}: a Corpus to Analyze the Impact of Common Ground in Spontaneous Face-to-Face Interaction

interpersonal relationship

human, machine

multi-turn dialogue

https://aclanthology.org/2020.lrec-1.186

{E}mo{E}vent: A Multilingual Emotion Corpus based on different Events

Emotion Classification

English, Spanish

https://aclanthology.org/2020.lrec-1.84

Multimodal Corpus of Bidirectional Conversation of Human-human and Human-robot Interaction during f{MRI} Scanning

open-domain dialogue

human-human, human-ai

multi-turn dialogue

https://aclanthology.org/2020.lrec-1.59

{``}Cheese!{''}: a Corpus of Face-to-face {F}rench Interactions. A Case Study for Analyzing Smiling and Conversational Humor

human, machine

multi-turn dialogue

https://aclanthology.org/2020.lrec-1.201

{CEASE}, a Corpus of Emotion Annotated Suicide notes in {E}nglish

sentence with context

https://aclanthology.org/2020.lrec-1.72

A {F}rench Medical Conversations Corpus Annotated for a Virtual Patient Dialogue System

Medical consultatiton

medical consultation

single-turn, multi-turn dialogue

https://aclanthology.org/2020.lrec-1.205

{PO}-{EMO}: Conceptualization, Annotation, and Modeling of Aesthetic Emotions in {G}erman and {E}nglish Poetry

Emotion Classification

poem website

expert, crowdsource

English, German

https://aclanthology.org/2020.lrec-1.203

An Event-comment Social Media Corpus for Implicit Emotion Analysis

https://aclanthology.org/2020.lrec-1.173

{WAC}: A Corpus of {W}ikipedia Conversations for Online Abuse Detection

Abusive Content Detection

existing dataset

sentence with context

https://aclanthology.org/2020.lrec-1.171

Multilingual Stance Detection in Tweets: The {C}atalonia Independence Corpus

Stance Detection

Catalan, Spanish

https://aclanthology.org/2020.lrec-1.143

Corpus for Modeling User Interactions in Online Persuasive Discussions

sentence with context

https://aclanthology.org/2020.lrec-1.168

Development and Validation of a Corpus for Machine Humor Comprehension

Humor Recognition

website, book, app

https://aclanthology.org/2020.lrec-1.624

{P}arl{V}ote: A Corpus for Sentiment Analysis of Political Debates

Sentiment Analysis

parliamentary record

automatic(keyword)

https://aclanthology.org/2020.lrec-1.628

Humor Recognition

https://aclanthology.org/2020.lrec-1.212

An Evaluation Dataset for Identifying Communicative Functions of Sentences in {E}nglish Scholarly Papers

Communicative Function Identification

single sentence

https://aclanthology.org/2020.lrec-1.80

Dialogue Act Annotation in a Multimodal Corpus of First Encounter Dialogues

Dialogue Act Classification

existing dataset

multi-turn dialogue

https://aclanthology.org/2020.emnlp-main.743

Medical consultatiton

multi-turn dialogue

English, Chinese

https://aclanthology.org/2020.lrec-1.75

{RDG}-Map: A Multimodal Corpus of Pedagogical Human-Agent Spoken Interactions.

multi-turn dialogue

https://aclanthology.org/Y15-1034

Annotation and Classification of {F}rench Feedback Communicative Functions

Communicative Function Identification

existing dataset

single sentence

https://aclanthology.org/W19-8623

{V}i{GGO}: A Video Game Corpus for Data-To-Text Generation in Open-Domain Conversation

data-to-text generation

multi-turn dialogue

https://aclanthology.org/W15-4614

Dialogue Act Classification

https://aclanthology.org/2021.sigdial-1.38

How Will {I} Argue? A Dataset for Evaluating Recommender Systems for Argumentations

https://aclanthology.org/W16-3604

Creating and Characterizing a Diverse Corpus of Sarcasm in Dialogue

sarcasm detection

existing dataset

sentence with context

https://aclanthology.org/2020.lrec-1.60

The Margarita Dialogue Corpus: A Data Set for Time-Offset Interactions and Unstructured Dialogue Systems

Time-Offset Interactions

multi-turn dialogue

https://aclanthology.org/W19-3510

Hate Speech Detection

https://aclanthology.org/2021.bucc-1.10

toxicity detection

existing dataset

sentence with context

https://aclanthology.org/D19-1460

Multi-Domain Goal-Oriented Dialogues ({M}ulti{D}o{GO}): Strategies toward Curating and Annotating Large Scale Dialogue Data

Dialogue State Tracking

multi-turn dialogue

https://aclanthology.org/P18-2024

Construction of a {C}hinese Corpus for the Analysis of the Emotionality of Metaphorical Expressions

book, journal, script, network

single sentence

https://aclanthology.org/2020.lrec-1.78

{EDA}: Enriching Emotional Dialogue Acts using an Ensemble of Neural Annotators

Dialogue Act Classification

existing dataset

automatic(neural models)

multi-turn dialogue