login

Hate Speech Detection with Comment Embeddings

Published 18 May 2015
Nemanja Djuric, Jing Zhou, Robin K. Morris, Mihajlo Grbovic, Vladan Radosavljević, Narayan Bhamidipati
Citations712

TL;DR

This work proposes to learn distributed low-dimensional representations of comments using recently proposed neural language models, that can then be fed as inputs to a classification algorithm, resulting in highly efficient and effective hate speech detectors.

Abstract

We address the problem of hate speech detection in online user comments. Hate speech, defined as an "abusive speech targeting specific group characteristics, such as ethnicity, religion, or gender", is an important problem plaguing websites that allow users to leave feedback, having a negative impact on their online business and overall user experience. We propose to learn distributed low-dimensional representations of comments using recently proposed neural language models, that can then be fed as inputs to a classification algorithm. Our approach addresses issues of high-dimensionality and sparsity that impact the current state-of-the-art, resulting in highly efficient and effective hate speech detectors.

Keywords

Computer Science