Multimodal Hatespeech Detection

Machine learning and artificial intelligence play an ever more crucial role in mitigating important societal problems, such as the prevalence of hate speech. We describe the Hateful Memes Challenge competition, held at NeurIPS 2020, focusing on multimodal hate speech. The aim of the challenge is to facilitate further research into multimodal reasoning and understanding.

We compare various multimodal transformer architectures for the task of detecting hateful memes, and achieve 4th place on the Hateful Meme Challenge organized by Facebook AI at NeurIPS 2020.