Toronto Metropolitan University

File(s) stored somewhere else

Please note: Linked content is NOT stored on Toronto Metropolitan University and we can't guarantee its availability, quality, security or accept any liability.

Does Media Format Matter? Investigating the Toxicity, Sentiment and Topic of Audio Versus Text Social Media Messages

Version 2 2023-04-19, 16:45
Version 1 2022-12-08, 14:11
conference contribution
posted on 2023-04-19, 16:45 authored by Jamy LiJamy Li, Karen Penaranda Valdivia

Audio messaging and voice-based interactions are growing in popularity. Lexical features of a manually-curated dataset of real-world audio tweets, as well as text and video/image tweets from the same user accounts, are analyzed to explore how user-generated audio differs from text. The toxicity, sentiment, topic and length of audio tweet transcripts are compared with their accompanying text, date-matched text tweets from the same users and date-matched video/image tweets and their accompanying text. Audio tweets were significantly less toxic than both text tweets and text that accompanied the audio tweet, as well as significantly lower sentiment than their accompanying text. The topics and word counts of audio, text and video/image tweets also differed. These findings are then used to derive design implications for audio and conversational agent interaction. This research contributes preliminary insights about audio social media messages that may help researchers and designers of audio- and agent-based interaction better understand and design for different media formats.


Natural Sciences and Engineering Research Council of Canada under Grant RGPIN-2021-03139


Usage metrics

    Industrial Engineering


    Ref. manager