Beyond content severity: rethinking psychological impact and wellness care for moderators working with “benign” content

Book chapter


DeMarco, J., Savio, M.T., Perez, J. and Huang, X. 2026. Beyond content severity: rethinking psychological impact and wellness care for moderators working with “benign” content. in: Daniel, M.L., Menking, A., Savio, M. and Claffey, J. (ed.) Trust, Safety, and the Internet We Share: Multistakeholder Insights New York, NY Routledge. pp. 199-211
Chapter titleBeyond content severity: rethinking psychological impact and wellness care for moderators working with “benign” content
AuthorsDeMarco, J., Savio, M.T., Perez, J. and Huang, X.
Abstract

Mitigating harms is the central problem for the field of Trust and Safety. Within this ecosystem, content moderators are the front-facing practitioners dealing with the cumulative, direct and consequential effects of harmful content. They may experience psychological distress and negative cognitive states as a result of bearing the daily burden of interacting with ever-changing content that requires complex review. While exposure to harmful material necessitates wellness care for moderators, the challenges of newer and so-called less severe content, ambiguous policies and fragmented workflows not only negatively affect moderators' well-being but also limit their potential to effectively gatekeep and safeguard online spaces. To meaningfully contain and tackle harm, we need to revisit how content impact and wellness needs are conceptualised. If such groundwork is not laid now, platforms risk falling behind in managing harmful content, putting users and moderators at greater risk while also eroding trust in the system. This chapter integrates the different types of content exposure and harms, and highlights the intricacies and dynamics that impact full-time moderators' well-being, to stimulate collective action for more efficient, effective and psychologically safe content moderation across work types.

KeywordsContent moderation; trust and safety; online harm; secondary trauma; vicarious trauma; wellbeing
Sustainable Development Goals3 Good health and well-being
Middlesex University ThemeHealth & Wellbeing
Research GroupCentre for Abuse, Trauma and Suicide Studies (CATS)
Page range199-211
Book titleTrust, Safety, and the Internet We Share: Multistakeholder Insights
EditorsDaniel, M.L., Menking, A., Savio, M. and Claffey, J.
PublisherRoutledge
Place of publicationNew York, NY
ISBN
Electronic9781003621072
Hardcover9781032859620
Paperback9781041028192
Copyright Year2026
Publication dates
Print22 May 2026
Publication process dates
Accepted01 Jul 2025
Deposited15 Jun 2026
Output statusPublished
Accepted author manuscript
License
Copyright Statement

This is an Accepted Manuscript of a book chapter published by Routledge in Trust, Safety, and the Internet We Share: Multistakeholder Insights on May 22, 2026, available online: http://doi.org/10.1201/9781003621072-24
It is deposited under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives License (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited, and is not altered, transformed, or built upon in any way.

Digital Object Identifier (DOI)https://doi.org/10.1201/9781003621072-24
Related Output
Is part ofhttps://doi.org/10.1201/9781003621072
LanguageEnglish
Permalink -

https://repository.mdx.ac.uk/item/36879y

Restricted files

Accepted author manuscript

  • 19
    total views
  • 3
    total downloads
  • 2
    views this month
  • 0
    downloads this month

Export as

Related outputs

Commercial content moderation: trauma exposure on the digital frontline
DeMarco, J., Watson, P. and Norman, S.B. 2026. Commercial content moderation: trauma exposure on the digital frontline. Journal of Traumatic Stress (JTS). https://doi.org/10.1002/jts.70087
Content moderator coping strategies: associations with psychological distress, secondary trauma and wellbeing
Spence, R., Martellozzo, E. and DeMarco, J. 2026. Content moderator coping strategies: associations with psychological distress, secondary trauma and wellbeing. Journal of Media Psychology: Theories, Methods, and Applications. 38 (2), pp. 119-129. https://doi.org/10.1027/1864-1105/a000454
Content moderator mental health and associations with coping styles: replication and extension of previous studies
Spence, R. and DeMarco, J. 2025. Content moderator mental health and associations with coping styles: replication and extension of previous studies. Behavioral Sciences. 15 (4), p. 487. https://doi.org/10.3390/bs15040487
Content moderator mental health and associations with coping styles: replication and extension of previous studies
Spence, R. and DeMarco, J. 2025. Content moderator mental health and associations with coping styles: replication and extension of previous studies. https://doi.org/10.20944/preprints202502.0160.v1
Exploring the use of Virtual Reality to enhance rapid decompression from occupational stress during short wellness breaks for content moderators
Spence, R., Campbell, N., Woofenden, T. and DeMarco, J. 2025. Exploring the use of Virtual Reality to enhance rapid decompression from occupational stress during short wellness breaks for content moderators. https://doi.org/10.21203/rs.3.rs-5684444/v1
Content moderator mental health, secondary trauma, and well-being: a cross-sectional study
Spence, R., Bifulco, A., Bradbury, P., Martellozzo, E. and DeMarco, J. 2024. Content moderator mental health, secondary trauma, and well-being: a cross-sectional study. Cyberpsychology, Behavior, and Social Networking. 27 (2), pp. 149-155. https://doi.org/10.1089/cyber.2023.0298
Supporting digital key workers: addressing the challenges faced by content moderators during and after the COVID-19 pandemic
Martellozzo, E., Bleakley, P., Bradbury, P., Spence, R. and DeMarco, J. 2024. Supporting digital key workers: addressing the challenges faced by content moderators during and after the COVID-19 pandemic. International Journal of Technology, Policy and Management. 24 (2), pp. 212-228. https://doi.org/10.1504/IJTPM.2024.137818
The psychological impacts of content moderation on content moderators: a qualitative study
Spence, R., Bifulco, A., Bradbury, P., Martellozzo, E. and DeMarco, J. 2023. The psychological impacts of content moderation on content moderators: a qualitative study. Cyberpsychology: Journal of Psychosocial Research on Cyberspace. 17 (4). https://doi.org/10.5817/cp2023-4-8
Moderating online child sexual abuse material (CSAM): does self-regulation work, or is greater state regulation needed?
Bleakley, P., Martellozzo, E., Spence, R. and DeMarco, J. 2023. Moderating online child sexual abuse material (CSAM): does self-regulation work, or is greater state regulation needed? European Journal of Criminology. 21 (2), pp. 231-250. https://doi.org/10.1177/14773708231181361
Content moderators’ strategies for coping with the stress of moderating content online
Spence, R., Harrison, A., Bradbury, P., Bleakley, P., Martellozzo, E. and DeMarco, J. 2023. Content moderators’ strategies for coping with the stress of moderating content online. Journal of Online Trust and Safety. 1 (5), pp. 1-18. https://doi.org/10.54501/jots.v1i5.91
Shared practice, learning, and goals between police and young people: a qualitative analysis of the National Volunteer Police Cadets
DeMarco, J. and Bifulco, A. 2021. Shared practice, learning, and goals between police and young people: a qualitative analysis of the National Volunteer Police Cadets. Policing: a Journal of Policy and Practice. 15 (4), pp. 2095-2110. https://doi.org/10.1093/police/paaa010
Racial differences in Police experiences: investigation into the factors influencing citizen-police co-operation
DeMarco, J. 2016. Racial differences in Police experiences: investigation into the factors influencing citizen-police co-operation. International Journal of Research in Social Sciences and Humanities. 6 (2), pp. 42-63.
Exploring the removal of online child sexual abuse material in the United Kingdom: processes and practice
Martellozzo, E. and DeMarco, J. 2020. Exploring the removal of online child sexual abuse material in the United Kingdom: processes and practice. Crime Prevention & Community Safety. 22 (4), pp. 331-350. https://doi.org/10.1057/s41300-020-00099-2
Exploring policing and industry practice in the prevention of online child sexual abuse
Davidson, J., Schimmenti, A., Caretti, V., Puccia, A., Corbari, E., Bogaerts, S., Schilder, J., Scally, M., Bifulco, A. and DeMarco, J. 2020. Exploring policing and industry practice in the prevention of online child sexual abuse. in: Bryce, I. and Petherick, W. (ed.) Child Sexual Abuse: Forensic Issues in Evidence, Impact, and Management Academic Press. pp. 657-678
An adapted REA exploring online child sexual abuse victimisation across the EU
Scally, M. and DeMarco, J. 2016. An adapted REA exploring online child sexual abuse victimisation across the EU. British Psychological Society Annual Conference. Nottingham 26 - 28 Apr 2016
Organised and Terrorist Networks: Empirical Research Report
Ruggiero, V., DeMarco, J., Monaghan, A., Huber, F., Jäger, B., Musotto, R., Wall, D., Bonfanti, M. and Meyer- Daetsch, L. 2017. Organised and Terrorist Networks: Empirical Research Report. European Commission.
Child online protection in the MENA region
Patrick, B., Monica, B., Davidson, J., Ali, M., Davison, P., Day, E., DeMarco, J., Rasul, M., Razai, S., Scally, M. and Wex, B. 2016. Child online protection in the MENA region. Centre for Justice and Crime Prevention.
EU online child safety: what does the literature say?
DeMarco, J., Davidson, J., Bifulco, A., Scally, M., Cheevers, C., Schimmenti, A., Caretti, V., Puccia, A., Corbari, E., Schilder, J. and Bogaerts, S. 2016. EU online child safety: what does the literature say? Crimen et Delictum: International Journal of Criminological and Investigative Sciences. 11 (1), pp. 1-19.
Digital dangers and cyber-victimisation: a study of European adolescent online risky behaviour for sexual exploitation
DeMarco, J., Cheevers, C., Davidson, J., Bogaerts, S., Pace, U., Aiken, M., Caretti, V., Schimmenti, A. and Bifulco, A. 2017. Digital dangers and cyber-victimisation: a study of European adolescent online risky behaviour for sexual exploitation. Clinical Neuropsychiatry. 14 (1), pp. 104-112.
Enhancing police and industry practice
Davidson, J., DeMarco, J., Bifulco, A., Bogaerts, S., Caretti, V., Aiken, M., Chevers, C., Corbari, E., Scally, M., Schimmenti, A. and Puccia, A. 2016. Enhancing police and industry practice. Middlesex University.
ISEC illegal use of the Internet: policing, collaboration and victimisation—A review of the literature. Document prepared for the European Commission initiative in dealing with cybercrime and cybersecurity
DeMarco, J., Davidson, J., Scally, M. and Long, E. 2015. ISEC illegal use of the Internet: policing, collaboration and victimisation—A review of the literature. Document prepared for the European Commission initiative in dealing with cybercrime and cybersecurity. Middlesex University.
Setting up a youth violence prevention project in a London hospital emergency department
Ilan-Clarke, Y., Bunn, A., DeMarco, J., Bifulco, A., Criddle, J. and Holdsworth, G. 2013. Setting up a youth violence prevention project in a London hospital emergency department. Journal of Public Mental Health. 12 (2), pp. 80-92. https://doi.org/10.1108/JPMH-09-2012-0005