More Web Proxy on the site http://driver.im/

extended-abstract

Public Access

MOSafely, Is that Sus? A Youth-Centric Online Risk Assessment Dashboard

Authors:

Ashwaq Alsoubai,

Xavier V. Caddle,

Alexandra Taylor Koehler,

Estefania Sanchez,

Munmun De Choudhury,

Pamela J. WisniewskiAuthors Info & Claims

CSCW'22 Companion: Companion Publication of the 2022 Conference on Computer Supported Cooperative Work and Social Computing

Pages 197 - 200

https://doi.org/10.1145/3500868.3559710

Published: 08 November 2022 Publication History

All formats PDF

Abstract

Current youth online safety and risk detection solutions are mostly geared toward parental control. As HCI researchers, we acknowledge the importance of leveraging a youth-centered approach when building Artificial Intelligence (AI) tools for adolescents online safety. Therefore, we built the MOSafely, Is that ‘Sus’ (youth slang for suspicious)? a web-based risk detection assessment dashboard for youth (ages 13-21) to assess the AI risks identified within their online interactions (Instagram and Twitter Private conversations). This demonstration will showcase our novel system that embedded risk detection algorithms for youth evaluations and adopted the human–in–the loop approach for using youth evaluations to enhance the quality of machine learning models.

Supplementary Material

MP4 File (MOSafely.mp4)

Supplemental video

Download
19.23 MB

References

[1]

Mamtaj Akter, Amy J Godfrey, Jess Kropczynski, Heather R Lipford, and Pamela J Wisniewski. 2022. From Parental Control to Joint Family Oversight: Can Parents and Teens Manage Mobile Online Safety and Privacy as Equals?Proceedings of the ACM on Human-Computer Interaction 6, CSCW1(2022), 1–28.

[2]

Shiza Ali, Afsaneh Razi, Seunghyun Kim, Ashwaq Alsoubai, Joshua Gracie, Munmun De Choudhury, Pamela J Wisniewski, and Gianluca Stringhini. 2022. Understanding the Digital Lives of Youth: Analyzing Media Shared within Safe Versus Unsafe Private Conversations on Instagram. In CHI Conference on Human Factors in Computing Systems. 1–14.

Digital Library

[3]

Ashwaq AlSoubai, Jihye Song, Afsaneh Razi, Nurun Naher, Munmun De Choudhury, and Pamela J Wisniewski. 2022. From ‘Friends with Benefits’ to ‘Sextortion:’ A Nuanced Investigation of Adolescents’ Online Sexual Risk Experiences.

[4]

Monica Anderson and Jingjing Jiang. 2018. Teens, Social Media & Technology 2018 | Pew Research Center. http://www.pewinternet.org/2018/05/31/teens-social-media-technology-2018/

[5]

Stevie Chancellor, Eric PS Baumer, and Munmun De Choudhury. 2019. Who is the" human" in human-centered machine learning: The case of predicting mental health from social media. Proceedings of the ACM on Human-Computer Interaction 3, CSCW(2019), 1–32.

Digital Library

[6]

Arup Kumar Ghosh, Karla Badillo-Urquiola, Mary Beth Rosson, Heng Xu, John Carroll, and Pamela J. Wisniewski. 2018. A matter of control or safety? Examining parental use of technical monitoring apps on teens’ mobile devices. In CHI 2018 - Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems: Engage with CHI. Association for Computing Machinery. https://doi.org/10.1145/3173574.3173768

Digital Library

[7]

Haiyan Jia, Pamela J Wisniewski, Heng Xu, Mary Beth Rosson, and John M Carroll. 2015. Risk-taking as a learning process for shaping teen’s online information privacy behaviors. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. 583–599.

Digital Library

[8]

Seunghyun Kim, Afsaneh Razi, Ashwaq Alsoubai, Chen Ling, Gianluca Stringhini, Pamela J. Wisniewski, and Munmun De Choudhury. 2022. I’m Talking to You: Detecting and Differentiating between Online Harassment in Networked Public vs. Private Social Media Spaces.

[9]

Seunghyun Kim, Afsaneh Razi, Gianluca Stringhini, Pamela J. Wisniewski, and Munmun De Choudhury. 2021. A Human-Centered Systematic Literature Review of Cyberbullying Detection Algorithms. Proc. ACM Hum.-Comput. Interact. 5, CSCW2, Article 325 (oct 2021), 34 pages. https://doi.org/10.1145/3476066

Digital Library

[10]

Sonia Livingstone and Ellen Helsper. 2010. Balancing opportunities and risks in teenagers’ use of the internet: the role of online skills and internet self-efficacy. New Media & Society 12, 2 (March 2010), 309–329. https://doi.org/10.1177/1461444809342697

[11]

Robert Munro Monarch. 2021. Human-in-the-Loop Machine Learning: Active learning and annotation for human-centered AI. Simon and Schuster.

[12]

Rachel Nosowsky and Thomas J Giordano. 2006. The Health Insurance Portability and Accountability Act of 1996 (HIPAA) privacy rule: implications for clinical research. Annu. Rev. Med. 57(2006), 575–590.

[13]

Afsaneh Razi, Ashwaq AlSoubai, Seunghyun Kim, Shiza Ali, Gianluca Stringhini, Munmun De Choudhury, and Pamela J Wisniewski. 2022. Sliding into My DMs: Detecting Uncomfortable or Unsafe Sexual Risk Experiences within Instagram Direct Messages Grounded in the Perspective of Youth.

[14]

Afsaneh Razi, Ashwaq AlSoubai, Seunghyun Kim, Nurun Naher, Shiza Ali, Gianluca Stringhini, Munmun De Choudhury, and Pamela J Wisniewski. 2022. Instagram Data Donation: A Case Study on Collecting Ecologically Valid Social Media Data for the Purpose of Adolescent Online Risk Detection. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1–9.

[15]

Afsaneh Razi, Seunghyun Kim, Ashwaq Alsoubai, Xavier Caddle, Shiza Ali, Munmun De Choudhury, Pamela Wisniewski, 2021. Teens at the Margin: Artificially Intelligent Technology for Promoting Adolescent Online Safety. In ACM Conference on Human Factors in Computing Systems (CHI 2021)/Artificially Intelligent Technology for the Margins: A Multidisciplinary Design Agenda Workshop.

[16]

Afsaneh Razi, Seunghyun Kim, Ashwaq Alsoubai, Gianluca Stringhini, Thamar Solorio, Munmun De Choudhury, and Pamela J. Wisniewski. 2021. A Human-Centered Systematic Literature Review of the Computational Approaches for Online Sexual Risk Detection. Proc. ACM Hum.-Comput. Interact. 5, CSCW2, Article 465 (oct 2021), 38 pages. https://doi.org/10.1145/3479609

Digital Library

[17]

Wojciech Samek, Grégoire Montavon, Andrea Vedaldi, Lars Kai Hansen, and Klaus-Robert Müller. 2019. Explainable AI: interpreting, explaining and visualizing deep learning. Vol. 11700. Springer Nature.

[18]

Ben Shneiderman, Catherine Plaisant, Maxine S Cohen, Steven Jacobs, Niklas Elmqvist, and Nicholas Diakopoulos. 2016. Designing the user interface: strategies for effective human-computer interaction. Pearson.

[19]

Pamela Wisniewski, Heng Xu, Mary Beth Rosson, Daniel F Perkins, and John M Carroll. 2016. Dear diary: Teens reflect on their weekly online risk experiences. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 3919–3930.

Digital Library

[20]

Agnieszka Wrońska, Rafał Lew-Starowicz, and Anna Rywczyńska. 2020. Education–Relationships–Play Multifaceted Aspects of the Internet and Child and Youth Online Safety. Foundation for the Development of the Education System.

Cited By

Datey IZytko D(2024)"Just Like, Risking Your Life Here": Participatory Design of User Interactions with Risk Detection AI to Prevent Online-to-Offline Harm Through Dating AppsProceedings of the ACM on Human-Computer Interaction10.1145/36869068:CSCW2(1-41)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686906
Alsoubai ARazi AAgha ZAli SStringhini GDe Choudhury MWisniewski P(2024)Profiling the Offline and Online Risk Experiences of Youth to Develop Targeted Interventions for Online SafetyProceedings of the ACM on Human-Computer Interaction10.1145/36373918:CSCW1(1-37)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637391
Park JGracie JAlsoubai ARazi AWisniewski P(2024)Personally Targeted Risk vs. Humor: How Online Risk Perceptions of Youth vs. Third-Party Annotators Differ based on Privately Shared Media on InstagramProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655799(1-13)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3655799
Show More Cited By

Index Terms

MOSafely, Is that Sus? A Youth-Centric Online Risk Assessment Dashboard
1. Computer systems organization
  1. Embedded and cyber-physical systems
    1. Embedded systems

Recommendations

Profiling the Offline and Online Risk Experiences of Youth to Develop Targeted Interventions for Online Safety
CSCW

We conducted a study with 173 adolescents (ages 13-21), who self-reported their offline and online risk experiences and uploaded their Instagram data to our study website to flag private conversations as unsafe. Risk profiles were first created based on ...
Examining the Unique Online Risk Experiences and Mental Health Outcomes of LGBTQ+ versus Heterosexual Youth
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

We collected and analyzed Instagram direct messages (DMs) from 173 youth aged 13–21 (including 86 LGBTQ+ youth). We examined youth’s risk-flagged social media trace data with their self-reported mental health outcomes to examine how the differing online ...
Stakeholder Risk Assessment: An Outcome-Based Approach

Requirements engineering must manage the risks arising from project stakeholders. The Outcome-Based Stakeholder Risk Assessment Model (Obsram) provides guidance in stakeholder identification, identification of stakeholder impacts and perceptions, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CSCW'22 Companion: Companion Publication of the 2022 Conference on Computer Supported Cooperative Work and Social Computing

November 2022

318 pages

ISBN:9781450391900

DOI:10.1145/3500868

Editors:
Gary Hsieh
University of Washington, Seattle, USA
,
Anthony Tang
University of Toronto, Toronto, Canada
,
Morgan G. Ames
University of California Berkeley, Berkeley, USA
,
Sharon Ding
University of Glasgow, Glasgow, UK
,
Susan Fussell
Cornell University, Ithaca, USA
,
Vera Liao
Microsoft Research, Montreal, Canada
,
Andrés Monroy-Hernández
Princeton University, Princeton, USA
,
Sean Munson
University of Washington, Seattle, USA
,
Irina Shklovski
University of Copenhagen, Copenhagen, Denmark
,
John Tang
Microsoft Research, Sunnyvale, USA

Copyright © 2022 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 November 2022

Check for updates

Qualifiers

Extended-abstract
Research
Refereed limited

Funding Sources

National Science Foundation

Conference

CSCW '22

Sponsor:

SIGCHI

CSCW '22: Computer Supported Cooperative Work and Social Computing

November 8 - 22, 2022

Virtual Event, Taiwan

Acceptance Rates

Overall Acceptance Rate 2,235 of 8,521 submissions, 26%

Upcoming Conference

CSCW '25

Sponsor:
sigchi

Computer-Supported Cooperative Work and Social Computing

October 18 - 22, 2025

Bergen , Norway

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
384
Total Downloads

Downloads (Last 12 months)224
Downloads (Last 6 weeks)30

Reflects downloads up to 15 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Datey IZytko D(2024)"Just Like, Risking Your Life Here": Participatory Design of User Interactions with Risk Detection AI to Prevent Online-to-Offline Harm Through Dating AppsProceedings of the ACM on Human-Computer Interaction10.1145/36869068:CSCW2(1-41)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686906
Alsoubai ARazi AAgha ZAli SStringhini GDe Choudhury MWisniewski P(2024)Profiling the Offline and Online Risk Experiences of Youth to Develop Targeted Interventions for Online SafetyProceedings of the ACM on Human-Computer Interaction10.1145/36373918:CSCW1(1-37)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637391
Park JGracie JAlsoubai ARazi AWisniewski P(2024)Personally Targeted Risk vs. Humor: How Online Risk Perceptions of Youth vs. Third-Party Annotators Differ based on Privately Shared Media on InstagramProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655799(1-13)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3655799
Qadir SNiser ACaddle XAlsoubai APark JWisniewski P(2024)Towards a Safer Digital Future: Exploring Stakeholder Perspectives on Creating a Sustainable Youth Online Safety CommunityExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651019(1-10)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3651019
Cullen SJohnson EWisniewski PPage X(2024)Towards Digital Independence: Identifying the Tensions between Autistic Young Adults and Their Support Network When Mediating Social MediaProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642567(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642567
Alsoubai APark JQadir SStringhini GRazi AWisniewski P(2024)Systemization of Knowledge (SoK): Creating a Research Agenda for Human-Centered Real-Time Risk Detection on Social Media PlatformsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642315(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642315
Zheng WWalquist EDatey IZhou XBerishaj KMcdonald MParkhill MZhu DZytko D(2024)“It’s Not What We Were Trying to Get At, but I Think Maybe It Should Be”: Learning How to Do Trauma-Informed Design with a Data Donation Platform for Online Dating Sexual ViolenceProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642045(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642045
Zheng WWalquist EDatey IZhou XBerishaj KMcdonald MParkhill MZhu DZytko D(2023)Towards Trauma-Informed Data Donation of Sexual Experience in Online Dating to Improve Sexual Risk Detection AIAdjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586182.3616689(1-3)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586182.3616689
Ali SRazi AKim SAlsoubai ALing CDe Choudhury MWisniewski PStringhini G(2023)Getting Meta: A Multimodal Approach for Detecting Unsafe Conversations within Instagram Direct Messages of YouthProceedings of the ACM on Human-Computer Interaction10.1145/35796087:CSCW1(1-30)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579608
Razi AAlsoubai AKim SAli SStringhini GDe Choudhury MWisniewski P(2023)Sliding into My DMs: Detecting Uncomfortable or Unsafe Sexual Risk Experiences within Instagram Direct Messages Grounded in the Perspective of YouthProceedings of the ACM on Human-Computer Interaction10.1145/35795227:CSCW1(1-29)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579522

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents