[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content
Springer Nature Link
Log in

An efficient automated multi-modal cyberbullying detection using decision fusion classifier on social media platforms

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Cyberbullying poses a dangerous threat to teens, children, young people, and adults in today’s digital world. Bullies use virtual social media platforms like Twitter, Facebook, YouTube, and Instagram to harm their victims. Therefore, this online bullying (cyberbullying) is now rising as an important societal issue that affects the person emotionally and psychologically. Among the number of studies conducted to deal with cyberbullying detection, most of them are limited to only text-based content. Since the network is continuously growing, the presence of visual and audio based provoking is also needed to be considered. Therefore, the proposed study aims to develop an automatic multi-modal cyberbullying detection on social media platforms through Multi-modal Decision Fusion Classifier. The proposed multi-modal cyberbullying detection steps are data collection, multi-modality generation, score-based fusion and classification. Multiple major modalities, such as audio, visual and textual, are initially gathered from appropriate datasets. The data collected is provided as input to a multi-modal generation, where the modality is generated separately for each input. The text modality is initially generated using the hybrid Bi-directional Long Short-Term Memory assisted Attention Hierarchical Capsule Network (BiLSTM-AHCNet) model. Next, the imaging modality is generated with the Tuned Aquila EfficientB0 (Tuned AEB0) model. Finally, the audio features are extracted through the Librosa library, and the extracted features are fed to the Attention Convolutional Neural Network (ACNN) model for acoustic modality generation. In the proposed work, the Multi-Modality Decision Fusion Classifier (MMDFC) is employed to fuse all modalities, and the classification is performed by adopting the softmax layer. In addition, a weighting scheme based on horse herd optimization is applied in the fusion phase to allow accurate characterization of the features. For the simulation analysis, the proposed study used Python, and the effectiveness of the proposed techniques is analyzed by measuring several performance metrics like accuracy (98.23%), F-measure (98.22%), specificity (98.47%) and AUC (0.982).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability

Data sharing is not applicable to this article.

References

  1. Alam F, Cresci S, Chakraborty T, Silvestri F, Dimitrov D, Martino GDS, Shaar S, Firooz H, Nakov P (2021) A survey on multi-modal disinformation detection. In: Proceedings of the 29th international conference on computational linguistics, Gyeongju, Republic of Korea. International cCommittee on computational linguistics, pp 6625–6643

  2. Alotaibi M, Alotaibi B, Razaque A (2021) A multichannel deep learning framework for cyberbullying detection on social media. Electronics 10(21):2664

    Article  Google Scholar 

  3. Bozyiğit A, Utku S, Nasibov E (2021) Cyberbullying detection: Utilizing social media features. Expert Syst Appl 179:115001

    Article  Google Scholar 

  4. Chatzakou D, Kourtellis N, Blackburn J, De Cristofaro E, Stringhini G, Vakali A (2017) Mean birds: detecting aggression and bullying on twitter. In: Proceedings of the 2017 ACM on web science conference, pp 13–22

  5. Cheng L, Silva YN, Hall D, Liu H (2020) Session-based cyberbullying detection: problems and challenges. IEEE Internet Comput 25(2):66–72

    Article  Google Scholar 

  6. Cheng L, Shu K, Wu S, Silva YN, Hall DL, Liu H (2020) Unsupervised cyberbullying detection via time-informed gaussian mixture model. 185–194

  7. Fang Y, Yang S, Zhao B, Huang C (2021) Cyberbullying detection in social networks using bi-gru with self-attention mechanism. Information 12(4):171

    Article  Google Scholar 

  8. Gomez R, Gibert J, Gomez L, Karatzas D (2020) Exploring hate speech detection in multi-modal publications. In: Proceedings of the IEEE/CVF winter conference on applications of computer vision, pp 1470–1478

  9. Haidar B, Chamoun M, Serhrouchni A (2018) Arabic cyberbullying detection: using deep learning. In: 2018 7th international conference on computer and communication engineering (ICCCE) IEEE, pp 284–289

  10. Islam MM, Uddin MA, Islam L, Akter A, Sharmin S, Acharjee UK (2020) Cyberbullying detection on social networks using machine learning approaches. In: 2020 IEEE Asia-Pacific conference on computer science and data engineering (CSDE), pp 1–6

  11. Iwendi C, Srivastava G, Khan S, Maddikunta PKR (2020) Cyberbullying detection solutions based on deep learning architectures. Multimed Syst 29(1):1–14

  12. Kumar A, Sachdeva N (2020) Multi-input integrative learning using deep neural networks and transfer learning for cyberbullying detection in real-time code-mix data. Multimed Syst 28(6):2027–2041

  13. Kumar A, Sachdeva N (2021) Multi-modal cyberbullying detection using capsule network with dynamic routing and deep convolutional neural network. Multimed Syst 28(6):1–10

  14. Kumar A, Sachdeva N (2022) A bi-GRU with attention and CapsNet hybrid model for cyberbullying detection on social media. World Wide Web 25(4):1537–1550

    Article  Google Scholar 

  15. Kumar S, Mahanti P, Wang S (2019) Intelligent computational techniques for multi-modal data. Multimed Tools Appl 78(17):23809–23814

    Article  Google Scholar 

  16. Kumari K, Singh JP (2021) Identification of cyberbullying on multi-modal social media posts using genetic algorithm. Trans Emerg Telecommun Technol 32(2):e3907

    Article  Google Scholar 

  17. Kumari K, Singh JP, Dwivedi YK, Rana NP (2020) Towards cyberbullying-free social media in smart cities: a unified multi-modal approach. Soft Comput 24(15):11059–11070

    Article  Google Scholar 

  18. Kumari K, Singh JP, Dwivedi YK, Rana NP (2021) Multi-modal aggression identification using convolutional neural network and binary particle swarm optimization. Futur Gener Comput Syst 118:187–197

    Article  Google Scholar 

  19. Maity K, Jha P, Saha S, Bhattacharyya P (n.d.) A multitask framework for sentiment, emotion and sarcasm aware cyberbullying detection from multi-modal code-mixed memes. In: SIGIR '22: Proceedings of the 45th International ACM SIGIR conference on research and development in information retrieval July 2022, pp 1739–1749

  20. Menini S, Aprosio AP, Tonelli S (2020) A multi-modal dataset of images and text to study abusive language. In: Seventh Italian conference on computational linguistics, CLiC-it 2769. CEUR-WS. org, pp 290–295

  21. Nandhini BS, Sheeba JI (2015) Cyberbullying detection and classification using information retrieval algorithm. In: Proceedings of the 2015 international conference on advanced research in Computer Science Engineering & Technology (ICARCSET 2015), pp 1–5

  22. Paul S, Saha S (2020) CyberBERT: BERT for cyberbullying identification. Multimedia Systems 28(6):1897–1904

  23. Paul S, Saha S, Hasanuzzaman M (2020) Identification of cyberbullying: a deep learning based multi-modal approach. Multimed Tools Appl 1–20

  24. Rezvani N, Beheshti A (2021) Towards attention-based context-boosted cyberbullying detection in social media. J Data Intell 2(4):418–433

    Article  Google Scholar 

  25. Roy PK, Mali FU (2022) Cyberbullying detection using deep transfer learning. Complex Intell Syst 25:1–9

    Google Scholar 

  26. Sui J (2015) Understanding and fighting bullying with machine learning. PhD diss., The University of Wisconsin-Madison

  27. Sweta A, Awekar A (2018) Deep learning for detecting cyberbullying across multiple social media platforms. In: European conference on information retrieval, Springer 141–153

  28. Vishwamitra N, Hu H, Luo F, Cheng L (2021) Towards understanding and detecting cyberbullying in real-world images. In: 2020 19th IEEE international conference on machine learning and applications (ICMLA)

Download references

Funding

No funding is provided for the preparation of the manuscript.

Author information

Authors and Affiliations

  1. Computer Science and Engineering, Oriental University, Indore, Maharashtra, 453555, India

    Neha Minder Singh & Sanjay Kumar Sharma

Authors
  1. Neha Minder Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sanjay Kumar Sharma
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors read and approved the final manuscript.

Corresponding author

Correspondence to Neha Minder Singh.

Ethics declarations

Conflict of interest

Authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Consent to participate

All the authors involved have agreed to participate in this submitted article.

Consent to publish

All the authors involved in this manuscript give full consent for publication of this submitted article.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Singh, N.M., Sharma, S.K. An efficient automated multi-modal cyberbullying detection using decision fusion classifier on social media platforms. Multimed Tools Appl 83, 20507–20535 (2024). https://doi.org/10.1007/s11042-023-16402-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-16402-w

Keywords

Search

Navigation