Investigating the Use of Topic Modeling for Social Media Market Research: A South African Case Study
Pages 305 - 320
Abstract
Businesses are increasingly investigating the use of data science and machine learning techniques for market research. This paper investigates the use of topic modeling as a tool for social media market research, specifically the influence and impact of this technology within market research practice. As an example of the use of topic modeling, three different topic modeling algorithms are applied to a single dataset extracted from Reddit, and their performance compared. The latent Dirichlet allocation (LDA) algorithm was trained as a baseline and compared to the Correlated topic model (CTM) and the Gibbs sampling for Dirichlet multinomial mixtures (GSDMM) model. The CTM outperformed the LDA model, while the GSDMM was unable to improve on the baseline. The 25 topics produced by the final CTM were investigated in greater detail and interpreted within the context of market research. Although five of these topics did not prove useful, the remaining topics were easily interpreted and divided into six categories related to (1) features, (2) software, (3) acquisition, (4) workouts, (5) physical design, and (6) physiological monitoring. Each category’s topics were able to provide valuable insight regarding consumers’ opinions about and experiences of the related product.
References
[1]
Aggarwal CC and Zhai C Mining Text Data 2012 New York Springer
[2]
Asuncion, A., Welling, M., Smyth, P., Teh, Y.W.: On smoothing and inference for topic models. In: Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence, UAI 2009, pp. 27–34 (2009)
[3]
Batrinca B and Treleaven PC Social media analytics: a survey of techniques, tools and platforms AI Soc. 2015 30 1 89-116
[4]
Bendle NT and Wang XS Uncovering the message from the mess of big data Bus. Horiz. 2016 59 1 115-124
[5]
Blei, D., Lafferty, J.: Correlated topic models. In: Advances in Neural Information Processing Systems, vol. 18, p. 147 (2006)
[6]
Blei DM, Ng AY, and Jordan MI Latent dirichlet allocation J. Mach. Learn. Res. 2003 3 993-1022
[7]
Boyd-Graber J, Mimno D, and Newman D Care and Feeding of Topic Models: Problems, Diagnostics, and Improvements 2014 Boca Raton CRC Press
[8]
Chang, J., Boyd-Graber, J., Wang, C., Gerrish, S., Blei, D.M.: Reading tea leaves: how humans interpret topic models. In: Neural Information Processing Systems, vol. 22, pp. 288–296. Citeseer (2009)
[9]
Chernova, V., Starostin, V.: Leading trends in marketing research: a case of big data. In: 5th International Conference on Social, Economic, and Academic Leadership (ICSEALV 2019), pp. 210–215. Atlantis Press (2020)
[10]
Cluley R, Green W, and Owen R The changing role of the marketing researcher in the age of digital technology: practitioner perspectives on the digitization of marketing research Int. J. Mark. Res. 2020 62 1 27-42
[11]
Newman, D., Lau, J.H., Grieser, K., Baldwin, T.: Automatic evaluation of topic coherence. In: Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pp. 100–108 (2010)
[12]
Nunan D and Di Domenico M Market research and the ethics of big data Int. J. Mark. Res. 2013 55 4 505-520
[13]
Patino A, Pitta DA, and Quinones R Social media’s emerging importance in market research J. Consum. Mark. 2012 29 3 233-237
[14]
Qiang J, Qian Z, Li Y, Yuan Y, and Wu X Short text topic modeling techniques, applications, and performance: a survey IEEE Trans. Knowl. Data Eng. 2020 34 3 1427-1445
[15]
Röder, M., Both, A., Hinneburg, A.: Exploring the space of topic coherence measures. In: Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, pp. 399–408 (2015)
[16]
Yin, J., Wang, J.: A dirichlet multinomial mixture model-based approach for short text clustering. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 233–242 (2014)
Recommendations
Latent Dirichlet allocation (LDA) and topic modeling: models, applications, a survey
Topic modeling is one of the most powerful techniques in text mining for data mining, latent data discovery, and finding relationships among data and text documents. Researchers have published many articles in the field of topic modeling and applied in ...
Topic Modeling Techniques for Text Mining Over a Large-Scale Scientific and Biomedical Text Corpus
Topic models are efficient in extracting central themes from large-scale document collection and it is an active research area. The state-of-the-art techniques like Latent Dirichlet Allocation, Correlated Topic Model (CTM), Hierarchical Dirichlet ...
Investigating the Sentiment in Italian Long-COVID Narrations
Computational Science – ICCS 2023AbstractThrough an overview of the history of the disease, Narrative Medicine (NM) aims to define and implement an effective, appropriate and shared treatment path. In the context of COVID-19, several blogs were produced, among those the “Sindrome Post ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Jul 2023
599 pages
ISBN:978-3-031-36807-3
DOI:10.1007/978-3-031-36808-0
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2023.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 03 July 2023
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 26 Dec 2024