Asking ChatGPT for Pattern Recommendations: EuroPLoP 2024 Focus Group Report
Article No.: 37, Pages 1 - 7
Abstract
This report summarizes a focus group held at EuroPLoP 2024 on using ChatGPT as a recommender for design patterns. Apart from the organizers, 11 participants from academia and industry took part in the focus group.
In this focus group, we discussed the results of two experiments exploring how well ChatGPT gives recommendations on using patterns from the GoF collection when a situation is described which suggests the application of such a pattern. It was found that the responses are promising in many cases, but their quality depends on a good choice of prompts. The quality of the responses was comparable for prompts in English, German, and Russian, but a little lower for Arabic and absolutely useless in Kyrgyz. Based on our observations, some recommendations are given for selecting suitable prompts when communicating with the chatbot.
References
[1]
Amos Azaria, Rina Azoulay, and Shulamit Reches. 2023. ChatGPT is a Remarkable Tool - For Experts. CoRR abs/2306.03102 (2023).
[2]
Alessio Bucaioni, Hampus Ekedahl, Vilma Helander, and Phuong T. Nguyen. 2024. Programming with ChatGPT: How far can we go? Machine Learning with Applications 15 (2024), 100526.
[3]
Alessio Buscemi. 2023. A Comparative Study of Code Generation using ChatGPT 3.5 across 10 Programming Languages. CoRR abs/2308.04477 (2023).
[4]
Erich Gamma, Richard Helm, Ralph Johnson, and John Vlissides. 1994. Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley.
[5]
Matthias Geirhos. 2015. Entwurfsmuster: Das umfassende Handbuch für Softwareentwickler. Rheinwerk Computing.
[6]
Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. 2022. Large Language Models are Zero-Shot Reasoners. In Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, NeurIPS 2022, Sanmi Koyejo, S. Mohamed, A. Agarwal, Danielle Belgrave, K. Cho, and A. Oh (Eds.).
[7]
Yue Liu, Thanh Le-Cong, Ratnadira Widyasari, Chakkrit Tantithamthavorn, Li Li, Xuan-Bach Dinh Le, and David Lo. 2023. Refining ChatGPT-Generated Code: Characterizing and Mitigating Code Quality Issues. CoRR abs/2307.12596 (2023).
[8]
J. J. Maranhão, F. F. Correia, and E. Guerra. 2023. Can ChatGPT suggest patterns? An exploratory study about answers given by ai-assisted tools to design problems. In AI-Assisted Agile Software Development Workshop at XP2023 conference.
[9]
Nhan Nguyen and Sarah Nadi. 2022. An Empirical Evaluation of GitHub Copilot’s Code Suggestions. In 19th IEEE/ACM International Conference on Mining Software Repositories, MSR 2022, Pittsburgh, PA, USA, May 23-24, 2022. ACM, 1–5.
[10]
Hanan Samet. 2006. Foundations of multidimensional and metric data structures. Academic Press.
[11]
Bruce Schneier and John Kelsey. 1999. Secure audit logs to support computer forensics. ACM Trans. Inf. Syst. Secur. 2, 2 (May 1999), 159–176.
[12]
Mohamed L. Seghier. 2023. ChatGPT: not all languages are equal. Nature 615, 216 (2023).
[13]
Alexander Shvets. 2021. Dive Into Design Patterns. Refactoring.guru (e-book).
[14]
Jules White, Quchen Fu, Sam Hays, Michael Sandborn, Carlos Olea, Henry Gilbert, Ashraf Elnashar, Jesse Spencer-Smith, and Douglas C. Schmidt. 2023. A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT. CoRR abs/2302.11382 (2023).
Index Terms
- Asking ChatGPT for Pattern Recommendations: EuroPLoP 2024 Focus Group Report
Index terms have been assigned to the content through auto-classification.
Recommendations
Dramatizing Software Patterns: Focus Group Report
EuroPLoP '23: Proceedings of the 28th European Conference on Pattern Languages of ProgramsThe focus group on drama patterns we organized at EuroPLoP 2023 attracted 16 participants (apart from the organizers), who together built a short drama play (created by Aleksandra Vranić) based on the motifs from the stories of Alice in Wonderland. We ...
Exploring Older Adults' Reminiscing with ChatGPT and Text-to-Image Technology
ASSETS '24: Proceedings of the 26th International ACM SIGACCESS Conference on Computers and AccessibilityAs individuals enter their later years, they often reminisce about their past, which can significantly enhance their well-being. Current research on technology-mediated reminiscence in HCI tends to position older adults as passive subjects in ...
15 design patterns for pattern illustrating
PLoP '18: Proceedings of the 25th Conference on Pattern Languages of ProgramsThis paper presents fifteen design patterns for Pattern Illustrating, which support people to create good pattern illustrations. Pattern Illustrating is a process of visualizing the essence of each pattern symbolically, conducted after Pattern Mining ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
July 2024
427 pages
ISBN:9798400716836
DOI:10.1145/3698322
Copyright © 2024 Copyright held by the owner/author(s). Publication rights licensed to ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 10 December 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
EuroPLoP 2024
EuroPLoP 2024: 29th European Conference on Pattern Languages of Programs, People, and Practices
July 3 - 7, 2024
Irsee, Germany
Acceptance Rates
Overall Acceptance Rate 216 of 354 submissions, 61%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 1Total Downloads
- Downloads (Last 12 months)1
- Downloads (Last 6 weeks)1
Reflects downloads up to 13 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format