Daniel Nilsson and Mert Yurdakul
Test Scouts (Sweden)
Spotting Twins - A Large Language Model Approach to Duplicate Defect Detection in Software Development
Artificial Intelligence, Machine Learning and Large Language Models has been main discussion topics in social media for some time now both from a general perspective but also specifically within Software Testing. However, the conversation quickly ends up in a discussion if AI will replace the tester or not, instead of in which situations it creates value. We have instead started from the daily activities that we as testers work with and tried to identify where there are bottlenecks and time wasters that could at the same time be suitable for using an AI-based solution to remove those. In this project we have addressed duplicates bug reports as being a huge time waster in large projects in large organizations. Given that defect reports are composed in natural language, the core of this issue resides within the realm of natural language processing. In recent years, large language models, which are based on a neural network architecture called a transformer, have been showing impressive results in natural language processing tasks, namely, understanding, generating, and interacting with human language. Therefore, our proposed method utilizes several large language models to understand given defect reports and to detect duplicates in a dataset of defect reports.
Buy Tickets nowMert pursued his master’s degree in data science & AI at Chalmers University of Technology located in Gothenburg, Sweden. He conducted his master’s thesis at AstraZeneca on automating molecular structure elucidation using machine learning techniques. He has been working at Test Scouts for about 1 year focusing on testing AI-driven systems and developing an internal AI testing tool. He also serves as the industrial supervisor for two groups of thesis students from the University of Gothenburg. Mert is a first-time speaker at international testing conferences but have within his relatively short working career already experience from customer presentations and speaking at local test communities.”