Paulo José Matos

GAlp (Portugal)

Test Generation Reloaded: How to Accelerate Test Design with AI & RAG — Without Breaking ISTQB Best Practices

Artificial Intelligence is making test case generation faster and more accessible, but speed alone does not guarantee quality, traceability, or maintainability. This paper explores how AI-powered assistants and Retrieval-Augmented Generation (RAG) can be applied to accelerate test design while remaining aligned with ISTQB best practices. It argues that effective AI-assisted test case creation depends not only on the model itself, but on the disciplined combination of context retrieval, prompt engineering, constraints, and output structure. The paper introduces a practical approach for using AI in test design by combining requirement and risk information with prompting techniques such as prompt chaining, few-shot prompting, and structured role-based instructions. It also discusses the limitations of large language models, particularly outdated public knowledge and the absence of internal organizational context, and presents RAG as a way to ground generated test cases in reliable project-specific information. In addition, the paper outlines a lightweight implementation path using local and privacy-aware tooling for experimentation and adoption. The session’s main contribution is a pragmatic framework for making AI a trusted partner in test case design rather than an opaque black box, enabling faster generation without compromising sound testing principles.


Comprar Tickets

Paulo is a Quality Assurance and Testing enthusiast with over 18 years of experience in the field with experience with C-level exposure reporting.

Throughout his career, he has conducted manual and automated testing, implemented performance testing practices, audited development processes based on ISO 25000 amd 29119 standards, and built QA teams from scratch.

In his current role, he has managed nearly 30 concurrent projects and led more than 45 testers at Galp, the largest oil and gas company in Portugal. He holds a master’s degree in software with theme “Energy Consumption Testing” and is currently pursuing a PhD in Web Science and Technology, focusing on ‘AI-Augmented Software Testing: Towards a Framework for Integrating Large Language Models and Other AI Techniques’.

Paulo holds ISTQB Foundation, Agile, and Advanced Level certifications and actively contributes to the testing community as a speaker and event organizer.