Comparative Study of LSTM and T5-Flan Models for Automated Test Case Generation from Gherkin Requirements

Project by Polygence alum Sree harshini

Comparative Study of LSTM and T5-Flan Models for Automated Test Case Generation from Gherkin Requirements

Project's result

Working models for both the LSTM and T5-Flan models (trained from scratch) along with a research paper.

They started it from zero. Are you ready to level up with us?

Summary

This paper investigates the application of LSTM and T5-Flan models for generating test cases from simplified Gherkin requirements in automated software testing. Automated test case generation using AI models has gained prominence recently, offering substantial benefits in efficiency and reliability. Therefore, understanding the comparative strengths of different models in this domain is helpful for optimizing software testing practices.In this study, we compare and analyze the performance of both models in terms of accuracy and efficiency, using a diverse dataset of Gherkin scenarios and evaluation metrics such as BLEU, ROGUE, BERTScore, and Semantic Similarity. The findings demonstrate that T5-Flan consistently outperforms LSTM across all metrics, showcasing superior capability in capturing complex dependencies and semantic nuances present in Gherkin requirements.

Mohith

Mohith

Polygence mentor

MS Master of Science

Subjects

Business, Quantitative, Engineering, Computer Science

Expertise

Business, Econ, App development, Web Development, AI/ML Algorithm development, other Computer Science areas, High School subjects

Sree harshini

Sree harshini

Student

Hello my name is Sree harshini (but everyone just calls me Sree) and my project is a Comparative Study of LSTM and T5-Flan Models for Automated Test Case Generation.

Graduation Year

2025

Project review

“My project taught me a lot about a field I never thought I could understand. I truly learned a lot and now feel more confident about myself and my major.”

About my mentor

“Mohith was very chill and fun to work with :) He kept the project proceeding smoothly and helped me a lot whenever I needed it.”