We introduce a novel automated testing technique that combines LLM and search-based fuzzing. We use ChatGPT to parameterise C programs. We compile the resultant code snippets, and feed compilable ones to SearchGEM5 — our extension to AFL++ fuzzer with customised new mutation operators. We run thus created 4005 binaries through our system under test, gem5, increasing its existing test coverage by more than 1000 lines. We discover 244 instances where gem5 simulation of the binary differs from the binary’s expected behaviour.
|Title of host publication
|15th Symposium on Search Based Software Engineering (SSBSE)
|Subtitle of host publication
|Lecture Notes in Computer Science
|Place of Publication
|Number of pages
|Published - 8 Dec 2023
- genetic improvement of tests
FingerprintDive into the research topics of 'SearchGEM5: Towards Reliable gem5 with Search Based Software Testing and Large Language Models'. Together they form a unique fingerprint.
Prize: Other distinction