LLM glitch detection in games and testing antipatterns

Welcome back to the Regression Games newsletter, covering the latest in automated game testing.

Join our community on Discord and check out our tools!

Article Highlight - Testing Antipattern: Depending on Real Game Features by Henry Golding

This past week, I shared a blog post on self-healing testing in games, where LLMs are used to fix broken tests automatically. In the Automated Testing in Games Discord (join if you haven’t!), Henry Golding brought up some great points about how self-healing tests might hide tests that are badly designed in the first place. He shared his article on an example of this testing antipattern, and it’s a great read!

Trello Board of Resources in Automated QA

Looking for a collection of great resources to learn more about automation in game QA? This Trello Board has a ton of articles, tutorials, talks, and tools for getting started, whether it be bots, general advice, CI pipelines, and other topics in this space.

Link: https://trello.com/b/nGE5yqZk/game-automated-testing-resource-hub

Papers we’ve been reading

In today’s Reading Club (held in our Discord every Friday at 2pm ET) we are discussing GlitchBench: Can large multimodal models detect video game glitches? In this paper, the authors introduce a dataset of game screenshots with a goal of identifying bugs in those images, such as clipping, missing textures, incorrect character poses, and more.

Members of our community discuss these papers on our Discord #reading-club channel. You can also find all past resources on our GitHub.

Have feedback about our newsletter? Let us know at [email protected]

You are receiving this email because you registered on our mailing list or are a developer on our platform.