Senior QA Engineer

Keyloop Keyloop bridges the gap between dealers, manufacturers, technology suppliers and car buyers. We empower car dealers and manufacturers to fully embrace digital transformation. How? By creating innovative technology that makes selling cars better for our customers, and buying and owning cars better for theirs. We use cutting-edge technology to link our clients’ systems, departments and sites. We provide an open technology platform that’s shaping the industry for the future. We use data to help clients become more efficient, increase profitability and give more customers an amazing experience. We’re excited to announce that Motortech AI are joining the Keyloop family. Bringing their industry leading AI-powered live chat solution, AIME, to Keyloop, we will revolutionize the customer experience in automotive. Their solution will begin rolling out to our thousands of existing clients, as well as many newcomers, this Spring. Want to be part of it? The Role: As a Senior QA Engineer, you'll own quality across our product portfolio. You'll define and lead our quality strategy across the full platform, from backend services and agent orchestration through to omnichannel communications. You'll work closely with engineers and product to build in quality from the start, not just a manual check at the end. You’ll design and execute tests to measure the quality of our AI agents, testing for probabilistic outputs, expected reasoning behaviours, performance and overall security. What You'll Be Doing: - Design and own the quality strategy for our AI agent platform, including approaches to testing non-deterministic, LLM-powered systems. - Build and maintain automated test suites covering unit, integration, API, and end-to-end scenarios across our TypeScript/Node.js/React/Python stack. - Develop evaluation frameworks for agent behaviour, testing reasoning quality, tool use, memory, and multi-step interaction flows. - Test and validate our omnichannel communication platform across channels: web, messaging, voice, and beyond. - Collaborate closely with engineers and define acceptance criteria that catch issues early in the development cycle. - Champion a culture of quality across the team, reviewing test coverage in PRs, advocating for testability in system design, and raising the bar for what "done" means. - Use and help shape AI-assisted testing tooling to accelerate coverage and surface issues faster.