Staff Quality Engineer at StackAdapt | AdTechTalent
Engineering2 months agoRemote
StackAdapt
Staff Quality Engineer
quality engineeringtest automationAI testingLLMagentic systemsTypeScriptPythonJavaScriptJavaPlaywrightCypressJestJunitOpenAIAnthropicCI/CDJenkinsGithub ActionsCircleCIReactTestRailsoftware qualityautomationnon-deterministic systems
Key details
Salary
Not specified
Employment type
Full-time
Seniority
Senior
Years experience
5-10
Location
Canada; United States
Full job description
StackAdapt seeks a Staff Quality Engineer to lead quality strategy for AI and agentic products within the Automation and Intelligence Pillar pod. This senior individual contributor role involves designing test architecture, building evaluation frameworks for non-deterministic AI systems, developing scalable automated test suites integrated into CI/CD pipelines, and establishing quality metrics. The engineer will collaborate with cross-functional teams, mentor QE staff, participate in technical planning, and provide actionable test feedback. Requirements include 7+ years in software quality and test automation, experience with API and UI automation frameworks (Playwright, Cypress, Jest, Junit), fluency in TypeScript, JavaScript, Python, or Java, experience testing AI systems and using AI for automation, knowledge of CI/CD tools (Jenkins, Github Actions, CircleCI), and understanding of scalable system design and QA methodologies. Benefits include competitive salary, retirement plans, paid time off, mental health programs, health benefits, work from home reimbursements, global WeWork membership, training, personal development support, parental leave, and a supportive culture. The role is remote-first, open to candidates in Canada and the United States.
What you'll do
Similar jobs
More roles worth a look
Related opportunities based on specialty and working model so candidates can keep momentum.
Own and drive the end-to-end quality strategy for the Automation and Intelligence Pillar pod's AI products
Design and build evaluation frameworks for non-deterministic systems including LLM output quality, agent behaviour, regression detection, and guardrail/safety testing
Develop reliable, scalable automated test suites and tooling for functional, system, API, integration, UI, and regression testing integrated into CI/CD pipeline
Establish quality metrics and benchmarks (accuracy, latency, cost, hallucination/failure rates) to inform data-driven decisions
Partner with Engineering Managers, Product Managers, Designers, ML/Data Science, and other engineering teams to align requirements and priorities
Act as a technical mentor and promote QE best practices across the organization
Participate in technical planning, code review, and architectural decision-making advocating for testability and reliability
Provide timely, actionable test result feedback to relevant teams and stakeholders
Requirements
7+ years of professional, hands-on software quality and test automation experience
Experience setting technical direction on complex systems
Deep, hands-on experience with API & UI test automation frameworks such as Playwright, Cypress, Jest, or Junit
Fluency in at least one of TypeScript, JavaScript, Python, or Java with preference for TypeScript
Experience testing AI/agentic systems (evals, prompt/regression testing, output validation)
Experience using AI to scale automation (test generation, self-healing tests, failure triage) with technologies such as OpenAI, Anthropic
Experience with CI/CD tools like Jenkins, Github Actions, or CircleCI
Strong understanding of scalable system design for web-based APIs and backend processing systems
In-depth understanding of QA methodologies in a software company with fast release cycles
Ability to define test case design standards and coverage strategy including edge/negative, compatibility, performance and concurrency scenarios
Experience owning a test case management practice (e.g. TestRail)
Knowledge of React, including adding data-testids
Ability to explore a codebase and use technical tools to understand technical implementation
Experience coaching and influencing cross-functional teams on tooling, testing plans and strategies
Highly competitive salaryRetirement/401K/Pension Savings globallyCompetitive paid time off packages including birthdays offAccess to a comprehensive mental health care programHealth benefits from day one of employmentWork from home reimbursementsOptional global WeWork membership with hubs in London and TorontoRobust training and onboarding programCoverage and support of personal development initiatives (conferences, courses, books etc)Access to StackAdapt programmatic courses and certificationsParental leave programFriendly, welcoming, and supportive cultureSocial and team events
Apply now
Ready to take the next step in your career? Click the button below to continue to the application process.
