AdTechTalent
Other7 days agoOn-site

Merkle

Senior QA Engineer (Manual+AI)

AI testingmanual testingtest casesregression testingintegration testingsystem testingAPI testingJIRAGitplaywrightcodeceptJSAzureResponsible AIbias testingcontent safetyperformance testingJMeterGenerative AIhallucination detectionmultimodal AI

Key details

Salary

Not specified

Employment type

Full-time

Seniority

Mid-level

Years experience

3-5

Location

Bengaluru, India; Gurugram, India; Mumbai, India; Pune, India

Full job description

Role involves manual testing and AI output validation to ensure software meets business needs. Responsibilities include developing and executing test cases, ensuring test coverage, logging defects, validating AI generated images, videos, recommendations, coordinating with product and developers, performing acceptance, integration, installation, system testing, and maintaining QA documentation. Requires 4-6 years experience, Agile team experience, strong test case writing and AI output review skills, proficiency in functional, regression, integration, exploratory and system testing, API testing, familiarity with JIRA and Git, and strong communication skills. Good to have knowledge of testing frameworks (playwright, codeceptJS), multimodal AI testing, Azure cloud, Responsible AI, bias testing, content safety, data validation, model output comparison, and performance testing tools like JMeter.

What you'll do

  • Develops and executes accurate test cases as per requirements, analyses results and raises issues within schedule
  • Ensures optimal test coverage comprising of positive, negative and exception scenarios
  • Logs defects with right priority, tracking them to closure and understanding the root cause for an issue
  • Tests and proves that the software meets major architectural requirements
  • Provides feedback on usability and serviceability, traces the result to quality risk and reports it to concerned people
  • Validates AI generated images, video outputs, recommendations and end-user workflows across supported scenarios
  • Coordinates with product management and Developer/System Engineer to deliver stable enterprise software products
  • Analyses and verifies best test approaches and executes acceptance, integration, installation, and system testing
  • Records test results, validates defect fixes and verifies overall quality acceptance criteria
  • Engages in both functional and non-functional testing
  • Participates in Requirement understanding, Scrum meeting, reviews and test strategy sessions
  • Creates and maintains QA and project documentation
  • Analyses problems reported in production application, identifies root causes and communicates results with appropriate stakeholders towards resolution

Requirements

  • Minimum 4 to 6 years of experience
  • Hands on experience in working with Agile Teams
  • Ability to implement test plans, follow test process, and record results
  • Strong expertise in writing test cases, reviewing AI outputs, and analyzing test results
  • Proficiency in functional, regression, integration, exploratory and system testing
  • Experience testing AI-powered applications involving image, videos
  • Understanding of Generative AI concepts, prompt testing, hallucination detection and output quality assessment
  • Experience validating AI recommendations, image updates, video outputs and content transformations
  • Hands-on experience in API Testing
  • Familiarity with tools such as JIRA and Git
  • Strong attention to detail and commitment to quality
  • Strong communication skills and ability to solve problems
  • Should be able to provide reports to senior stakeholders
  • Good to have: Knowledge on Testing framework like playwright, codeceptJS
  • Good to have: Knowledge of multimodal AI testing (text, image and video)
  • Good to have: Knowledge of cloud technologies, preferably Azure
  • Good to have: Understanding of Responsible AI, bias testing and content safety validation
  • Good to have: Experience with data validation and model output comparison
  • Good to have: Experience/knowledge of performance/load/volume testing
  • Good to have: Experience with performance tools such as JMeter

Tech stack

AI testingAPI TestingJIRAGitplaywrightcodeceptJSAzureJMeter

Apply now

Ready to take the next step in your career? Click the button below to continue to the application process.

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.