AdTechTalent
Engineering3 days agoOn-site

Microsoft

Principal Software Engineer - Intelligent Decision, Evaluation & Review Platforms

C++C#JavaPythonTypeScriptdistributed systemssystem designAI evaluationagent orchestrationhuman-in-the-loopauditworkflow orchestrationLLMOpssoftware platformengineeringprincipal software engineer

Key details

Salary

Not specified

Employment type

Full-time

Seniority

Senior

Years experience

5-10

Location

Bengaluru, India

Full job description

Microsoft Ads is seeking a Principal Software Engineer to build scalable platforms for agentic evaluation, production audits, and human-in-the-loop review. The role involves developing AI agent workflows, building reviewer experiences, designing distributed orchestration systems, and providing technical leadership across teams. Candidates must have a Bachelor’s or Master’s degree in Computer Science, Engineering, or related field, with 8+ years of industry experience. Strong coding skills in C++, C#, Java, Python, or TypeScript and experience with large-scale distributed systems, system design, AI evaluation, and human-in-the-loop platforms are required. Preferred background includes advertising, trust and safety, fraud, responsible AI, search, or recommendations.

What you'll do

  • Architect and build scalable platforms for agentic evaluation, production audits, and human-in-the-loop review
  • Develop workflows in which AI agents gather evidence, analyze cases, compare decisions, and assist reviewers while preserving human oversight and accountability
  • Build reviewer experiences that present the right evidence, explanations, uncertainty, and recommended actions at the right time
  • Design distributed orchestration systems for long-running workflows involving models, agents, tools, automated checks, and human decisions
  • Provide technical leadership across engineering, applied science, product, design, operations, and policy teams

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field
  • 8+ years of relevant industry experience
  • Strong production-coding skills in at least one of C++, C#, Java, Python, or TypeScript
  • Experience designing, building, and operating large-scale distributed services or software platforms
  • Strong system-design skills across APIs, workflow orchestration, event-driven systems, storage, concurrency, fault tolerance, and service reliability
  • Experience building AI evaluation, agent orchestration, human-in-the-loop, audit, experimentation, or LLMOps platforms
  • Experience owning substantial systems from initial architecture through rollout, adoption, and production operations

Tech stack

C++C#JavaPythonTypeScript

Apply now

Ready to take the next step in your career? Click the button below to continue to the application process.

Continue to applicationBrowse more jobs

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.