TripleLift
Data Scientist
New York, US•4 months ago
$90K – $120K
data sciencemachine learningpython
Engineering12 days agoOn-site
Microsoft
Principal Software Engineer
C++C#JavaPythonTypeScriptdistributed systemssystem designAI evaluationagent orchestrationhuman-in-the-loopauditworkflow orchestrationLLMOpssoftware platformtechnical leadership
Key details
Salary
Not specified
Employment type
Full-time
Seniority
Senior
Years experience
5-10
Location
Bengaluru, India
Full job description
Microsoft Ads is hiring a Principal Software Engineer to build scalable platforms for AI decision evaluation, audit, and human review. The role involves architecting systems that combine AI agents and human oversight to improve decision quality. Responsibilities include building workflows for AI evidence gathering and reviewer support, designing distributed orchestration systems, and providing technical leadership across teams. Candidates must have a Bachelor’s or Master’s in Computer Science or related field, 8+ years industry experience, strong coding skills in C++, C#, Java, Python, or TypeScript, and experience with large-scale distributed systems and AI evaluation platforms. Preferred experience includes advertising, trust and safety, fraud, responsible AI, or related domains. The position is full-time and located in Bengaluru, Karnataka, India.
What you'll do
- Architect and build scalable platforms for agentic evaluation, production audits, and human-in-the-loop review
- Develop workflows where AI agents gather evidence, analyze cases, compare decisions, and assist reviewers while preserving human oversight and accountability
Similar jobs
More roles worth a look
Related opportunities based on specialty and working model so candidates can keep momentum.
TripleLift
Director of Sales - US, West
Los Angeles, United States•4 months ago
$290K – $350K
sales leadershipprogrammaticCTV
TripleLift