AdTechTalent
Engineering2 months agoHybrid

PubMatic

Senior Principal AI Architect

AIagentic systemsarchitectureLLMsdistributed systemscloudcontainerizationAI/MLtechnical leadershipplatformscalabilityinfrastructureAI safetygovernance

Key details

Salary

Not specified

Employment type

Full-time

Seniority

Senior

Years experience

10+

Location

Pune, India

Full job description

Seeking a Senior Principal AI Architect to lead AI and Agentic Systems platform architecture. Responsibilities include defining architecture principles, reviewing system designs, translating non-functional requirements, guiding model deployment, architecting agent ecosystems, establishing standards for autonomy and safety, and acting as a technical representative across teams. Requires 12+ years software engineering experience, 3+ years in AI/ML production systems, expertise in LLMs, distributed systems, cloud infrastructure, containerization, and strong leadership skills. Bachelor’s degree in CS/IT or equivalent required. Hybrid work schedule (3 days in office, 2 remote). Benefits include parental leave, healthcare, broadband reimbursement, and office amenities.

What you'll do

  • Define and enforce architecture-first principles for AI and agentic systems
  • Review system designs and recommend appropriate models, frameworks, and patterns
  • Translate non-functional requirements (latency, reliability, scalability, observability, cost) into concrete designs
  • Serve as final technical escalation point for complex AI decisions
  • Guide model selection, evaluation, and deployment strategies
  • Architect the agent ecosystem as a cohesive platform
  • Define shared agent patterns and orchestration frameworks
  • Establish standards for autonomy levels, guardrails, and safety
  • Ensure alignment between agent behaviour and business logic
  • Drive standardization of evaluation and lifecycle management
  • Act as the technical voice in company-wide AI discussions
  • Clearly articulate system capabilities and trade-offs
  • Translate customer and business requirements into architecture
  • Partner with product and business teams for scalable AI solutions
  • Raise AI maturity across engineering
  • Conduct knowledge-sharing sessions on emerging models and frameworks
  • Share lessons learned from deployments
  • Influence AI engineering best practices organization wide

Requirements

  • 12+ years of software engineering experience
  • 3+ years designing and deploying AI/ML systems in production
  • Deep expertise in LLMs, agentic systems, distributed systems, scalable inference infrastructure
  • Strong experience with cloud infrastructure and containerization
  • Proven ability to translate business requirements into architecture
  • Excellent communication and technical leadership skills
  • Strong hands-on experience in designing, implementing, and reviewing AI/ML systems and infrastructure
  • Bachelor’s degree in engineering (CS / IT) or equivalent degree from well-known Institutes / Universities

Tech stack

AIAgentic SystemsLLMsdistributed systemsscalable inference infrastructurecloud infrastructurecontainerizationAI/ML systems

Benefits

paternity/maternity leavehealthcare insurancebroadband reimbursementkitchen with healthy snacks and drinkscatered lunches

Apply now

Ready to take the next step in your career? Click the button below to continue to the application process.

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.