AdTechTalent
Engineering15 days agoHybrid

PubMatic

Senior Principal AI Architect

AIagentic systemsarchitectureLLMsdistributed systemscloudcontainerizationAI/MLtechnical leadershipplatformscalabilityinfrastructureAI safetygovernance

Key details

Salary

Not specified

Employment type

Full-time

Seniority

Senior

Years experience

10+

Location

Pune, Maharashtra, India

Full job description

Seeking a Senior Principal AI Architect to lead AI and Agentic Systems platform architecture. Responsibilities include defining architecture principles, reviewing system designs, translating non-functional requirements, guiding model deployment, architecting agent ecosystems, establishing standards for autonomy and safety, and acting as a technical representative across teams. Requires 12+ years software engineering experience, 3+ years in AI/ML production systems, expertise in LLMs, distributed systems, cloud infrastructure, containerization, and strong leadership skills. Bachelor’s degree in CS/IT or equivalent required. Hybrid work schedule (3 days in office, 2 remote). Benefits include parental leave, healthcare, broadband reimbursement, and office amenities.

What you'll do

  • Define and enforce architecture-first principles for AI and agentic systems
  • Review system designs and recommend appropriate models, frameworks, and patterns
  • Translate non-functional requirements (latency, reliability, scalability, observability, cost) into concrete designs
  • Serve as final technical escalation point for complex AI decisions
  • Guide model selection, evaluation, and deployment strategies
  • Architect the agent ecosystem as a cohesive platform
  • Define shared agent patterns and orchestration frameworks
  • Establish standards for autonomy levels, guardrails, and safety
  • Ensure alignment between agent behaviour and business logic
  • Drive standardization of evaluation and lifecycle management
  • Act as the technical voice in company-wide AI discussions
  • Clearly articulate system capabilities and trade-offs
  • Translate customer and business requirements into architecture
  • Partner with product and business teams for scalable AI solutions
  • Raise AI maturity across engineering
  • Conduct knowledge-sharing sessions on emerging models and frameworks
  • Share lessons learned from deployments
  • Influence AI engineering best practices organization wide

Requirements

  • 12+ years of software engineering experience
  • 3+ years designing and deploying AI/ML systems in production
  • Deep expertise in LLMs, agentic systems, distributed systems, scalable inference infrastructure
  • Strong experience with cloud infrastructure and containerization
  • Proven ability to translate business requirements into architecture
  • Excellent communication and technical leadership skills
  • Strong hands-on experience in designing, implementing, and reviewing AI/ML systems and infrastructure
  • Bachelor’s degree in engineering (CS / IT) or equivalent degree from well-known Institutes / Universities

Tech stack

AIAgentic SystemsLLMsdistributed systemsscalable inference infrastructurecloud infrastructurecontainerizationAI/ML systems

Benefits

paternity/maternity leavehealthcare insurancebroadband reimbursementkitchen with healthy snacks and drinkscatered lunches

Apply now

This MVP uses a placeholder application flow. In production, this section can connect to an external apply URL or a native application form.

Continue to applicationBrowse more jobs

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.