AdTechTalent
Engineering6 days agoHybrid

DoubleVerify

Director of Engineering - PinAI

directorengineering leadershipAImachine learningconversational AILLMagentic AIModel Context ProtocolLangChainLangGraphAutoGPTPythonJavaScalacloudGCPAWSAzureKubernetesDockerLookerSnowflakeprompt engineeringMLOpsevaluation frameworksdistributed systemssoftware engineeringteam leadershiphybrid

Key details

Salary

$118K – $235K

Employment type

Full-time

Seniority

Director

Years experience

10+

Location

New York, New York, United States

Full job description

DoubleVerify seeks a Director of Engineering to lead the PinAI team focused on conversational AI and agentic systems. The role involves defining technical vision, leading architecture and development of AI-powered conversational interfaces using agentic AI, MCP, and LLM technologies. Responsibilities include building and mentoring engineering teams, collaborating cross-functionally, ensuring production quality, implementing MLOps, and driving innovation. Required qualifications include 10+ years software engineering experience, 5+ years leadership, expertise in AI/ML systems, LLMs, agentic AI frameworks (LangChain, LangGraph, AutoGPT), MCP, conversational AI, backend languages (Python, Java, Scala), cloud platforms (GCP, AWS, Azure), containerization (Kubernetes, Docker), and strong leadership and communication skills. Location is New York, NY with hybrid work. Salary range $118,000 - $235,000 plus bonus, equity, and benefits.

What you'll do

  • Define and execute the technical vision and roadmap for PinAI/Pin Chat
  • Lead design and architecture of agentic AI systems leveraging MCP
  • Drive innovation in conversational AI experiences
  • Establish technical standards for AI/ML engineering including evaluation frameworks and prompt engineering
  • Partner with Product, Data Science, and Architecture teams to translate business requirements into AI solutions
  • Build, mentor, and scale a team of AI/ML engineers, software engineers, and technical leads
  • Attract top-tier talent with expertise in LLMs, agent architectures, conversational AI, and distributed systems
  • Foster a culture of innovation, experimentation, and continuous learning
  • Provide hands-on technical guidance through architecture reviews, design discussions, and code reviews
  • Develop career paths and growth opportunities for team members
  • Oversee development of agentic AI systems using LangChain, LangGraph, and custom architectures
  • Implement evaluation frameworks to measure and improve AI agent performance
  • Design and build conversational AI interfaces with context awareness and conversation history
  • Architect modular AI components leveraging MCP
  • Integrate with Pinnacle's analytics infrastructure including Looker and data APIs
  • Ensure production-grade quality through testing, monitoring, observability, and reliability engineering
  • Collaborate with Product Management, Data Science, Platform Engineering, Security, Compliance, and UX/UI teams
  • Define and track KPIs for AI system performance
  • Implement MLOps best practices for model deployment and monitoring
  • Optimize costs related to LLM API usage and infrastructure
  • Establish incident response protocols and SLAs
  • Drive continuous improvement through retrospectives, evals analysis, and user feedback

Requirements

  • 10+ years of software engineering experience building production systems at scale
  • 5+ years in engineering leadership roles managing teams of 5-15+ engineers
  • Hands-on experience with AI/ML systems, particularly LLMs and conversational AI
  • Proven track record of delivering AI-powered products from concept to production
  • Deep expertise in building agentic systems using frameworks like LangChain, LangGraph, AutoGPT, or similar
  • Experience with Model Context Protocol (MCP) or similar protocols
  • Strong background in conversational AI systems, dialogue management, and natural language understanding
  • Expertise in building evaluation frameworks for LLM applications
  • Hands-on experience with major LLM providers (OpenAI, Anthropic, Google, etc.) and open-source models
  • Proficiency in Python, Java, Scala, or similar languages for backend systems
  • Experience with cloud platforms (GCP, AWS, Azure) and containerization (Kubernetes, Docker)
  • Exceptional system architecture skills and engineering best practices
  • Strong technical communication skills
  • Experience building and scaling diverse engineering teams
  • Strategic thinker with strong stakeholder management
  • BS/MS in Computer Science, Machine Learning, AI, or related technical field (PhD preferred)

Tech stack

agentic AIModel Context Protocol (MCP)LLMsLangChainLangGraphAutoGPTPythonJavaScalaGCPAWSAzureKubernetesDockerLookerSnowflakeReactAngular

Benefits

Opportunity to lead a cutting-edge AI initiative at a publicly-traded, industry-leading companyWork with Fortune 500 clients on transformative AI solutionsCollaborative, innovative culture with a focus on continuous learningCompetitive compensation including base salary, bonus, and equityComprehensive benefits packageProfessional development and conference opportunitiesHybrid work flexibility

Apply now

This MVP uses a placeholder application flow. In production, this section can connect to an external apply URL or a native application form.

Continue to applicationBrowse more jobs

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.