AdTechTalent
Engineering14 days agoHybrid

Epsilon

Lead Software Engineer

leadershipjavapythonsparkpysparktypescriptjavascriptangularawsmicroserviceskubernetesrest apievent-drivensqlnosqlterraformansibleci/cddevopsdata platformdistributed systemsbig datagenerative aillmragagentic aidatabricksazuregcp

Key details

Salary

$113K – $209K

Employment type

Full-time

Seniority

Lead

Years experience

5-10

Location

Wakefield, United States

Full job description

Lead Software Engineer role in the CDP team responsible for design, delivery, technical strategy, and execution of large-scale cloud-native data platforms primarily on AWS. Requires 8-10 years of software engineering experience with expertise in Java, Python, Spark, PySpark, TypeScript, JavaScript, Angular, AWS services, REST APIs, microservices, Kubernetes, SQL/NoSQL databases, and event-driven architectures. Responsibilities include leading technical initiatives, partnering with global teams, owning the software development lifecycle, and mentoring junior engineers. Requires strong skills in distributed systems, data warehousing, data lakes, CI/CD, DevOps, and testing. Exposure to Generative AI technologies is a plus. Benefits include flexible time off, paid holidays, health coverage, 401(k), tuition assistance, and more.

What you'll do

  • Deliver large-scale cloud-native data platforms primarily on AWS using REST APIs, microservices, and event-driven applications
  • Work hands-on across the technology stack including Java, Python, Spark, TypeScript, JavaScript, Angular, AWS services, event-driven architectures, and SQL/NoSQL databases
  • Lead product-wide technical initiatives focused on performance optimization, scalability, reliability, security, governance, and cost efficiency
  • Partner closely with global engineering, product management, architecture, and business partners to align technical solutions with strategic business objectives
  • Own the end-to-end software development lifecycle including requirements gathering, solution design, development, deployment, observability, and documentation
  • Mentor and guide junior engineers fostering a culture of innovation, accountability, collaboration, and technical excellence

Requirements

  • B.E./B.Tech/M.Tech/MCA in Computer Science, Information Technology, or related field
  • 8-10 years of strong software engineering experience
  • Deep expertise in scalable UX driven applications and distributed systems architecture
  • Experience designing and building scalable REST APIs, microservices, Kubernetes, and distributed systems
  • Experience in Data Warehousing, Data Lakes, Delta Lake architecture, and big data ecosystem designs
  • Strong hands-on expertise in Python, Java, Angular
  • Well-versed with Object oriented design patterns and Functional programming
  • Expertise in PySpark and Apache Spark
  • Experience building high-performance distributed data processing solutions
  • Micro-services development with Kubernetes containerization
  • Extensive experience with AWS services (S3, Lambda, API Gateway, EventBridge)
  • Experience with messaging and event-driven technologies (Kafka, SNS, SQS)
  • Expertise in relational and NoSQL databases (PostgreSQL, SQL Server, Aurora, DynamoDB, MongoDB, Redis)
  • Hands-on experience with Infrastructure as Code tools (Terraform, Ansible)
  • Strong understanding of CI/CD and DevOps practices (Jenkins, GitHub/GitLab, Bitbucket, GoCD)
  • Experience implementing unit, integration, and regression testing
  • Strong critical thinking and analytical skills
  • Exposure to Generative AI technologies (LLMs, RAG architectures, Agentic AI)
  • Nice to have: Working knowledge of PySpark with Databricks
  • Nice to have: Experience with Azure and/or Google Cloud Platform
  • Nice to have: Experience building data platforms in privacy-safe or Customer Data Platforms and Marketing Technology environments

Tech stack

JavaPythonSparkPySparkTypeScriptJavaScriptAngularAWSS3LambdaAPI GatewayEventBridgeKafkaSNSSQSPostgreSQLSQL ServerAuroraDynamoDBMongoDBRedisTerraformAnsibleJenkinsGitHubGitLabBitbucketGoCDKubernetesREST APIsMicroservicesEvent-driven architecturesCI/CDDevOpsDatabricksAzureGoogle Cloud PlatformGenerative AILLMsRAG architecturesAgentic AI

Benefits

Flexible time off (FTO)15 paid holidaysPaid sick timeParental/new child leaveChildcare & elder care assistanceAdoption assistanceComprehensive health coverage401(k)Tuition assistanceCommuter benefitsProfessional developmentEmployee recognitionCharitable donation matchingHealth coaching and counseling

Apply now

This MVP uses a placeholder application flow. In production, this section can connect to an external apply URL or a native application form.

Continue to applicationBrowse more jobs

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.