AdTechTalent
Engineering14 days agoHybrid

Epsilon

Lead Software Engineer

JavaPythonSparkPySparkTypeScriptJavaScriptAngularAWSREST APIMicroservicesKubernetesSQLNoSQLKafkaTerraformAnsibleCI/CDDevOpsData WarehousingData LakesDelta LakeDistributed SystemsGenerative AILLMsRAGAgentic AI

Key details

Salary

Not specified

Employment type

Full-time

Seniority

Lead

Years experience

5-10

Location

Bengaluru, India

Full job description

Lead Software Engineer role in the CDP team responsible for designing, delivering, and executing technical strategy for large-scale cloud-native data platforms on AWS. Requires 8-10 years experience in software engineering with expertise in scalable UX applications, distributed systems, REST APIs, microservices, Kubernetes, data warehousing, data lakes, and big data ecosystems. Proficient in Java, Python, Angular, PySpark, Apache Spark, AWS services, messaging/event-driven technologies, relational and NoSQL databases, Infrastructure as Code, CI/CD, and DevOps. Responsibilities include leading technical initiatives, collaborating with stakeholders, owning software development lifecycle, and mentoring junior engineers. Exposure to Generative AI technologies is required. Location: Bengaluru, Karnataka, India.

What you'll do

  • Deliver large-scale cloud-native data platforms primarily on AWS leveraging REST APIs, microservices and event driven applications
  • Work hands-on across the technology stack including Java, Python, Spark, TypeScript, JavaScript, Angular, AWS services, event-driven architectures, and SQL/NoSQL databases
  • Lead product wide technical initiatives focused on performance optimization, scalability, reliability, security, governance, and cost efficiency
  • Partner closely with global engineering, product management, architecture, and business stakeholders to align technical solutions with strategic business objectives
  • Own the end-to-end software development lifecycle including requirements gathering, solution design, development, deployment, observability, and documentation
  • Mentor and guide junior engineers fostering a culture of innovation, accountability, collaboration, and technical excellence

Requirements

  • B.E./B.Tech/M.Tech/MCA in Computer Science, Information Technology, or related field
  • 8-10 years of strong software engineering experience
  • Deep expertise in building scalable UX driven applications and distributed systems architecture
  • Proven experience designing and building scalable REST APIs, microservices, Kubernetes, and distributed systems
  • Experience in Data Warehousing, Data Lakes, Delta Lake architecture, and modern big data ecosystem designs
  • Strong hands-on expertise in Python, Java, Angular
  • Well-versed with Object oriented design patterns and Functional programming
  • Expertise in PySpark and Apache Spark
  • Solid depth in Micro-services development with Kubernetes containerization
  • Extensive experience with AWS services such as S3, Lambda, API Gateway, and EventBridge
  • Strong experience with messaging and event-driven technologies such as Kafka, SNS, and SQS
  • Solid expertise in relational and NoSQL databases including PostgreSQL, SQL Server, Aurora, DynamoDB, MongoDB, and Redis
  • Hands-on experience with Infrastructure as Code (IaC) tools such as Terraform and Ansible
  • Strong understanding of CI/CD and DevOps practices using Jenkins, GitHub/GitLab, Bitbucket, GoCD
  • Experience implementing robust testing strategies including unit, integration, and regression testing
  • Strong critical thinking and analytical skills
  • Exposure to Generative AI technologies including LLMs, RAG architectures, and Agentic AI systems
  • Nice to have: Working knowledge of PySpark with Databricks
  • Nice to have: Experience working with Azure and/or Google Cloud Platform (GCP)
  • Nice to have: Experience building data platforms in privacy-safe or Customer Data Platforms and Marketing Technology environments

Tech stack

JavaPythonSparkPySparkTypeScriptJavaScriptAngularAWS (S3, Lambda, API Gateway, EventBridge)REST APIsMicroservicesKubernetesSQLNoSQL (PostgreSQL, SQL Server, Aurora, DynamoDB, MongoDB, Redis)KafkaSNSSQSTerraformAnsibleJenkinsGitHubGitLabBitbucketGoCDDatabricks (nice to have)Azure (nice to have)Google Cloud Platform (GCP) (nice to have)Generative AILLMsRAG architecturesAgentic AI systems

Benefits

Employee well-being focusCollaborative work environmentOpportunities for growth through learning, development and career advancementInnovation-driven cultureWork-life balance and flexibilityDiversity, inclusion, and equal employment opportunity commitment

Apply now

This MVP uses a placeholder application flow. In production, this section can connect to an external apply URL or a native application form.

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.