AdTechTalent
Engineering14 days agoHybrid

Epsilon

Lead Software Engineer

leadershipjavapythonsparkpysparktypescriptjavascriptangularawskubernetesmicroservicesrest apisqlnosqldata platformbig dataevent-driventerraformansibleci/cddevopsgenerative aillmsragagentic aidistributed systemsdata warehousingdata lakesmarketing technologycustomer data platform

Key details

Salary

Not specified

Employment type

Full-time

Seniority

Lead

Years experience

5-10

Location

Bengaluru, India

Full job description

Lead Software Engineer role in the CDP team responsible for designing, delivering, and executing technical strategy for large-scale cloud-native data platforms on AWS. Requires 8-10 years of software engineering experience with expertise in Java, Python, Spark, Angular, AWS, Kubernetes, microservices, REST APIs, SQL/NoSQL databases, and event-driven architectures. Responsibilities include leading technical initiatives, partnering with stakeholders, owning the software development lifecycle, and mentoring junior engineers. Qualifications include a relevant degree and strong experience in distributed systems, data warehousing, big data ecosystems, infrastructure as code, CI/CD, and DevOps. Exposure to Generative AI technologies is a plus. Location: Bengaluru, Karnataka, India.

What you'll do

  • Deliver large-scale cloud-native data platforms primarily on AWS leveraging REST APIs, microservices, and event-driven applications
  • Work hands-on across the technology stack including Java, Python, Spark, TypeScript, JavaScript, Angular, AWS services, event-driven architectures, and SQL/NoSQL databases
  • Lead product-wide technical initiatives focused on performance optimization, scalability, reliability, security, governance, and cost efficiency
  • Partner with global engineering, product management, architecture, and business stakeholders to align technical solutions with strategic business objectives
  • Own the end-to-end software development lifecycle including requirements gathering, solution design, development, deployment, observability, and documentation
  • Mentor and guide junior engineers, fostering a culture of innovation, accountability, collaboration, and technical excellence

Requirements

  • B.E./B.Tech/M.Tech/MCA in Computer Science, Information Technology, or related field
  • 8-10 years of strong software engineering experience
  • Experience building scalable UX driven applications and distributed systems architecture
  • Proven experience designing and building scalable REST APIs, microservices, Kubernetes, and distributed systems
  • Experience in Data Warehousing, Data Lakes, Delta Lake architecture, and modern big data ecosystem designs
  • Strong hands-on expertise in Python, Java, Angular
  • Well-versed with Object oriented design patterns and Functional programming
  • Expertise in PySpark and Apache Spark for high-performance distributed data processing
  • Experience with Micro-services development and Kubernetes containerization
  • Extensive experience with AWS services (S3, Lambda, API Gateway, EventBridge)
  • Strong experience with messaging and event-driven technologies (Kafka, SNS, SQS)
  • Expertise in relational and NoSQL databases (PostgreSQL, SQL Server, Aurora, DynamoDB, MongoDB, Redis)
  • Hands-on experience with Infrastructure as Code tools (Terraform, Ansible)
  • Strong understanding of CI/CD and DevOps practices (Jenkins, GitHub/GitLab, Bitbucket, GoCD)
  • Experience implementing unit, integration, and regression testing
  • Strong critical thinking and analytical skills
  • Exposure to Generative AI technologies including LLMs, RAG architectures, and Agentic AI systems
  • Nice to have: Working knowledge of PySpark with Databricks
  • Nice to have: Experience with Azure and/or Google Cloud Platform
  • Nice to have: Experience building data platforms in privacy-safe or Customer Data Platforms and Marketing Technology environments

Tech stack

JavaPythonSparkPySparkTypeScriptJavaScriptAngularAWS (S3, Lambda, API Gateway, EventBridge)KubernetesREST APIsMicroservicesSQLNoSQLPostgreSQLSQL ServerAuroraDynamoDBMongoDBRedisKafkaSNSSQSTerraformAnsibleJenkinsGitHubGitLabBitbucketGoCDDatabricks (nice to have)Azure (nice to have)Google Cloud Platform (GCP) (nice to have)Generative AILLMsRAG architecturesAgentic AI systems

Benefits

Opportunities for growth through learning, development and career advancementFocus on employee well-beingCollaborative work environmentFlexibility to balance work and personal lifeCulture of innovation and forward-thinking approachesDiversity, inclusion, and equal employment opportunities

Apply now

This MVP uses a placeholder application flow. In production, this section can connect to an external apply URL or a native application form.

Continue to applicationBrowse more jobs

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.