Full job description
Lead Software Engineer role in the CDP team responsible for designing, delivering, and executing technical strategy for large-scale cloud-native data platforms on AWS. Requires 8-10 years of software engineering experience with expertise in Java, Python, Spark, Angular, AWS services, microservices, Kubernetes, and distributed systems. Responsibilities include leading technical initiatives, collaborating with stakeholders, owning software development lifecycle, and mentoring junior engineers. Strong skills in REST APIs, event-driven architectures, SQL/NoSQL databases, Infrastructure as Code, CI/CD, and DevOps are required. Exposure to Generative AI technologies is a plus. Educational qualifications include B.E./B.Tech/M.Tech/MCA in Computer Science or related fields. Location: Bengaluru, Karnataka, India.
What you'll do
- Deliver large-scale cloud-native data platforms primarily on AWS leveraging REST APIs, microservices, and event-driven applications
- Work hands-on across the technology stack including Java, Python, Spark, TypeScript, JavaScript, Angular, AWS services, event-driven architectures, and SQL/NoSQL databases
- Lead product-wide technical initiatives focused on performance optimization, scalability, reliability, security, governance, and cost efficiency
- Partner with global engineering, product management, architecture, and business stakeholders to align technical solutions with strategic business objectives
- Own the end-to-end software development lifecycle including requirements gathering, solution design, development, deployment, observability, and documentation
- Mentor and guide junior engineers fostering a culture of innovation, accountability, collaboration, and technical excellence
Requirements
- B.E./B.Tech/M.Tech/MCA in Computer Science, Information Technology, or related field
- 8-10 years of software engineering experience
- Experience building scalable UX driven applications and distributed systems architecture
- Proven experience designing and building scalable REST APIs, microservices, Kubernetes, and distributed systems
- Experience in Data Warehousing, Data Lakes, Delta Lake architecture, and big data ecosystem designs
- Strong hands-on expertise in Python, Java, Angular
- Well-versed with Object oriented design patterns and Functional programming
- Expertise in PySpark and Apache Spark for distributed data processing
- Experience with Micro-services development and Kubernetes containerization
- Extensive experience with AWS services (S3, Lambda, API Gateway, EventBridge)
- Experience with messaging and event-driven technologies (Kafka, SNS, SQS)
- Expertise in relational and NoSQL databases (PostgreSQL, SQL Server, Aurora, DynamoDB, MongoDB, Redis)
- Hands-on experience with Infrastructure as Code tools (Terraform, Ansible)
- Strong understanding of CI/CD and DevOps practices (Jenkins, GitHub/GitLab, Bitbucket, GoCD)
- Experience implementing unit, integration, and regression testing
- Strong critical thinking and analytical skills
- Exposure to Generative AI technologies including LLMs, RAG architectures, Agentic AI systems
- Nice to have: PySpark with Databricks, Azure and/or GCP experience, experience in privacy-safe or Customer Data Platforms and Marketing Technology environments
Tech stack
JavaPythonSparkPySparkTypeScriptJavaScriptAngularAWS (S3, Lambda, API Gateway, EventBridge)REST APIsMicroservicesKubernetesSQLNoSQL (PostgreSQL, SQL Server, Aurora, DynamoDB, MongoDB, Redis)KafkaSNSSQSTerraformAnsibleJenkinsGitHubGitLabBitbucketGoCDDatabricks (nice to have)Azure (nice to have)Google Cloud Platform (GCP) (nice to have)Generative AI, LLMs, RAG architectures, Agentic AI systems
Benefits
Opportunities for growth through learning, development and career advancementPeople centric environment focusing on employee well-beingCollaborative work cultureInnovation-driven environmentWork-life balance and flexibility