Full job description
Lead Software Engineer role in the CDP team responsible for designing, delivering, and executing technical strategy for large-scale cloud-native data platforms on AWS. Requires 8-10 years experience in software engineering with expertise in scalable UX applications, distributed systems, REST APIs, microservices, Kubernetes, data warehousing, data lakes, and big data ecosystems. Proficient in Java, Python, Angular, PySpark, Apache Spark, AWS services, messaging/event-driven technologies, relational and NoSQL databases, Infrastructure as Code, CI/CD, and DevOps. Responsibilities include leading technical initiatives, collaborating with stakeholders, owning software development lifecycle, and mentoring junior engineers. Exposure to Generative AI technologies is required. Location: Bengaluru, Karnataka, India.
What you'll do
- Deliver large-scale cloud-native data platforms primarily on AWS leveraging REST APIs, microservices and event driven applications
- Work hands-on across the technology stack including Java, Python, Spark, TypeScript, JavaScript, Angular, AWS services, event-driven architectures, and SQL/NoSQL databases
- Lead product wide technical initiatives focused on performance optimization, scalability, reliability, security, governance, and cost efficiency
- Partner closely with global engineering, product management, architecture, and business stakeholders to align technical solutions with strategic business objectives
- Own the end-to-end software development lifecycle including requirements gathering, solution design, development, deployment, observability, and documentation
- Mentor and guide junior engineers fostering a culture of innovation, accountability, collaboration, and technical excellence
Requirements
- B.E./B.Tech/M.Tech/MCA in Computer Science, Information Technology, or related field
- 8-10 years of strong software engineering experience
- Deep expertise in building scalable UX driven applications and distributed systems architecture
- Proven experience designing and building scalable REST APIs, microservices, Kubernetes, and distributed systems
- Experience in Data Warehousing, Data Lakes, Delta Lake architecture, and modern big data ecosystem designs
- Strong hands-on expertise in Python, Java, Angular
- Well-versed with Object oriented design patterns and Functional programming
- Expertise in PySpark and Apache Spark
- Solid depth in Micro-services development with Kubernetes containerization
- Extensive experience with AWS services such as S3, Lambda, API Gateway, and EventBridge
- Strong experience with messaging and event-driven technologies such as Kafka, SNS, and SQS
- Solid expertise in relational and NoSQL databases including PostgreSQL, SQL Server, Aurora, DynamoDB, MongoDB, and Redis
- Hands-on experience with Infrastructure as Code (IaC) tools such as Terraform and Ansible
- Strong understanding of CI/CD and DevOps practices using Jenkins, GitHub/GitLab, Bitbucket, GoCD
- Experience implementing robust testing strategies including unit, integration, and regression testing
- Strong critical thinking and analytical skills
- Exposure to Generative AI technologies including LLMs, RAG architectures, and Agentic AI systems
- Nice to have: Working knowledge of PySpark with Databricks
- Nice to have: Experience working with Azure and/or Google Cloud Platform (GCP)
- Nice to have: Experience building data platforms in privacy-safe or Customer Data Platforms and Marketing Technology environments
Tech stack
JavaPythonSparkPySparkTypeScriptJavaScriptAngularAWS (S3, Lambda, API Gateway, EventBridge)REST APIsMicroservicesKubernetesSQLNoSQL (PostgreSQL, SQL Server, Aurora, DynamoDB, MongoDB, Redis)KafkaSNSSQSTerraformAnsibleJenkinsGitHubGitLabBitbucketGoCDDatabricks (nice to have)Azure (nice to have)Google Cloud Platform (GCP) (nice to have)Generative AILLMsRAG architecturesAgentic AI systems
Benefits
Employee well-being focusCollaborative work environmentOpportunities for growth through learning, development and career advancementInnovation-driven cultureWork-life balance and flexibilityDiversity, inclusion, and equal employment opportunity commitment