Full job description
Lead Software Engineer role in the CDP team responsible for designing, delivering, and executing technical strategy for large-scale cloud-native data platforms on AWS. Requires hands-on experience with Java, Python, Spark, TypeScript, JavaScript, Angular, AWS services, REST APIs, microservices, event-driven architectures, and SQL/NoSQL databases. Lead technical initiatives on performance, scalability, reliability, security, governance, and cost efficiency. Collaborate with global teams to align technical solutions with business objectives. Own full software development lifecycle and mentor junior engineers. Requires 8-10 years of software engineering experience, expertise in distributed systems, REST APIs, Kubernetes, data warehousing, big data ecosystems, PySpark, microservices, AWS, messaging/event-driven tech, databases, IaC tools, CI/CD, DevOps, and testing strategies. Exposure to Generative AI technologies is a plus. Location: Bengaluru, Karnataka, India.
What you'll do
- Deliver large-scale cloud-native data platforms primarily on AWS leveraging REST APIs, microservices, and event-driven applications
- Work hands-on across the technology stack including Java, Python, Spark, TypeScript, JavaScript, Angular, AWS services, event-driven architectures, and SQL/NoSQL databases
- Lead product-wide technical initiatives focused on performance optimization, scalability, reliability, security, governance, and cost efficiency
- Partner with global engineering, product management, architecture, and business stakeholders to align technical solutions with strategic business objectives
- Own the end-to-end software development lifecycle including requirements gathering, solution design, development, deployment, observability, and documentation
- Mentor and guide junior engineers fostering a culture of innovation, accountability, collaboration, and technical excellence
Requirements
- B.E./B.Tech/M.Tech/MCA in Computer Science, Information Technology, or related field
- 8-10 years of strong software engineering experience
- Deep expertise in building scalable UX driven applications and distributed systems architecture
- Proven experience designing and building scalable REST APIs, microservices, Kubernetes, and distributed systems
- Experience in Data Warehousing, Data Lakes, Delta Lake architecture, and modern big data ecosystem designs
- Strong hands-on expertise in Python, Java, Angular
- Well-versed with Object oriented design patterns and Functional programming
- Expertise in PySpark and Apache Spark
- Experience with Micro-services development with Kubernetes containerization
- Extensive experience with AWS services such as S3, Lambda, API Gateway, EventBridge
- Strong experience with messaging and event-driven technologies such as Kafka, SNS, and SQS
- Solid expertise in relational and NoSQL databases including PostgreSQL, SQL Server, Aurora, DynamoDB, MongoDB, and Redis
- Hands-on experience with Infrastructure as Code (IaC) tools such as Terraform and Ansible
- Strong understanding of CI/CD and DevOps practices using Jenkins, GitHub/GitLab, Bitbucket, GoCD
- Experience implementing robust testing strategies including unit, integration, and regression testing
- Strong critical thinking and analytical skills
- Exposure to Generative AI technologies including LLMs, RAG architectures, and Agentic AI systems
Tech stack
JavaPythonSparkPySparkTypeScriptJavaScriptAngularAWS (S3, Lambda, API Gateway, EventBridge)REST APIsMicroservicesKubernetesSQLNoSQL (PostgreSQL, SQL Server, Aurora, DynamoDB, MongoDB, Redis)KafkaSNSSQSTerraformAnsibleJenkinsGitHubGitLabBitbucketGoCDDatabricks (nice to have)Azure (nice to have)Google Cloud Platform (GCP) (nice to have)Generative AI (LLMs, RAG architectures, Agentic AI systems)
Benefits
Employee well-being focusCollaborative work environmentOpportunities for growth through learning, development, and career advancementInnovation-driven cultureWork-life balance and flexibilityDiversity, inclusion, and equal employment opportunity commitment