AdTechTalent
Engineering1 month agoHybrid

Epsilon

Staff Software Engineer

pythonpysparkapache sparkdatabricksawsazuregcpterraformansibleci/cddevopskafkastreamingsqlnosqldata engineeringdistributed systemsgenerative aillmsragagentic aicleanroomdata platformcloud-native

Key details

Salary

Not specified

Employment type

Full-time

Seniority

Senior

Years experience

10+

Location

Bengaluru, India

Full job description

Staff Software Engineer role in the Cleanroom team at Epsilon. Responsibilities include architecting and delivering large-scale cloud-native data platforms primarily on AWS, working hands-on with Python, PySpark, Apache Spark, Databricks, AWS services, event-driven architectures, and SQL/NoSQL databases. Lead technical initiatives on performance, scalability, reliability, security, governance, and cost efficiency. Review architectural decisions and establish best practices. Collaborate with global teams to align technical solutions with business objectives. Own the full software development lifecycle. Mentor senior and junior engineers. Requirements: 10-13 years software engineering experience with expertise in large-scale data engineering, distributed systems, data warehousing, data lakes, Delta Lake, Databricks, Python, PySpark, Apache Spark, AWS services (S3, Glue, Redshift, EMR, Athena, Lambda, EventBridge), real-time streaming (Kafka, AWS Kinesis, SQS, RabbitMQ), relational and NoSQL databases, Infrastructure as Code (Terraform, Ansible), CI/CD and DevOps practices, and exposure to Generative AI technologies (LLMs, RAG, Agentic AI). Nice to have AWS and Databricks certifications, Azure/GCP experience, TypeScript, Node.js, UX design, and cleanroom environment experience. Location: Bengaluru, Karnataka, India.

What you'll do

  • Architect, design, and deliver large-scale cloud-native data platforms primarily on AWS
  • Work hands-on with Python, PySpark, Apache Spark, Databricks, AWS services, event-driven architectures, SQL/NoSQL databases
  • Lead technical initiatives on performance, scalability, reliability, security, governance, and cost efficiency
  • Review and influence architectural decisions and establish engineering best practices
  • Partner with global engineering, product management, architecture, and business stakeholders
  • Own end-to-end software development lifecycle including requirements, design, development, deployment, observability, and documentation
  • Mentor and guide senior and junior engineers fostering innovation, accountability, collaboration, and technical excellence

Requirements

  • B.E/B.Tech/M.Tech/MCA in Computer Science, Information Technology or related field
  • 10-13 years of software engineering experience
  • Expertise in large-scale data engineering and distributed systems architecture
  • Expertise in Data Warehousing, Data Lakes, Delta Lake architecture
  • Hands-on experience with Databricks, Python, PySpark, Apache Spark
  • Experience with AWS services: S3, Glue, Redshift, EMR, Athena, Lambda, EventBridge
  • Experience with real-time streaming technologies: Kafka, AWS Kinesis, SQS, RabbitMQ
  • Strong understanding of relational and NoSQL databases
  • Hands-on experience with Infrastructure as Code tools like Terraform or Ansible
  • Strong understanding of CI/CD and DevOps practices
  • Proven ability to lead complex engineering programs and influence technical direction
  • Exposure to Generative AI technologies including LLMs, RAG architectures, Agentic AI
  • Nice to have: AWS and Databricks certifications, experience with Azure/GCP
  • Nice to have: Working knowledge of TypeScript, Node.js, UX design & development
  • Experience building data platforms in privacy-safe or cleanroom environments

Tech stack

AWSAzureGCPDatabricksPythonPySparkApache SparkSQLNoSQLPostgreSQLSQL ServerAuroraRDSMongoDBDynamoDBTerraformAnsibleJenkinsGitHubGitLabBitbucketGoCDKafkaAWS KinesisSQSRabbitMQTypeScriptNode.jsDelta LakeCI/CDDevOpsGenerative AILLMsRAG architecturesAgentic AI

Benefits

Employee well-being focusCollaborative work environmentOpportunities for growth, learning, and career advancementInnovation-driven cultureWork-life balance and flexibilityDiversity and inclusion commitment

Apply now

Ready to take the next step in your career? Click the button below to continue to the application process.

Continue to applicationBrowse more jobs

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.