AdTechTalent
Engineering2 days agoHybrid

Epsilon

Senior Big Data Administrator

DevOpsmicroservicesCI/CDAzure DevOpsJenkinsGitHub ActionsDockerKubernetesDatabricksPythonBashPowerShellTerraformARMCloudFormationPrometheusGrafanaCloudWatchAzure MonitorSparkDelta LakeKafkaEvent HubsAWSAzureGCPInfrastructure as Codecloud-nativedata engineeringautomationmonitoringhigh availability

Key details

Salary

Not specified

Employment type

Full-time

Seniority

Senior

Years experience

5-10

Location

Bengaluru, India

Full job description

Design, implement, and manage CI/CD pipelines for microservices and data workloads. Build and maintain cloud-native infrastructure (AWS/Azure/GCP) using Infrastructure as Code. Support deployment and orchestration of microservices-based applications (Docker, Kubernetes). Manage and optimize Databricks environments for data engineering and analytics workloads. Automate operational workflows, monitoring, and alerting for high availability systems. Collaborate with development, data engineering, and platform teams to ensure seamless delivery. Ensure security, compliance, and cost optimization across cloud resources. Troubleshoot deployment, performance, and infrastructure issues. Requires 5+ years experience in DevOps and microservices, strong Unix/Linux and shell scripting skills, proficiency with CI/CD tools (Azure DevOps, Jenkins, GitHub Actions), containerization (Docker), orchestration (Kubernetes), Databricks, scripting (Python, Bash, PowerShell), Infrastructure as Code (Terraform, ARM, CloudFormation), and monitoring tools (Prometheus, Grafana, CloudWatch, Azure Monitor). Preferred experience with data engineering pipelines (Spark, Delta Lake), streaming architectures (Kafka, Event Hubs), data lake/lakehouse architectures, multi-region/high-availability setups, and cloud certifications. B.S. in Computer Science or related field required.

What you'll do

  • Design, implement, and manage CI/CD pipelines for microservices and data workloads
  • Build and maintain cloud-native infrastructure (AWS/Azure/GCP) using Infrastructure as Code
  • Support deployment and orchestration of microservices-based applications (Docker, Kubernetes)
  • Manage and optimize Databricks environments for data engineering and analytics workloads
  • Automate operational workflows, monitoring, and alerting for high availability systems
  • Collaborate with development, data engineering, and platform teams to ensure seamless delivery
  • Ensure security, compliance, and cost optimization across cloud resources
  • Troubleshoot deployment, performance, and infrastructure issues

Requirements

  • 5+ years of experience in DevOps & Microservices
  • Proficiency in backup and recovery methodologies and techniques
  • Ability to diagnose problems and resolve issues across various tiers (application, database, network and appliance)
  • Adherence to SDLC, Change Management, troubleshooting and development methodologies
  • Strong Unix/Linux and shell scripting skills
  • Ability to perform work with minimal supervisory direction
  • Excellent written and verbal communication skills
  • Hands-on expertise with CI/CD tools (Azure DevOps, Jenkins, GitHub Actions)
  • Experience with containerization (Docker) and orchestration (Kubernetes - EKS/AKS/GKE)
  • Experience with microservices architecture and distributed systems
  • Solid experience with Databricks (cluster management, job orchestration, integrations)
  • Strong scripting skills (Python / Bash / PowerShell)
  • Experience with Infrastructure as Code (Terraform / ARM / CloudFormation)
  • Knowledge of monitoring tools (Prometheus, Grafana, CloudWatch, Azure Monitor)
  • Preferred: Experience with data engineering pipelines (Spark, Delta Lake)
  • Preferred: Exposure to streaming architectures (Kafka, Event Hubs)
  • Preferred: Understanding of data lake / lakehouse architectures
  • Preferred: Experience with multi-region / high-availability setups
  • Preferred: Cloud certifications (AWS / Azure DevOps / Databricks)
  • B.S. in Computer Science or related field or equivalent work experience required
  • AWS certification is a plus

Tech stack

Azure DevOpsJenkinsGitHub ActionsDockerKubernetesEKSAKSGKEDatabricksPythonBashPowerShellTerraformARMCloudFormationPrometheusGrafanaCloudWatchAzure MonitorSparkDelta LakeKafkaEvent HubsAWSAzure

Benefits

Employee well-being focusCollaborative work environmentOpportunities for growth, learning, development and career advancementInnovation-driven cultureWork-life balance and flexibility

Apply now

Ready to take the next step in your career? Click the button below to continue to the application process.

Continue to applicationBrowse more jobs

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.