AdTechTalent
Engineering9 days agoHybrid

Epsilon

Senior Big Data Administrator

devopsmicroservicesci/cddockerkubernetesdatabrickspythonbashpowershellterraformazureawsgcpsparkdelta lakekafkaevent hubsmonitoringinfrastructure as codeclouddata engineering

Key details

Salary

Not specified

Employment type

Full-time

Seniority

Senior

Years experience

5-10

Location

Bengaluru, India

Full job description

Seeking a senior DevOps engineer with 5+ years experience in DevOps and microservices. Responsibilities include designing and managing CI/CD pipelines, building cloud-native infrastructure on AWS, Azure, or GCP using Infrastructure as Code, supporting deployment and orchestration of microservices with Docker and Kubernetes, managing Databricks environments, automating workflows and monitoring, collaborating with teams for delivery, ensuring security and cost optimization, and troubleshooting infrastructure issues. Required skills: strong Unix/Linux shell scripting, CI/CD tools (Azure DevOps, Jenkins, GitHub Actions), containerization (Docker), orchestration (Kubernetes), Databricks, scripting (Python, Bash, PowerShell), Infrastructure as Code (Terraform, ARM, CloudFormation), monitoring tools (Prometheus, Grafana, CloudWatch, Azure Monitor). Preferred skills include data engineering pipelines (Spark, Delta Lake), streaming architectures (Kafka, Event Hubs), multi-region high availability, and cloud certifications. Bachelor’s degree in Computer Science or related field required.

What you'll do

  • Design, implement, and manage CI/CD pipelines for microservices and data workloads
  • Build and maintain cloud-native infrastructure (AWS, Azure, GCP) using Infrastructure as Code
  • Support deployment and orchestration of microservices-based applications (Docker, Kubernetes)
  • Manage and optimize Databricks environments for data engineering and analytics workloads
  • Automate operational workflows, monitoring, and alerting for high availability systems
  • Collaborate with development, data engineering, and platform teams to ensure seamless delivery
  • Ensure security, compliance, and cost optimization across cloud resources
  • Troubleshoot deployment, performance, and infrastructure issues

Requirements

  • 5+ years of experience in DevOps & Microservices
  • Proficiency in backup and recovery methodologies and techniques
  • Ability to diagnose problems and resolve issues across application, database, network and appliance tiers
  • Adherence to SDLC, Change Management, troubleshooting and development methodologies
  • Strong Unix/Linux and shell scripting skills
  • Ability to perform work with minimal supervisory direction
  • Excellent written and verbal communication skills
  • Strong hands-on expertise with CI/CD tools: Azure DevOps, Jenkins, GitHub Actions
  • Experience with containerization using Docker
  • Experience with orchestration using Kubernetes (EKS/AKS/GKE)
  • Experience with microservices architecture and distributed systems
  • Solid experience with Databricks (cluster management, job orchestration, integrations)
  • Strong scripting skills in Python, Bash, PowerShell
  • Experience with Infrastructure as Code (Terraform, ARM, CloudFormation)
  • Knowledge of monitoring tools (Prometheus, Grafana, CloudWatch, Azure Monitor)
  • Preferred: Experience with data engineering pipelines (Spark, Delta Lake)
  • Preferred: Exposure to streaming architectures (Kafka, Event Hubs)
  • Preferred: Understanding of data lake / lakehouse architectures
  • Preferred: Experience with multi-region / high-availability setups
  • Preferred: Cloud certifications (AWS, Azure DevOps, Databricks)
  • B.S. in Computer Science or related field or equivalent work experience

Tech stack

Azure DevOpsJenkinsGitHub ActionsDockerKubernetesDatabricksPythonBashPowerShellTerraformARMCloudFormationPrometheusGrafanaCloudWatchAzure MonitorSparkDelta LakeKafkaEvent HubsAWSAzure

Benefits

Employee well-being focusCollaborative work environmentOpportunities for growth, learning, development and career advancementInnovation-driven cultureWork-life balance and flexibility

Apply now

This MVP uses a placeholder application flow. In production, this section can connect to an external apply URL or a native application form.

Continue to applicationBrowse more jobs

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.