Senior Big Data Administrator

Key details

Full job description

Design, implement, and manage CI/CD pipelines for microservices and data workloads. Build and maintain cloud-native infrastructure (AWS/Azure/GCP) using Infrastructure as Code. Support deployment and orchestration of microservices-based applications (Docker, Kubernetes). Manage and optimize Databricks environments for data engineering and analytics workloads. Automate operational workflows, monitoring, and alerting for high availability systems. Collaborate with development, data engineering, and platform teams to ensure seamless delivery. Ensure security, compliance, and cost optimization across cloud resources. Troubleshoot deployment, performance, and infrastructure issues. Requires 5+ years experience in DevOps and microservices, strong Unix/Linux and shell scripting skills, proficiency with CI/CD tools (Azure DevOps, Jenkins, GitHub Actions), containerization (Docker), orchestration (Kubernetes), Databricks, scripting (Python, Bash, PowerShell), Infrastructure as Code (Terraform, ARM, CloudFormation), and monitoring tools (Prometheus, Grafana, CloudWatch, Azure Monitor). Preferred experience with data engineering pipelines (Spark, Delta Lake), streaming architectures (Kafka, Event Hubs), data lake/lakehouse architectures, multi-region/high-availability setups, and cloud certifications. B.S. in Computer Science or related field required.