SDE III

Key details

Full job description

Position: SDE III/IV - Data Platform Engineering. Architect and build a self-serve Data Platform-as-a-Product for InMobi's global data ecosystem. Responsibilities include designing and developing integrations of OSS tools (Spark, Flink, Airflow, Iceberg), internal services, and cloud offerings into a unified data platform infrastructure. Operate distributed systems processing petabytes of data daily with multi-region Kubernetes infrastructure. Optimize compute utilization for batch and real-time streaming workloads. Build telemetry and data quality frameworks ensuring 24/7 uptime and enforce SLAs/SLOs with automated incident response. Requirements: 7-10 years experience in production data platforms, expertise in data modeling, query optimization, distributed compute (Spark, Flink), data lake architecture (Iceberg, Polaris), orchestration (Airflow), data transformation (DBT), data quality frameworks (Great Expectations), query acceleration (Velox, Gluten), data governance (OpenMetadata), Kubernetes platform development, cloud infrastructure (GKE, GCS), programming in Python, PySpark, Scala, IaC tools (Terraform, Helm, GitOps), and CI/CD pipelines. Good to have experience in cloud data platform/control plane development, advanced observability (Prometheus, Grafana), real-time streaming (Kafka), and cost optimization strategies. Location: Lucknow, India.