Lead Compute Platform Engineer

Key details

Full job description

Senior Compute Platform Engineer role on the Data Platform team responsible for building and running data infrastructure including Zeta’s lakehouse platform. Deliver reliable, cost-efficient data processing that scales with growth. Work with Scala data warehouse framework for data modeling and batch jobs. Manage compute environment for Spark jobs on Hadoop clusters using EC2 spot instances. Collaborate with teams in San Francisco and Berlin. Mentor engineers and conduct code reviews. Requirements: 7+ years software engineering experience, degree in relevant field, 2+ years Scala or JVM languages, experience with Spark or large-scale data frameworks, Kubernetes and AWS knowledge preferred. Responsibilities include operating and implementing features, improving data scientist productivity, computational improvements, contributing to open-source projects, expert on Spark and Scala, mentoring team. Salary range £100,000 - £112,000. Location: London, UK.