AdTechTalent
Engineering1 month agoHybrid

Zeta Global

Senior Compute Platform Engineer

scalasparkhadoopairflowicebergkubernetesawsec2s3athenadata platformdata engineeringbig datasoftware engineeringadtech

Key details

Salary

£100K – £112K

Employment type

Full-time

Seniority

Senior

Years experience

5-10

Location

London, United Kingdom

Full job description

Senior Compute Platform Engineer role on the Data Platform team responsible for building and running data infrastructure including Zeta's lakehouse platform. Deliver reliable, cost-efficient data processing to support engineers and analysts. Work with a Scala data warehouse framework for data modeling and batch jobs. Manage compute environment for Spark jobs on Hadoop clusters using EC2 spot instances with dynamic scaling. Collaborate with teams in San Francisco and Berlin. Mentor engineers and conduct code reviews. Requirements: minimum 7 years software engineering experience, degree in relevant field, 2+ years Scala or JVM language proficiency, experience with Spark or similar frameworks, Kubernetes experience a plus, basic AWS knowledge, interest in backend technologies and adtech, strong analytical and communication skills. Salary range £100,000 - £112,000. Location: London, hybrid work model.

What you'll do

  • Operating and implementing new features in the framework and the services managed by the team
  • Engaging with data scientists and identifying ways of improving their experience and productivity when using our framework and services
  • Identifying and implementing computational improvements
  • Making improvements and/or fixing bugs by submitting patches to open-source projects in our stack, such as Spark, Iceberg, Hadoop, Airflow, and many others
  • Acting as an expert on Spark and Scala
  • Mentoring engineers (including through pairing, design discussions, and knowledge-sharing sessions) and helping raise the bar on quality, reliability, and good practices across the team

Requirements

  • Minimum 7 years of software engineering experience
  • A degree in Computer Science, Software Engineering, Physics, Math, or a related field
  • 2+ years of experience and proficiency in Scala or other JVM-based languages
  • Experience with Spark and/or other large-scale data-processing frameworks
  • Experience with Kubernetes is a plus
  • Basic knowledge of Amazon Web Services (EC2, S3, Athena, etc.)
  • Interest in back-end technologies, architecture, and passion for learning new things
  • Interest in math, statistics, or adtech technology is a plus
  • Analytical approach to problems and pragmatic approach to solutions
  • Ability to work independently and enterprisingly in a dynamic environment where work priorities can change
  • Excellent interpersonal and communication skills, with the ability to discuss ideas in a distanced and constructive manner

Tech stack

ScalaSparkIcebergHadoopAirflowKubernetesAmazon Web ServicesEC2S3Athena

Apply now

Ready to take the next step in your career? Click the button below to continue to the application process.

Continue to applicationBrowse more jobs

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.