AdTechTalent
Engineering1 month agoHybrid

Zeta Global

Senior Compute Platform Engineer

scalasparkhadoopicebergairflowkubernetesawsec2s3athenadata platformdata engineeringbig datascalajvmsoftware engineeringmentoring

Key details

Salary

€120K – €130K

Employment type

Full-time

Seniority

Senior

Years experience

5-10

Location

Berlin, Germany

Full job description

Senior Compute Platform Engineer role on the Data Platform team responsible for building and running data infrastructure including Zeta's lakehouse platform. Deliver reliable, cost-efficient data processing that scales with growth. Work with Scala data warehouse framework for data modeling and batch jobs. Manage compute environment for Spark jobs on Hadoop clusters using EC2 spot instances. Collaborate with teams in San Francisco and Berlin. Mentor engineers and conduct code reviews. Responsibilities include operating and implementing features, improving data scientist productivity, computational improvements, contributing to open-source projects (Spark, Iceberg, Hadoop, Airflow), acting as Spark and Scala expert, and mentoring. Requirements: minimum 7 years software engineering experience, degree in CS or related field, 2+ years Scala or JVM languages, experience with Spark or large-scale data processing, Kubernetes experience a plus, basic AWS knowledge, interest in backend tech and adtech, analytical and pragmatic problem solving, ability to work independently, excellent communication skills. Salary range €120,000 - €130,000.

What you'll do

  • Operating and implementing new features in the framework and the services managed by the team
  • Engaging with data scientists and identifying ways of improving their experience and productivity when using our framework and services
  • Identifying and implementing computational improvements
  • Making improvements and/or fixing bugs by submitting patches to open-source projects in our stack, such as Spark, Iceberg, Hadoop, Airflow, and many others
  • Acting as an expert on Spark and Scala
  • Mentoring engineers (including through pairing, design discussions, and knowledge-sharing sessions) and helping raise the bar on quality, reliability, and good practices across the team

Requirements

  • Minimum 7 years of software engineering experience
  • A degree in Computer Science, Software Engineering, Physics, Math, or a related field
  • 2+ years of experience and proficiency in Scala or other JVM-based languages
  • Experience with Spark and/or other large-scale data-processing frameworks
  • Experience with Kubernetes is a plus
  • Basic knowledge of Amazon Web Services (EC2, S3, Athena, etc.)
  • Interest in back-end technologies, architecture, and passion for learning new things
  • Interest in math, statistics, or adtech technology is a plus
  • Analytical approach to problems and pragmatic approach to solutions
  • Ability to work independently and enterprisingly in a dynamic environment where work priorities can change
  • Excellent interpersonal and communication skills, with the ability to discuss ideas in a distanced and constructive manner

Tech stack

ScalaSparkHadoopIcebergAirflowKubernetesAmazon Web Services (EC2, S3, Athena)

Apply now

Ready to take the next step in your career? Click the button below to continue to the application process.

Continue to applicationBrowse more jobs

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.