Senior Compute Platform Engineer

What you'll do

• Operating and implementing new features in the framework and the services managed by the team
• Engaging with data scientists and identifying ways of improving their experience and productivity when using our framework and services
• Identifying and implementing computational improvements
• Making improvements and/or fixing bugs by submitting patches to open-source projects in our stack, such as Spark, Iceberg, Hadoop, Airflow, and many others
• Acting as an expert on Spark and Scala
• Mentoring engineers (including through pairing, design discussions, and knowledge-sharing sessions) and helping raise the bar on quality, reliability, and good practices across the team

Requirements

• Minimum 7 years of software engineering experience
• A degree in Computer Science, Software Engineering, Physics, Math, or a related field
• 2+ years of experience and proficiency in Scala or other JVM-based languages
• Experience with Spark and/or other large-scale data-processing frameworks
• Experience with Kubernetes is a plus
• Basic knowledge of Amazon Web Services (EC2, S3, Athena, etc.)
• Interest in back-end technologies, architecture, and passion for learning new things
• Interest in math, statistics, or adtech technology is a plus
• Analytical approach to problems and pragmatic approach to solutions
• Ability to work independently and enterprisingly in a dynamic environment where work priorities can change
• Excellent interpersonal and communication skills, with the ability to discuss ideas in a distanced and constructive manner

Tech stack