Senior/Staff Software Engineer, Data Platform

What you'll do

• Lead architecture design, table definition, metric consistency, data modeling, and implementation of big data solutions and analytics applications
• Work with latest big data and analytics technologies to break down complex deliverables
• Lead governance of business-critical product data sets within data warehouse
• Architect components and configurations for data pipeline implementation in AWS and Databricks
• Architect data pipeline metrics to monitor performance, accuracy, and availability
• Enable team to research, implement, and evolve data processing methods
• Optimize data processing and data access to business intelligence tools
• Collaborate across organization to enable business growth through data services and models
• Identify and resolve stability issues and author improvements
• Lead collaboration with security team to implement and maintain data security measures
• Ensure compliance with data governance and privacy regulations

Requirements

• 5+ years of software engineering experience
• Strong Scala and Python skills with expert understanding of backend and data engineering design patterns
• Deep understanding of big data processing environments such as Spark and Databricks
• Experience with data processing using Spark in a production environment
• Proven experience with orchestration tools such as Airflow and MWAA
• Experience working in the Cloud Computing ecosystem (AWS preferred, open to GCP, Azure)
• Experience with infrastructure as code tools like Terraform and AWS CloudFormation
• Deep understanding of relational databases, big data tables, and noSQL databases
• Ability to triage, debug, and permanently fix complex data processing issues
• Mature understanding of product domain and architecture
• Strong individual contributor capable of defining and architecting features
• Knowledge of industry best practices, design principles, and design patterns
• Ability to write clean, testable, readable, maintainable, quality code
• Experience with proof of concept and greenfield development
• Ability to set standards for documentation and coding processes
• Desire for professional growth and dynamic learning environment
• Ability to multi-task and collaborate across all employee levels
• Creative and analytical mindset with strong problem-solving skills
• Excellent communication and collaboration skills
• Willingness to assist others with issues

Tech stack

Benefits