Senior Data Engineer, Big Data and Cloud

What you'll do

• Design and develop data engineering solutions that enable data pipelines, visualization, and analytical tools to support business requirements
• Innovate, implement, support, and iterate on scalable big data pipelines and ETL processes
• Write robust, efficient, and highly maintainable code in Python, Spark and Scala
• Contribute to team knowledge sharing and drive the advancement of new data engineering capabilities
• Assist technical, product, and operational leaders in project definition, including estimating, planning, and scoping work to meet objectives
• Perform other duties/projects as assigned by business management as needed

Requirements

• Bachelor's Degree plus 5 years of related work experience OR Advanced degree with 3 years of related experience
• Degree in Computer Engineering, Computer Science, or related subject area
• 4-7 years hands-on implementation and architectural familiarity with streaming data, relational and non-relational databases, and distributed processing technologies
• 4-7 years designing and developing advanced data engineering tasks in Python, SQL, Spark, and related Python libraries (pandas, scikit-learn, scipy, numpy)
• 4-7 years advanced knowledge in building complex data pipelines and cloud-based services (GCP) to support robust and scalable infrastructure (Airflow, Kafka)
• Strong background in software engineering, large-scale data and algorithms, cloud architecture, and design thinking
• Experience with production-level engineering around GIS and geospatial data processing (preferred)
• Familiarity with DevOps practices and tools for DataOps
• Ability to work quickly and precisely, capturing requirements and designing before implementation
• Knowledge of Google BigQuery and tools for solving data-centric problems and working with graph datasets and databases

Tech stack

Benefits