Senior Data Engineer

Key details

Full job description

Seeking a Senior Data Engineer with 5+ years experience to develop and maintain data pipelines and analytics infrastructure using Databricks and SQL. Responsibilities include developing ETL/ELT pipelines with Databricks, PySpark, and SQL; writing efficient SQL and Python code; maintaining data pipelines and troubleshooting data quality issues; collaborating with engineering and analytics teams; implementing data validation and logging; documenting code and architecture; and participating in code reviews. Required skills: Databricks, Spark SQL, PySpark, SQL, Python, cloud ETL platforms (Azure Data Factory, AWS Glue), data architecture, and problem-solving. Certifications such as Databricks Certified Data Engineer, Snowflake SnowPro Core, or AWS Certified Data Engineer preferred. Experience with orchestration tools (Apache Airflow, Tidal, Control-M), cloud data warehousing (Snowflake, Redshift, BigQuery), Git, CI/CD, Agile methodologies, and data validation frameworks is a plus.