Data Engineering Team Lead

Key details

Full job description

Smadex is seeking a Data Engineering Team Lead with 6+ years in software or data engineering and 2+ years in leadership managing high-throughput distributed systems. The role is full-time, on-site in Austin, TX or New York, NY. Responsibilities include leading Data Quality and Feature Engineering teams, designing scalable data pipelines for real-time ML inference, establishing data observability and quality frameworks, enforcing data governance and compliance, overseeing feature store development using Scala and Redis, coordinating pipeline workflows with Apache Airflow, ensuring operational excellence, and collaborating with C-level executives. Required skills include advanced Spark, SQL, AWS (EMR, EC2, Athena, S3), debugging distributed systems, and excellent English communication. Preferred experience includes AdTech, RTB/DSP ecosystems, feature stores, containerization (Docker, Kubernetes), and a Master's degree in relevant fields. Tech stack includes Python, Scala, Bash, Spark, MySQL, Redis, AWS, Jenkins, Docker, Airflow, Git, Jira, and Notion. Benefits include competitive U.S. compensation, medical/dental/vision plans, career growth opportunities, and potential travel to Barcelona HQ after one year. No visa sponsorship provided.