AdTechTalent
Engineering23 days agoHybrid

Epsilon

Senior Data Engineer

apache sparkdatabricksairflowsqlpythonetldata engineeringbig dataci/cdgitpostgreSQLsparkSQLhiveaws glueterraformdigital marketingmentoringworkflow orchestration

Key details

Salary

$89K – $165K

Employment type

Full-time

Seniority

Senior

Years experience

5-10

Location

Chicago, United States

Full job description

Senior Software Engineer role focused on designing, building, and optimizing large-scale data solutions for digital marketing. Requires 5-8 years of data engineering experience with expertise in Apache Spark (Databricks preferred), SQL, Python, ETL/ELT design, and workflow orchestration tools like Airflow. Responsibilities include collaborating with global teams, working with petabyte-scale data, mentoring engineers, and influencing architecture. Must have strong communication skills and familiarity with digital marketing technologies. Benefits include flexible time off, paid holidays, health coverage, 401(k), parental leave, and professional development. Location: Chicago, Illinois, United States. Salary range: USD $88,900 - $165,100 annually.

What you'll do

  • Design, build, and optimize large-scale data solutions for digital marketing strategies
  • Collaborate with Engineering Manager, global engineering teams, delivery teams, and clients
  • Work with petabyte-scale data using Spark, Databricks, and Airflow
  • Solve complex data challenges and transform raw data into actionable insights
  • Grow into a technical leader, mentoring engineers and influencing architecture
  • Build expertise in data engineering, data governance, performance optimization, and disaster recovery
  • Propose and implement innovative frameworks and best practices

Requirements

  • 5–8 years of data engineering experience with strong ETL/ELT design and optimization skills
  • Expertise in big data processing using Apache Spark (preferably Databricks), SQL (basic & advanced), and Python
  • Experience building scalable pipelines and working with large datasets (terabytes to petabytes)
  • Knowledge of CI/CD practices, Git workflows, and test-driven development
  • Proficiency with workflow orchestration tools (preferably Airflow)
  • Strong communication skills with experience in global, cross-cultural teams
  • Hands-on experience with PostgreSQL, SparkSQL, Hive, or AWS Glue
  • Familiarity with digital marketing technologies and consumer data ecosystems
  • Proven ability to mentor engineers and lead solution design discussions
  • Nice to have: Knowledge of cloud platforms and infrastructure-as-code tools (e.g., Terraform)

Tech stack

Apache SparkDatabricksAirflowSQLPythonPostgreSQLSparkSQLHiveAWS GlueCI/CDGitTerraform

Benefits

Flexible time off (FTO)15 paid holidaysPaid sick timeParental/new child leaveChildcare & elder care assistanceAdoption assistanceComprehensive health coverage401(k)Tuition assistanceCommuter benefitsProfessional developmentEmployee recognitionCharitable donation matchingHealth coaching and counseling

Apply now

Ready to take the next step in your career? Click the button below to continue to the application process.

Continue to applicationBrowse more jobs

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.