AdTechTalent
Data ScienceYesterdayRemote

Simulmedia

Senior Data Engineer

pythonsqlsparkdatabricksdelta lakeredshiftpostgresairflowdockerawsetldata pipelinesdata engineeringrest apici/cdbig datadata modelingworkflow orchestrationfastapiflaskmediaadvertising

Key details

Salary

Not specified

Employment type

Full-time

Seniority

Senior

Years experience

5-10

Location

Kyiv, Ukraine; Lviv, Ukraine

Full job description

Simulmedia seeks a senior Data Engineer with 7+ years experience to design, build, and operate large-scale data pipelines and data models. The role involves working with Python, SQL, Spark/Databricks, Delta Lake, Redshift, and Airflow to ingest, validate, and transform multi-billion-row datasets. Responsibilities include migrating pipelines, building REST APIs, optimizing performance and cost, monitoring production, and collaborating cross-functionally. Candidates must have strong skills in Python, expert SQL, distributed data processing, data modeling, workflow orchestration, AWS, Docker, and engineering best practices. Must communicate effectively with U.S. teams and work 11:00 AM - 8:00 PM EEST. Location is mandatory in Ukraine, with offices in Kyiv and Lviv; work is primarily remote with occasional onsite meetings.

What you'll do

  • Design and build batch data pipelines ingesting, validating, and transforming multi-billion-row datasets
  • Model complex real-world data including dimensional, reference, and temporal data
  • Develop and operate workloads on lakehouse platform (Databricks / Spark / Delta) and data warehouse (Redshift)
  • Migrate existing pipelines from warehouse to lakehouse
  • Orchestrate pipelines with Airflow including scheduling, dependencies, retries, backfills, and alerting
  • Design parity checks and reconciliation queries to prove correctness
  • Run large historical backfills and investigate data discrepancies down to row level
  • Build and maintain Python services and REST APIs serving internal products
  • Optimize performance and cost via query tuning, table design, workload management, and compute right-sizing
  • Monitor production pipelines, participate in incident triage and root-cause analysis, and harden systems
  • Collaborate cross-functionally with product managers, data scientists, and stakeholders
  • Work within an Agile team releasing new features regularly
  • Take ownership and experiment with new technologies to improve software

Requirements

  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • 7+ years of work experience as a data engineer
  • Proficiency in Python as primary development language
  • Expert-level SQL skills for complex analytical queries and debugging
  • Hands-on experience with distributed data processing platforms (Spark/Databricks preferred; EMR, Snowflake, BigQuery also relevant)
  • Experience with columnar data warehouses (Redshift, Snowflake, BigQuery, ClickHouse, etc.)
  • Ability to design complex data models including normalized, dimensional, and temporal models
  • Experience with workflow orchestration tools like Airflow
  • Experience integrating third-party data feeds handling schema drift and data-quality issues
  • Experience building REST services in Python (FastAPI, Flask, etc.)
  • Experience developing, maintaining, and debugging large server-side codebases
  • Working knowledge of AWS services and Docker
  • Good knowledge of engineering best practices and testing (unit, integration, code review, CI/CD)
  • High level of ownership and ability to learn quickly
  • Must be able to communicate effectively with U.S.-based teams
  • Ability to work 11:00 AM — 8:00 PM EEST
  • Experience with Delta Lake / medallion lakehouse architectures is a plus
  • Experience migrating legacy pipelines with strict parity requirements is a plus
  • Experience with advertising, media or measurement industry data is a plus

Tech stack

PythonSQLSparkDatabricksDelta LakeRedshiftPostgresAirflowDockerAWS (S3, ECS, EMR, RDS, IAM)GitHub ActionsJenkinsGrafanaSentryOpenSearchFastAPIFlask

Apply now

Ready to take the next step in your career? Click the button below to continue to the application process.

Continue to applicationBrowse more jobs

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.