Data Engineer

ClickHousePythonSQLDagsterdata engineeringmachine learningdata pipelinesperformance tuningcost optimizationremotepair programmingasynchronous communicationlarge scale data

Key details

Salary

Not specified

Employment type

Full-time

Seniority

Senior

Years experience

5-10

Location

Remote

Full job description

Pubstack is hiring a Senior Data Engineer to architect and optimize their high-scale data pipeline. The role involves full ownership of ClickHouse clusters, optimizing for sub-second latency and cost efficiency, ensuring data pipeline reliability for ML models, and building data workflows with Dagster in Python. Candidates must have 5+ years experience in data engineering, expertise in ClickHouse, strong Python and SQL skills, and experience with orchestration tools like Dagster. The position is fully remote and requires professional proficiency in English and French. Benefits include competitive salary, top-tier equipment, Swile vouchers, quarterly off-sites, and a transparent, growth-oriented culture.

What you'll do

Take full ownership of ClickHouse clusters, optimizing table engines, materialized views, and projections for sub-second latency aggregation
Keep infrastructure costs low through architectural choices and performance tuning
Ensure reliability and quality of data pipelines feeding Spark ML models
Collaborate on developing new data-driven use cases
Build and evolve sophisticated data workflows using Dagster in Python

Requirements

5+ years of professional experience as a Data Engineer or similar role
Experience with production systems handling large-scale data workloads
Expertise in advanced ClickHouse optimization and scaling analytics databases for real-time aggregation
Performance-driven mindset focused on infrastructure sustainability and cost-efficiency
Fluent in Python and SQL with ability to write clean, production-grade code and complex queries
Hands-on experience with Dagster preferred, or similar orchestration tools like Prefect or Airflow
Strong advocate for asynchronous communication and written documentation
Enjoys pair programming to share knowledge and solve complex problems
Professional proficiency in English and French

Tech stack

ClickHousePythonSQLDagsterPrefectAirflow

Benefits

Full remote-first work environmentCompetitive salaryTop-of-the-line gearSwile vouchersQuarterly off-sitesTransparency and culture of knowledge sharingOpportunity to work on bleeding edge technology stackWork on a unique product handling massive scale data

Apply now

Ready to take the next step in your career? Click the button below to continue to the application process.

Continue to application Browse more jobs

Company

Pubstack

Pubstack, founded in Paris in 2018, is the leading Enterprise Monetisation Management Platform empowering publishers to streamline operations, reduce costs, and maximize ad revenue. Trusted by over 100 premium publishers, including Le Monde, The Independent, and Vinted, Pubstack offers a no-code solution that simplifies monetisation management and enhances revenue generation through real-time analytics and yield optimization. By reducing dependency on technical teams, Pubstack’s platform improves operational agility, enabling publishers to unlock the full value of their ad inventory. With expert support, Pubstack ensures publishers stay ahead of market trends and adapt swiftly to changes.

Industry

Technology, Information and Internet

Company size

11-50

Website

https://pubstack.io

Posted

4 months ago

Category: Data Science

Similar jobs