AdTechTalent
Data Science8 days agoHybrid

Epsilon

Senior Software Engineer

data engineeringapache sparkdatabrickspysparksparkSQLETLSQLpythonairflowCI/CDdigital marketingdata warehousebig datacloudterraformdata modeling

Key details

Salary

Not specified

Employment type

Full-time

Seniority

Senior

Years experience

5-10

Location

Bengaluru, India

Full job description

Seeking a Senior Data Engineer with 5-8 years experience in Apache Spark, Databricks, ETL, SQL, and Python. Responsibilities include designing and managing ETL/ELT pipelines, leading solution design and development, mentoring junior engineers, and collaborating with global teams. Requires strong database fundamentals, experience with data warehouses handling terabytes of data, and proficiency in CI/CD, Git, and Airflow. Good communication skills and ability to work with diverse teams are essential. Knowledge of cloud platforms and infrastructure-as-code tools like Terraform is a plus. Location: Bengaluru, Karnataka, India.

What you'll do

  • Develop deep understanding of business context and present feature recommendations
  • Lead, design and code solutions on and off database for data-driven decision making
  • Collaborate with global engineering teams to ensure enterprise data warehouse solutions are actionable and evolving
  • Design, develop, and manage ETL/ELT pipelines in Databricks using PySpark/SparkSQL
  • Lead solution design, code development, quality assurance, data modelling, and business intelligence
  • Mentor junior engineers
  • Stay updated on data governance, quality, and performance optimization
  • Conduct effective client meetings and drive successful outcomes

Requirements

  • Bachelor’s Degree in Computer Science or equivalent
  • 5 – 8 years of data engineering experience
  • Expertise using Apache Spark and Databases (preferably Databricks)
  • Strong proficiency in ETL, SQL, and modern data engineering practices
  • Experience in designing, developing, and managing ETL/ELT pipelines
  • Experience with Python
  • Good understanding of CI/CD practices and Git version control
  • Experience with scheduling applications with complex interdependencies, preferably Airflow
  • Experience with disaster recovery and business continuity solutions
  • Good understanding of data management concepts in relational databases and big data lakehouse solutions
  • Excellent written and verbal communication skills
  • Ability to mentor junior engineers
  • Experience working with geographically and culturally diverse teams
  • Good problem-solving and time management skills
  • Good to have knowledge of cloud platforms and infrastructure-as-code tools like Terraform

Tech stack

Apache SparkDatabricksPySparkSparkSQLSQLPythonGitAirflowTerraformApache HiveAWS GlueCI/CD

Benefits

Work with latest tools and technologyExposure to Digital Marketing DomainOpportunity to innovate and recommend solutionsWork in a dynamic, open, and transparent environmentCollaboration with global teamsCareer growth opportunities

Apply now

This MVP uses a placeholder application flow. In production, this section can connect to an external apply URL or a native application form.

Continue to applicationBrowse more jobs

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.