AdTechTalent
Engineering7 months agoHybrid

Epsilon

Staff, Software Engineer

scalaapache sparkhadooppythonsqlawsgcpdatabrickselk stacktableaupower bigrafanadockerkubernetesgitbig datadata processingcloudagilementoring

Key details

Salary

Not specified

Employment type

Full-time

Seniority

Lead

Years experience

10+

Location

Bengaluru, India

Full job description

Seeking a Staff Software Engineer with 12+ years experience in Scala and Apache Spark for big data processing in on-premises and cloud environments (AWS, GCP). Responsibilities include designing and optimizing data processing solutions, collaborating with teams to deploy big data solutions, building and maintaining workflows, performing data integration and transformation, troubleshooting, documenting processes, and enhancing attribution and forecasting engines. Must have strong SQL skills, experience with Hadoop ecosystem, Python, GIT, unit and integration testing, and Agile methodologies (SCRUM). Ability to mentor junior staff and work under tight deadlines required.

What you'll do

  • Design, implement, and optimize data processing solutions using Scala, Spark, and Hadoop
  • Collaborate with cross-functional teams to deploy big data solutions on on-premises and cloud infrastructure
  • Build, schedule, and maintain workflows
  • Perform data integration and transformation
  • Troubleshoot issues
  • Document processes
  • Communicate technical concepts clearly
  • Continuously enhance attribution and forecasting engines
  • Work within Agile methodologies (SCRUM)

Requirements

  • 12+ years experience in Scala programming
  • Extensive experience with Apache Spark for big data processing
  • Experience with on-premises and cloud operations, especially AWS and GCP
  • Hands-on experience with Python for infrastructure modules
  • In-depth understanding of Hadoop ecosystem including HDFS, YARN, MapReduce
  • Strong SQL skills for handling large datasets
  • Experience building, scheduling, and maintaining DAG workflows
  • Familiarity with data warehousing concepts and technologies
  • Experience with GIT or equivalent source control
  • Understanding of unit and integration test frameworks
  • Ability to collaborate with stakeholders and develop working solutions
  • Ability to work under tight deadlines and prioritize tasks
  • Mentoring junior staff

Tech stack

ScalaApache SparkHadoopPythonSQLAWSGCPDatabricksELK stackTableauPower BIGrafanaDockerKubernetesGIT

Benefits

Employee well-being focusCollaborative work environmentOpportunities for growth, learning, and career advancementInnovation-driven cultureWork-life balance and flexibilityDiversity and inclusion commitment

Apply now

Ready to take the next step in your career? Click the button below to continue to the application process.

Continue to applicationBrowse more jobs

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.