Seeking a Senior Software Engineer for Epsilon’s Data Practice focused on TotalSource Plus demographic and lifestyle products. Responsibilities include designing, developing, and maintaining scalable data processing solutions using Python and Apache Spark on Databricks, optimizing Spark jobs, building fault-tolerant data pipelines with monitoring and alerting, leveraging AWS cloud services, developing and optimizing SQL queries, applying design patterns for data modeling and distributed systems, using Git for source control, collaborating with cross-functional teams, extracting insights from large datasets, and mentoring junior engineers. Requirements include 5+ years of software development experience in scalable distributed environments, proficiency in Scala, Python, or Java, significant Apache Spark experience, cloud platform experience (AWS preferred), exposure to Kubernetes, Docker, MWAA/Airflow, strong problem-solving and communication skills, BA/BS in Computer Science or related field, experience in machine learning, and preferred certifications in AWS, Databricks, or Spark.
What you'll do
Design, develop, and maintain scalable data processing solutions across on-premises and cloud environments using Python and Apache Spark on Databricks
Similar jobs
More roles worth a look
Related opportunities based on specialty and working model so candidates can keep momentum.
