AdTechTalent
Data Science2 days agoHybrid

Epsilon

Software Engineer

scalapythonjavaapache sparkhadoophiveawsazuredatabricksgcpkubernetesdockerairflowdata engineeringcloud migrationmachine learningbig data

Key details

Salary

$74K – $137K

Employment type

Full-time

Seniority

Mid-level

Years experience

3-5

Location

Chicago, United States

Full job description

Collaborate with decision scientists to enable and optimize AI/ML workflows through data engineering and platform support. Provide support for Spark, Hive, and Hadoop jobs including troubleshooting and performance optimization. Participate in agile sprint cycles, review designs, provide feedback, and ensure successful delivery. Contribute to best practices for application development. Gather requirements for platform and application enhancements and implement them. Continuously learn and expand skills in data engineering and cloud technologies. Support migration of data or applications to cloud platforms (AWS, Azure, Databricks, GCP). Learn and contribute to Databricks platform solutions. Requires 3+ years software development experience in scalable, distributed environments. Proficient in Scala, Python, or Java. Familiar with Apache Spark, Hadoop, Hive, and cloud platforms. BA/BS in Computer Science or related field. Hadoop and Spark certifications are a plus.

What you'll do

  • Collaborate with decision scientists to enable and optimize AI/ML workflows through data engineering and platform support
  • Provide support for Spark, Hive, and Hadoop jobs including troubleshooting and performance analysis and optimization
  • Participate in agile sprint cycles, review designs, provide feedback, and ensure successful delivery
  • Contribute to best practices for application development
  • Gather requirements for platform and application enhancements and work with the team to implement them
  • Continuously learn and expand technical skills in data engineering and cloud technologies
  • Support migration of existing data or applications to cloud platforms (AWS, Azure, Databricks or GCP)
  • Learn and contribute to solutions on the Databricks platform

Requirements

  • 3+ years of software development experience in a scalable, distributed, or multi-node environment
  • Proficient in programming with Scala, Python, or Java
  • Familiarity with Apache Spark and exposure to Hadoop, Hive, or related big data technologies
  • Experience with cloud platforms (AWS, Azure, Databricks or GCP)
  • BA/BS in Computer Science or related discipline
  • Strong problem-solving skills
  • Consultative attitude and collaborative teamwork
  • Hadoop certification is a plus
  • Spark certification is a plus

Tech stack

ScalaPythonJavaApache SparkHadoopHiveAWSAzureDatabricksGCPKubernetesDockerAirflow

Benefits

Flexible time off (FTO)15 paid holidaysPaid sick timeParental/new child leaveChildcare & elder care assistanceAdoption assistanceComprehensive health coverage401(k)Tuition assistanceCommuter benefitsProfessional developmentEmployee recognitionCharitable donation matchingHealth coaching and counseling

Apply now

This MVP uses a placeholder application flow. In production, this section can connect to an external apply URL or a native application form.

Continue to applicationBrowse more jobs

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.