AdTechTalent
Data Science1 month agoHybrid

Epsilon

Data Solutions Engineer

SQLPythonScalaJavaSparkKafkaHadoopDatabricksKubernetesArgoCDStrimziData WarehouseBig DataCloudCI/CDData EngineeringPerformance Optimization

Key details

Salary

$74K – $137K

Employment type

Full-time

Seniority

Mid-level

Years experience

3-5

Location

Chicago, United States

Full job description

Develop and maintain large-scale data solutions handling hundreds of terabytes daily. Use SQL, Python, Scala, and Java to design and implement scalable data architectures in on-premises and cloud environments. Collaborate globally with engineering and business teams to deliver efficient, cost-effective solutions. Support migration from legacy systems to cloud platforms like Databricks. Manage deployments using Kubernetes, ArgoCD, and Strimzi. Troubleshoot production issues, optimize performance, and continuously improve processes. Requires Bachelor's in Computer Science or equivalent, 3-6 years experience, strong SQL and Python skills, and ability to work independently and in teams.

What you'll do

  • Build and maintain data solutions collecting and warehousing hundreds of terabytes of data per day
  • Influence technical decisions
  • Stay informed and up to date with technologies
  • Build data expertise on subject matter and speak to data warehouse constructs and data architecture
  • Design and code solutions in both on-premises and cloud environments
  • Work closely with Engineering and Business resources globally to deliver cost-effective solutions
  • Design and implement scalable data solutions within a CI/CD environment
  • Support migration from on-premises ecosystem to cloud-based architecture leveraging Databricks
  • Continuously improve processes optimizing for speed and cost savings while scaling data volumes
  • Lead development of solutions in Spark (Scala and Python), cross-team communication, testing and release deployment
  • Manage deployments to Kubernetes clusters using ArgoCD and Strimzi for Kafka operations

Requirements

  • Bachelor’s Degree in Computer Science or equivalent
  • 3-6 years professional experience on a development team manipulating data
  • Fluent SQL with ability to ingest complex use cases, refactor and ask questions
  • Strong experience in Python or other languages (JAVA or Scala)
  • Ability to troubleshoot production issues and solve for performance bottlenecks
  • Ability to analyze processes and identify improvements and optimizations
  • Excellent communication skills and ability to work with internal analyst community
  • Ability to thrive in a collaborative team environment and handle complex products

Tech stack

SQLPythonScalaJavaSparkKafkaHadoopHDFSGreenPlumDatabricksKubernetesArgoCDStrimziMPP RDBMSPostgresAWSAirFlowDocker

Benefits

Flexible time off (FTO)15 paid holidaysPaid sick timeParental/new child leaveChildcare & elder care assistanceAdoption assistanceComprehensive health coverage401(k)Tuition assistanceCommuter benefitsProfessional developmentEmployee recognitionCharitable donation matchingHealth coaching and counseling

Apply now

This MVP uses a placeholder application flow. In production, this section can connect to an external apply URL or a native application form.

Continue to applicationBrowse more jobs

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.