AdTechTalent
Engineering15 days agoHybrid

Epsilon

Senior Software Engineer

pythonpysparkapache sparkdatabricksawskafkarabbitmqsqlnosqlci/cddevopsdata engineeringdistributed systemsdata warehousingdata lakesdelta lakegenerative aillmsragagentic aicloud-nativeevent-driven architecture

Key details

Salary

$102K – $190K

Employment type

Full-time

Seniority

Senior

Years experience

5-10

Location

Boston, United States; Wakefield, United States

Full job description

Senior Software Engineer role on the Cleanroom team responsible for delivering and executing critical data systems. Requires 5-8 years of software engineering experience with expertise in large-scale data engineering and distributed systems. Key technologies include Python, PySpark, Apache Spark, Databricks, AWS (S3, Glue, Athena, Lambda), Kafka, RabbitMQ, SQL Server, MongoDB, and CI/CD tools like Jenkins and GitHub/GitLab. Responsibilities include building scalable cloud-native data platforms, collaborating with cross-functional teams, owning the software development lifecycle, designing reusable components, and mentoring junior engineers. Preferred qualifications include AWS and Databricks certifications, experience with Azure or GCP, and exposure to Generative AI technologies. Location: Wakefield and Boston, Massachusetts, USA. Salary range: $102,200 to $189,800 annually. Benefits include flexible time off, paid holidays, sick time, parental leave, childcare assistance, health coverage, 401(k), tuition assistance, commuter benefits, and professional development.

What you'll do

  • Deliver large-scale cloud-native data platforms primarily on AWS using Databricks and distributed processing frameworks
  • Work hands-on across the technology stack including Python, PySpark, Apache Spark, Databricks, AWS services, event-driven architectures, and SQL/NoSQL databases
  • Partner with global engineering, product management, architecture, and business teams to align technical solutions with business objectives
  • Own the end-to-end software development lifecycle including requirements gathering, solution design, development, deployment, observability, and documentation
  • Design and develop reusable, maintainable, and scalable components
  • Participate in architecture discussions, technical design reviews, and code reviews
  • Mentor and guide junior engineers fostering innovation, accountability, collaboration, and technical excellence

Requirements

  • B.E/B.Tech/M.Tech/MCA in Computer Science, Information Technology or related field
  • 5-8 years of strong software engineering experience
  • Expertise in large-scale data engineering and distributed systems architecture
  • Experience in Data Warehousing, Data Lakes, Delta Lake architecture
  • Hands-on expertise in Databricks, Python, PySpark, Apache Spark
  • Experience with AWS services such as S3, Glue, Athena, Lambda
  • Experience with messaging technologies such as Kafka and RabbitMQ
  • Strong expertise in relational and NoSQL databases including SQL Server and MongoDB
  • Experience implementing unit, integration, and regression testing
  • Strong understanding of CI/CD and DevOps practices using Jenkins, GitHub/GitLab, Bitbucket
  • Strong critical thinking and analytical skills
  • Nice to have AWS and Databricks certifications
  • Experience with Azure and/or Google Cloud Platform (GCP)
  • Exposure to Generative AI technologies including LLMs, RAG architectures, and Agentic AI systems

Tech stack

PythonPySparkApache SparkDatabricksAWSAWS S3AWS GlueAWS AthenaAWS LambdaKafkaRabbitMQSQL ServerMongoDBSQLNoSQLJenkinsGitHubGitLabBitbucketCI/CDDevOpsDelta LakeData WarehousingData LakesDistributed SystemsEvent-driven architecturesGenerative AILLMsRAG architecturesAgentic AI

Benefits

Flexible time off (FTO)15 paid holidaysPaid sick timeParental/new child leaveChildcare & elder care assistanceAdoption assistanceComprehensive health coverage401(k)Tuition assistanceCommuter benefitsProfessional developmentEmployee recognitionCharitable donation matchingHealth coaching and counseling

Apply now

This MVP uses a placeholder application flow. In production, this section can connect to an external apply URL or a native application form.

Continue to applicationBrowse more jobs

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.