AdTechTalent
Data Science4 days agoHybrid

Epsilon

Senior Software Engineer

databrickshadoopsparkpysparkhivesqldelta lakeawsdata engineeringperformance tuningetlbig datadata pipelinesjiragitbitbucket

Key details

Salary

Not specified

Employment type

Full-time

Seniority

Senior

Years experience

5-10

Location

Bengaluru, India

Full job description

The Data Engineering team at Epsilon is seeking a senior data engineer with 5-8 years of experience to develop, unit test, and implement applications primarily in the Hadoop ecosystem and Databricks. The candidate must have hands-on experience with Spark, PySpark, Hive, Hadoop, Databricks, and AWS. Responsibilities include designing and maintaining scalable data pipelines and ETL frameworks, optimizing Spark jobs, contributing to data modeling and governance, troubleshooting production issues, participating in code reviews, and collaborating with cross-functional teams. Qualifications include a BE/B.Tech/MCA degree (no correspondence courses) and experience with JIRA and GIT/Bitbucket. The role offers exposure to modern data platforms, cloud ecosystems, and a collaborative agile environment in Bengaluru, India.

What you'll do

  • Design, develop, and maintain data pipelines and ETL frameworks using Spark, PySpark, Hive, and SQL
  • Design and develop scalable data pipelines and processing frameworks on Databricks using PySpark, SQL, and Delta Lake
  • Develop efficient, reusable, and reliable code for data processing and transformation
  • Optimize and tune Spark jobs for performance and scalability
  • Work with Technical Leads, Architects and data platform teams to implement robust data solutions
  • Contribute to data modeling, quality, and governance initiatives
  • Perform detailed analysis, troubleshooting, and root cause analysis for production issues
  • Participate in code reviews and enforce best coding and design practices
  • Collaborate with cross-functional teams to deliver high-quality software solutions
  • Improve and optimize deployment challenges and help deliver reliable solutions
  • Interact with technical leads and architects to solve challenges faced by Data Engineering teams
  • Contribute to continuous improvement of the development and delivery process

Requirements

  • BE / B.Tech / MCA – No correspondence course
  • 5-8 years of experience
  • Hands-on experience in building and optimizing data solutions on the Hadoop ecosystem leveraging PySpark
  • Good knowledge and experience with Databricks
  • Experience working with AWS
  • Experience with performance tuning for large data sets
  • Experience with JIRA for user-story/bug tracking
  • Experience with GIT/Bitbucket

Tech stack

DatabricksHadoopSparkPySparkHiveSQLDelta LakeAWSJIRAGITBitbucket

Benefits

Opportunity to design, build, and optimize large-scale data solutionsExposure to diverse data engineering challengesHands-on experience with modern data platforms, cloud ecosystems, and automation frameworksCollaborative and agile work environmentBeing part of a global Data team impacting data-driven decision-making

Apply now

Ready to take the next step in your career? Click the button below to continue to the application process.

Continue to applicationBrowse more jobs

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.