The Trade Desk
Business Development GM (Holdco)
New York, US•3 days ago
$134K – $245K
salesbusiness developmentagency
Data Science29 days agoHybrid
Epsilon
Software Engineer
databrickshadoopsparkpysparkhivesqldelta lakeawsdata engineeringetlperformance tuningbig datadata pipelinesjiragitbitbucket
Key details
Salary
Not specified
Employment type
Full-time
Seniority
Mid-level
Years experience
3-5
Location
Bengaluru, India
Full job description
The Data Engineering team at Epsilon is seeking a mid-level engineer with 3-5 years experience to develop, unit test, and implement data engineering applications primarily in the Hadoop ecosystem and Databricks. The role involves building and optimizing scalable data pipelines using Spark, PySpark, Hive, SQL, and Delta Lake on Databricks, with a focus on performance tuning and large-scale data integration. Candidates must have hands-on experience with Databricks, Hadoop, AWS, and tools like JIRA and Git/Bitbucket. Responsibilities include designing data pipelines, developing efficient code, troubleshooting production issues, participating in code reviews, and collaborating with technical leads and cross-functional teams. The position is based in Bengaluru, Karnataka, India.
What you'll do
- Design, develop, and maintain data pipelines and ETL frameworks using Spark, PySpark, Hive, and SQL
- Design and develop scalable data pipelines and processing frameworks on Databricks using PySpark, SQL, and Delta Lake
Similar jobs
More roles worth a look
Related opportunities based on specialty and working model so candidates can keep momentum.
TripleLift
Accountant
Detroit, United States; New York, US•3 months ago
$75K – $95K
accountingpayrollcompensation
TripleLift