Senior Data Engineer role to architect and build Epsilon's enterprise Corporate Intelligence Platform on Databricks. Responsibilities include designing scalable data ingestion frameworks, implementing Medallion Architecture, establishing data governance, building semantic models, and creating certified data products for executive dashboards and AI solutions. Requires 5+ years experience with Databricks, Delta Lake, Unity Catalog, Python, SQL, and cloud platforms (preferably AWS). Must have strong data modeling, governance, and stakeholder management skills. Benefits include flexible time off, paid holidays, health coverage, 401(k), parental leave, and professional development. Location: Chicago, Illinois, United States. Salary range: $88,900 - $165,100 annually.
What you'll do
Design and implement scalable Bronze, Silver, and Gold data layers using Databricks and Delta Lake architecture patterns
Develop reusable ingestion frameworks, transformation pipelines, and governed data products supporting enterprise reporting and AI initiatives
Similar jobs
More roles worth a look
Related opportunities based on specialty and working model so candidates can keep momentum.
Build and manage ingestion pipelines from systems including HRIS, Jira, Salesforce, Finance platforms, Resource Forecasting systems, and other enterprise applications
Implement data quality monitoring, metadata management, lineage tracking, security classifications, masking strategies, governance controls, and certification processes
Create semantic models, curated datasets, feature layers, and optimized data structures consumed by Databricks Genie, AI applications, executive dashboards, and self-service analytics platforms
Drive architecture decisions across Delta Lake, Unity Catalog, Databricks Workflows, Delta Live Tables, semantic modeling, governance, and enterprise AI enablement
Support executive initiatives around resource planning, product investment management, engineering cost transparency, sales operations, client profitability analysis, workforce planning, and enterprise reporting
Define governance standards, certified metrics, enterprise taxonomies, semantic layers, and reusable data products leveraged across the company
Requirements
Bachelor's degree in Computer Science, Engineering, Information Systems, Data Engineering, or related technical discipline
5+ years of experience building enterprise-scale data platforms and modern cloud-based analytics solutions
Deep expertise with Databricks, Delta Lake, Unity Catalog, and Medallion Architecture design patterns
Advanced proficiency using Python, SQL, and data engineering frameworks
Experience designing Bronze, Silver, and Gold layer architectures
Experience building enterprise ETL/ELT pipelines and scalable data ingestion frameworks
Strong data modeling skills including dimensional modeling, semantic modeling, canonical data models, and enterprise taxonomy design
Experience implementing data governance, metadata management, lineage tracking, and data quality frameworks
Working knowledge of cloud platforms, preferably AWS
Strong communication and stakeholder management skills
Ability to independently lead technical initiatives from architecture through production deployment
Tech stack
DatabricksDelta LakeUnity CatalogDatabricks WorkflowsDelta Live TablesPythonSQLAWS
Benefits
Flexible time off (FTO)15 paid holidaysPaid sick timeParental/new child leaveChildcare & elder care assistanceAdoption assistanceComprehensive health coverage401(k)Tuition assistanceCommuter benefitsProfessional developmentEmployee recognitionCharitable donation matchingHealth coaching and counseling
Apply now
Ready to take the next step in your career? Click the button below to continue to the application process.
