Lead Data Engineer - Freewheel at FreeWheel | AdTechTalent
Data ScienceYesterdayOn-site
FreeWheel
Lead Data Engineer - Freewheel
data engineeringapache sparksqljavadatabrickskubernetesteradataawsminioaws s3redshiftdata pipelinesdata qualitydata architecture
Key details
Salary
Not specified
Employment type
Full-time
Seniority
Senior
Years experience
10+
Location
Maryland, United States; Reston, United States
Full job description
Lead the design and management of data engineering solutions to improve decision-making and operational efficiency. Develop robust data pipelines and storage systems ensuring high data quality and accessibility. Strategize and implement data architecture across platforms including Kubernetes, Teradata, AWS, and Databricks. Responsibilities include standardizing data delivery, ensuring data quality, designing APIs and data extracts, selecting appropriate data storage solutions, mapping data lineage, collaborating with teams to improve data processes, and setting design and QA standards. Requires 10+ years experience, Bachelor's degree or equivalent, and skills in Data Engineering, Apache Spark, SQL, Java, and Databricks. Must be able to work nights and weekends as needed. Salary ranges from $158,057.06 to $237,085.58 in Virginia and $144,312.96 to $237,085.58 in Maryland.
What you'll do
Lead data structure and pipeline development to standardize, transform, and deliver data for insights and reporting
Ensure data quality throughout ingestion, processing, and loading using data quality frameworks
Similar jobs
More roles worth a look
Related opportunities based on specialty and working model so candidates can keep momentum.
Design and implement standardized data consumption methods including APIs, database views, and data extracts
Design and deploy data solutions on Kubernetes, Teradata, AWS, and Databricks
Select data storage solutions tailored to sensitivity and access needs using minIO, Teradata, AWS S3, and Redshift
Map data lineage and apply transformation rules to facilitate troubleshooting and impact analysis
Collaborate with cross-functional teams to refine data sourcing and processing, enhancing data quality and operational processes
Set design standards and QA protocols to ensure interoperability of data flows and storage solutions
Exercise independent judgment and discretion in significant matters
Maintain regular, consistent, and punctual attendance; work nights and weekends as necessary
Perform other duties as assigned
Requirements
Bachelor's Degree or equivalent combination of coursework and experience
10+ years of relevant work experience
Experience leading data structure and pipeline development
Experience ensuring data quality throughout the lifecycle
Experience designing and implementing data consumption methods such as APIs, database views, and data extracts
Experience with data solutions on Kubernetes, Teradata, AWS, and Databricks
Experience choosing data storage solutions based on sensitivity and access needs
Ability to map data lineage and apply transformation rules
Ability to collaborate with cross-functional teams to improve data sourcing and processing
Ability to set design standards and QA protocols for software/systems development
Ability to exercise independent judgment and discretion
Willingness to work nights and weekends as necessary
Tech stack
Data EngineeringApache SparkSQLJavaDatabricksKubernetesTeradataAWSminIOAWS S3Redshift
Benefits
Base pay within specified salary rangeBonus eligibility for non-sales positionsComprehensive benefits including physical, financial, and emotional supportAccess to expert guidance and personalized toolsSupport for major life milestones and everyday needs
Apply now
Ready to take the next step in your career? Click the button below to continue to the application process.
