Lead Software Engineer (Data)-7999 at FreeWheel | AdTechTalent
Engineering3 days agoHybrid
FreeWheel
Lead Software Engineer (Data)-7999
Apache FlinkSparkKafkaAWSEMRAzkabanAirflowHbaseLinuxBashETLdata pipelinesstreamingad servingad decisioningaudience targetingtechnical leadershiponline video advertising
Key details
Salary
From $175K
Employment type
Full-time
Seniority
Senior
Years experience
5-10
Location
Reston, United States
Full job description
Provide technical leadership for a team developing data processing software using Apache Flink. Design ETL data pipelines using Flink, Spark, Kafka, AWS EMR, Azkaban, and Airflow. Store structured data with Hbase. Develop online video advertising technologies including ad serving platforms, ad decisioning systems, and audience targeting. Develop streaming data pipelines with Apache Kafka. Utilize AWS services (S3, EC2, CloudWatch, IAM) for data storage, service operation, monitoring, and permissions management. Automate Unix tasks using Linux CLI and Bash scripting. Support and customize applications, assist with software updates and releases, analyze and integrate new applications, document development activities, monitor competitive products, collaborate with stakeholders on requirements, conduct integration analysis, work with QA to ensure specifications are met, and mentor junior engineers. Position allows remote work one or more days per week per company policy.
What you'll do
Provide technical leadership to a team developing data processing software using Apache Flink
Similar jobs
More roles worth a look
Related opportunities based on specialty and working model so candidates can keep momentum.
Design ETL data pipelines using proprietary ETL development library and technologies including Flink, Spark, Kafka, AWS EMR, Azkaban, and Airflow
Store structured data using Hbase
Develop business-level online video advertising technologies such as ad serving platforms, ad decisioning systems, and audience targeting
Develop streaming data pipelines using Apache Kafka
Use AWS services (S3, EC2, CloudWatch, IAM) for data storage, running services, monitoring logs, and managing permissions
Automate tasks in Unix environment using Linux CLI and Bash scripting
Support and customize applications under development
Assist with software update processes and software release roll-outs
Analyze, test, and assist with integration of new applications
Document development activities and write/edit technical documentation
Monitor and evaluate competitive applications and products
Review literature, patents, and current practices relevant to assigned projects
Collaborate with project stakeholders to identify product and technical requirements
Conduct analysis to determine integration needs
Work with Quality Assurance team to ensure applications meet specifications and technical requirements
Guide and mentor junior-level engineers
Requirements
Bachelor’s degree or foreign equivalent in Computer Science, Engineering, or related technical field
7 years experience developing data processing software using Apache Flink
5 years experience designing ETL data pipelines using Flink, Spark, Kafka, AWS EMR, Azkaban, and Airflow
Experience storing structured data using Hbase
Experience developing business-level online video advertising technologies including ad serving platforms, ad decisioning systems, and audience targeting
3 years experience developing streaming data pipelines using Apache Kafka
Experience with AWS services including S3, EC2, CloudWatch, and IAM for storing data, running services, monitoring logs, and managing permissions
Experience automating tasks in a Unix environment using Linux CLI and Bash scripting
Comprehensive benefits as detailed at https://jobs.comcast.com/life-at-comcast/benefitsBonus eligibility for non-sales positionsSupport for physical, financial, and emotional well-beingPersonalized benefit options and expert guidance
Apply now
Ready to take the next step in your career? Click the button below to continue to the application process.
