AdTechTalent
Engineering18 days agoHybrid

FreeWheel

Lead Software Engineer-0341

Apache FlinkPrometheusGrafanaSparkHBaseAzkabanAirflowApache KafkaAWSLinuxBashdata pipelinesETLreal-time datatechnical leadership

Key details

Salary

Not specified

Employment type

Full-time

Seniority

Senior

Years experience

5-10

Location

Reston, United States

Full job description

Provide technical leadership to build and maintain data infrastructure and products. Process continuous data streams in near real-time using Apache Flink. Use Prometheus and Grafana for system monitoring and alerts. Build ETL and data pipelines using Flink, Spark, HBase, Azkaban, and Airflow. Handle large data volumes with Apache Kafka. Manage data storage, servers, logs, and permissions using AWS Data Stack (S3, EC2, CloudWatch, IAM). Automate Unix tasks with Linux CLI and Bash. Support and customize applications, assist with software updates and releases, test and integrate new applications. Document development activities and technical requirements. Monitor competitive products and review relevant literature. Collaborate with stakeholders on product and technical requirements. Work with QA to ensure application compliance. Mentor junior engineers. Position allows remote work one or more days per week.

What you'll do

  • Provide technical leadership in building and maintaining data infrastructure and products
  • Process continuous data streams in near real-time using Apache Flink
  • Use Prometheus and Grafana for system health tracking and alerts
  • Use Flink, Spark, HBase, Azkaban, and Airflow for ETL and building data pipelines
  • Collect and move large volumes of data using Apache Kafka
  • Store data, run servers, monitor logs, and manage permissions using AWS Data Stack
  • Automate tasks in Unix environment using Linux CLI and Bash
  • Support applications under development and customize current applications
  • Assist with software update processes and roll-outs of software releases
  • Analyze, test, and assist with integration of new applications
  • Document development activity and write technical documentation
  • Monitor and evaluate competitive applications and products
  • Review literature, patents, and current practices relevant to projects
  • Collaborate with stakeholders to identify product and technical requirements
  • Conduct analysis to determine integration needs
  • Work with Quality Assurance team to ensure applications meet specifications
  • Guide and mentor junior-level engineers

Requirements

  • Bachelor’s degree or foreign equivalent in Computer Science, Engineering, or related technical field
  • 7 years experience processing continuous data streams using Apache Flink
  • 5 years experience using Flink, Spark, HBase, Azkaban, and Airflow for building data pipelines and ETL
  • 3 years experience handling real-time data feeds using Apache Kafka
  • Experience storing data, running servers, monitoring logs, and managing permissions using AWS Data Stack (S3, EC2, CloudWatch, IAM)
  • Experience automating tasks in Unix environment using Linux CLI and Bash

Tech stack

Apache FlinkPrometheusGrafanaSparkHBaseAzkabanAirflowApache KafkaAWS S3AWS EC2AWS CloudWatchAWS IAMLinux CLIBash

Benefits

Commission eligibility for sales positionsBonus eligibility for most non-sales positionsComprehensive benefits supporting physical, financial, and emotional well-beingPersonalized options, expert guidance, and always-on tools

Apply now

Ready to take the next step in your career? Click the button below to continue to the application process.

Continue to applicationBrowse more jobs

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.