Full job description
Engineer II - Data Engineering role at Magnite working on big data platforms processing hundreds of billions of events daily. Responsibilities include designing, developing, and supporting big data applications using Hadoop, Kafka, ETL, data warehouse integration, Java, Spark, and scripting languages. The role involves full cycle data services development, data analysis, troubleshooting, and production issue resolution. Requires proficiency in Hadoop, Spark, Kafka, Druid, Java, Python, Shell, Perl, and familiarity with JIRA, Jenkins, Github. Bachelor’s degree in CS, EE or related field required. Hybrid work schedule with two remote days (Monday, Friday) and three in-office days (Tuesday to Thursday). Salary range for Colorado location is $115,000 - $125,000 plus variable bonus and equity.
What you'll do
- Design, develop and support big data platform applications including Hadoop, Kafka, ETL, and data warehouse integration
- Develop applications using Java, Spark, and scripting languages (Python, shell) to support application execution
- Design and implement full cycle data services from data transportation, processing, ETL to data delivery for reporting
- Perform data analysis and troubleshooting to support day-to-day production operations
- Proactively identify, troubleshoot and resolve production data and performance issues
Requirements
- Proficiency and hands-on experience with data engineering related technologies: Hadoop, Spark, Kafka, Druid
- Experience with Java and scripting languages (UNIX Shell, Perl, Python)
- Familiarity with process, infrastructure, and application management technologies such as JIRA, Jenkins, Github
- Ability to follow standard development and engineering practices and understand concepts related to computer architecture, data structures, and programming practices
- Experience developing and executing testing/debugging, data quality, and performance tuning applications
- Effective communication skills and ability to work within a team environment
- Bachelor’s degree in Computer Science, Electrical Engineering, or related science
Tech stack
HadoopKafkaDruidJavaScalaSparkPythonShellPerlJIRAJenkinsGithubMapR HadoopSQL
Benefits
Comprehensive Healthcare Coverage from Day OneGenerous Time OffHoliday Breaks and Quarterly Wellness DaysEquity and Employee Stock Purchase PlanFamily-Focused Benefits and Parental Leave401k Retirement Savings Plan with Employer MatchDisability and Life InsuranceCell Phone SubsidyFitness and Wellness ReimbursementCommunity Service and Volunteer EventsCompany-Matched Charitable ContributionsWellness Coach and Mental Health SupportCareer Development Initiatives and a Career Growth FrameworkCulture and Inclusion ProgramsBonusly Peer-to-Peer Recognition Program