AdTechTalent
Engineering54 days agoHybrid

Quantcast

Software Engineer (Big Data)

apache sparkhadoophdfsdockerkubernetesairflowjavapythonlinuxdistributed systemsbig datadata infrastructureci/cd

Key details

Salary

$139K – $162K

Employment type

Full-time

Seniority

Entry

Years experience

0-2

Location

San Francisco, California, United States

Full job description

Quantcast is seeking a junior Software Engineer for the Big Data Services team to build, maintain, and optimize large-scale data processing systems supporting data science and engineering teams. The role involves working with distributed storage and compute platforms such as HDFS and Apache Spark. Responsibilities include developing and optimizing data workflows, operating elastic and fault-tolerant data systems, deploying and maintaining production systems with CI/CD, contributing to technical roadmaps, and writing clean, maintainable code. Candidates should have 0-1 years experience, a Bachelor's degree in computer science or equivalent, US work authorization without sponsorship, familiarity with Apache Spark, Hadoop, Docker, Kubernetes, and proficiency in Java and/or Python. Experience with Airflow and Linux system administration is a plus. The position offers a salary range of $138,500 to $162,000 USD plus performance bonus, equity, and benefits. Location: San Francisco, California.

What you'll do

  • Contribute to the development and optimization of large-scale data workflows using technologies such as Apache Spark or similar frameworks
  • Develop and operate large scale data processing systems, making them more elastic and fault tolerant, solving distributed data and compute challenges
  • Assist in deploying and maintaining production systems, including CI/CD workflows
  • Provide technical input into roadmaps for the team
  • Write clean, maintainable, and well-tested code

Requirements

  • Recent graduate (0-1 years) with a Bachelor's Degree in computer science or equivalent experience
  • Work authorization in the United States without need for current or future employer sponsorship
  • Familiarity with data processing frameworks such as Apache Spark, Hadoop, or similar
  • Familiarity with containerization tools (e.g., Docker and Kubernetes)
  • Experience with workflow orchestration tools (e.g., Airflow) is a plus
  • Proficient in Java and/or Python programming languages
  • Linux system administration/automation is a plus
  • Strong problem-solving and debugging skills
  • Organized and detail-oriented

Tech stack

Apache SparkHadoopHDFSDockerKubernetesAirflowJavaPythonLinux

Benefits

Competitive salaryPerformance bonusEquityComprehensive benefits package

Apply now

This MVP uses a placeholder application flow. In production, this section can connect to an external apply URL or a native application form.

Continue to applicationBrowse more jobs

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.