Data Infrastructure Engineer (Hadoop)

Key details

Full job description

Data Infrastructure Engineer responsible for designing, building, maintaining, and modernizing enterprise big data platforms supporting large-scale data processing and analytics. Requires experience with distributed data platforms such as Kafka, Hadoop/MapR, NoSQL databases (Redis, DynamoDB, Aerospike), and Linux infrastructure. Responsibilities include Hadoop cluster management, Linux systems engineering, performance tuning, high availability, infrastructure as code, CI/CD integration, Kafka event streaming, NoSQL database management, and Hadoop ecosystem integration. Requires 4+ years experience with big data platforms, Kafka, NoSQL databases, shell scripting, relational databases, Linux administration, and monitoring tools. Preferred qualifications include Kubernetes, distributed storage platforms, Terraform, Spacelift, Puppet, Ansible, and AWS experience. Role is hybrid with 2 remote days and 3 in-office days in New York. Salary range $170,000 - $180,000 plus bonus, equity, and comprehensive benefits.