AdTechTalent
Data Science27 days agoOn-site

Merkle

Technical Lead

AWSdata engineeringdata pipelinesSQLPythonPySparkSparkTerraformCloudFormationDockerECSEKSKinesisKafkaMSKdata lakesdata warehousesCI/CDperformance tuningcost optimizationdata modelingcloud-nativestreamingbatch processingDevOpsinfrastructure as code

Key details

Salary

Not specified

Employment type

Full-time

Seniority

Senior

Years experience

5-10

Location

Mumbai, India

Full job description

Seeking a Technical Architect (AWS Data Engineering Lead) with 6-10 years experience to design and deliver scalable, secure, high-performance data platforms on AWS. Requires strong hands-on skills with AWS services (S3, Glue, Athena, Redshift), SQL, Python, and PySpark. Responsibilities include designing cloud-native data lakes and warehouses, building batch and streaming data pipelines, performance tuning, cost optimization, troubleshooting, and collaborating with global teams. Must have experience with Infrastructure as Code (Terraform/CloudFormation), CI/CD pipelines, containerization (Docker, ECS, EKS), and strong ownership mindset. Preferred certifications include AWS Certified Data Analytics and AWS Solutions Architect. Location: Mumbai, India.

What you'll do

  • Design and implement AWS-based data engineering solutions
  • Build and optimize batch and streaming pipelines
  • Develop SQL-driven data transformations and Python-based pipelines
  • Design efficient data models for scalability, performance, and cost optimization
  • Own data engineering deliverables from development to production support
  • Perform performance tuning, cost optimization, and capacity planning
  • Troubleshoot complex data and production issues
  • Ensure solutions meet security, reliability, and scalability standards
  • Collaborate with architects, product owners, and stakeholders
  • Translate business requirements into technical data solutions
  • Provide technical estimates and implementation trade-offs
  • Participate in solution design and architecture discussions
  • Follow coding standards and data engineering best practices
  • Participate in code reviews and continuous improvement initiatives
  • Ensure compliance with AWS, security, and governance guidelines

Requirements

  • 6 to 10 years of experience in AWS data engineering
  • Strong hands-on experience with Amazon S3, AWS Glue, Athena, Redshift
  • Experience designing cloud-native data lakes and data warehouses
  • Deep understanding of batch and streaming data pipelines
  • Strong expertise in SQL including complex transformations, aggregations, and performance tuning
  • Strong Python programming skills for data engineering use cases
  • Hands-on experience with Spark / PySpark
  • Experience with distributed processing frameworks
  • Experience with Infrastructure as Code (Terraform / CloudFormation)
  • Hands-on experience building CI/CD pipelines for data platforms
  • Exposure to containerization (Docker, ECS, EKS)
  • Strong ownership mindset and excellent communication skills
  • Bachelor’s or Master’s degree in Computer Science, Information Systems, Data Engineering or related field
  • Preferred certifications: AWS Certified Data Analytics, AWS Solutions Architect (any two preferred)
  • Additional certifications: Databricks, Snowflake or other cloud data platform certifications

Tech stack

AWSAmazon S3AWS GlueAthenaRedshiftSQLPythonPySparkSparkTerraformCloudFormationDockerECSEKSKinesisKafkaMSKDatabricksSnowflake

Apply now

Ready to take the next step in your career? Click the button below to continue to the application process.

Continue to applicationBrowse more jobs

Similar jobs

More roles worth a look

Related opportunities based on specialty and working model so candidates can keep momentum.