Principal Software Engineer - Data Analytics

What you'll do

• Build, design, and implement a highly scalable, fault-tolerant big data platform to process terabytes of data and provide in-depth analytics
• Develop backend services using Java, REST APIs, JDBC, and AWS
• Build and maintain Big Data pipelines using Spark, Hadoop, Kafka, and Snowflake
• Architect and implement real-time data processing workflows and automation frameworks
• Lead multiple projects to develop features for data processing and reporting platforms
• Collaborate with product managers and cross-functional teams to build end-to-end products and features
• Fix bugs to improve performance
• Design and develop GenAI-powered agents for analytics, operations, and data enrichment using frameworks like LangChain, LlamaIndex, or custom orchestration systems
• Integrate LLMs (OpenAI, Claude, Mistral) into existing services for query understanding, summarization, and decision support
• Manage end-to-end GenAI workflows including prompt engineering, fine-tuning, vector embeddings, and retrieval-augmented generation (RAG)
• Work closely with cross-functional teams to improve availability and scalability of large data platforms and software functionality
• Participate in Agile/Scrum processes such as sprint planning, retrospectives, backlog grooming, user story management, and prioritization
• Discuss software features with product managers
• Support customer issues via email or JIRA, provide updates and patches
• Perform code and design reviews

Requirements

• 6+ years of coding experience in Java and backend development
• Solid computer science fundamentals, including data structure and algorithm design, and creation of architectural specifications
• Experience in professional software engineering best practices for full SDLC, including coding standards and code reviews
• Hands-on experience with Big Data tools and systems like Scala Spark, Kafka, Hadoop, and Snowflake
• Proven experience in building GenAI applications including LLM integration, LangChain or similar libraries, prompt engineering, embedding, and retrieval-based generation (RAG)
• Experience in developing and deploying scalable, production-grade AI or data systems
• Ability to lead end-to-end feature development and debug distributed systems
• Experience in developing and delivering large-scale big data pipelines, real-time systems, and data warehouses preferred
• Ability to achieve stretch goals in an innovative and fast-paced environment
• Ability to learn new technologies quickly and independently
• Excellent verbal and written communication skills
• Strong interpersonal skills and desire to work collaboratively
• Bachelor’s degree in engineering or equivalent from a recognized institute/university

Tech stack

Benefits