The Senior Product Support Engineer will design and optimize Hadoop and Spark-based systems, troubleshoot performance issues, and support migrations while working in a 24/7 environment.
Position Summary:
We are seeking a Staff Product Support Engineer - Hadoop SME (Subject Matter Expert) who will be responsible for designing, optimising, migrating and scaling Hadoop and Spark-based data processing systems. This role involves hands-on experience with Hadoop and other core data operations, focusing on building resilient, high-performance distributed data systems. You will collaborate with customer engineering teams to deliver high-throughput Hadoop and Spark applications and solve complex data challenges in migration, upgrades, reliability, and optimise post-migration system performance.
If you’re passionate about working in fast-paced, dynamic environments and want to be part of the cutting edge of data solutions, this role is for you.
We’re looking for someone who can:
- Design and optimise distributed Hadoop-based applications, ensuring low-latency, high-throughput performance for big data workloads.
- Troubleshooting: Provide expert-level support for data or performance issues in Hadoop and Spark jobs and clusters.
- Data Processing Expertise: Work extensively with large-scale data pipelines using Hadoop and Spark's core components
- Performance Tuning: Conduct deep-dive performance analysis, debugging, and optimisation of Impala and Spark jobs to reduce processing time and resource consumption.
- Cluster Management: Collaborate with DevOps and infrastructure teams to manage Impala and Spark clusters on platforms like Hadoop/YARN, Kubernetes, or cloud platforms (AWS EMR, GCP Dataproc, etc.).
- Migration: Provide dedicated support to ensure the stability and reliability of the new ODP Hadoop environment during and after migration. Promptly address evolving technical challenges and optimise system performance after migration to ODP.
- This role requires flexibility to work in rotational shifts, based on team coverage needs and customer demand. Candidates should be comfortable supporting operations in a 24/7 environment and be willing to adjust their working hours accordingly.
Top Skills
Aws Emr
Gcp Dataproc
Hadoop
Impala
Kubernetes
Spark
Similar Jobs
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
As a Solution Consultant, you will integrate AI into work processes, develop solutions during sales cycles, and collaborate with sales and product management to drive product sales.
Top Skills:
AICloud Software SolutionsServicenow
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The role involves driving new business sales through a SaaS model, developing client relationships, and leading a virtual sales team.
Top Skills:
AISaaS
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The role is responsible for managing the product development of Partner Relationship Management software, collaborating with various teams, conducting market analysis, and maintaining the product roadmap while ensuring customer needs are met.
Top Skills:
AIApi IntegrationsB2B SaasCpqData ModelingSfa
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
