Designs and operates scalable multi-cloud data platforms, real-time and batch pipelines, lakehouse architectures, and distributed processing systems. The role focuses on Kafka, Spark, BigQuery, Airflow, Terraform, Kubernetes, data reliability, governance, security, and warehouse performance. It also leads technical architecture reviews, mentors engineers, and drives engineering best practices.
This is a remote position.
Shuru is an AI-native technology and engineering company that partners with businesses to build and scale high-impact digital products, platforms, and AI-driven solutions. We work with fast-growing organizations across industries, helping them solve complex technology challenges through strong engineering, product, data, and AI capabilities.
We are looking for a Senior Data Engineer to join Shuru and help design and build scalable, reliable, and high-performance data platforms for complex business environments.
- Design, build, and manage scalable multi-cloud data platforms.
- Develop and optimize real-time and batch data pipelines using Kafka and Spark.
- Build Lakehouse architectures using Apache Iceberg or Delta Lake.
- Optimize BigQuery, data models, queries, and warehouse performance.
- Design reliable and scalable distributed data processing systems.
- Automate infrastructure and deployments using Terraform and Kubernetes.
- Ensure high standards of data reliability, security, governance, and compliance.
- Drive technical architecture and design reviews.
- Mentor engineers and contribute to engineering best practices.
Requirements
- 8+ years of experience in Data Engineering, Data Platforms, or Distributed Systems.
- 3+ years of experience operating large-scale data platforms in production.
- Strong hands-on experience with Kafka, Spark, GCP, BigQuery, and Airflow.
- Experience with Terraform and Kubernetes.
- Hands-on knowledge of Lakehouse technologies such as Iceberg or Delta Lake.
- Strong understanding of data modeling, distributed systems, and data warehouse architecture.
- Experience leading technical initiatives and mentoring engineers.
Nice to Have
- Experience with Debezium, Redpanda, and dbt.
- Experience with Prometheus and Grafana for monitoring and observability.
- Exposure to fintech, financial services, or regulated environments.
- Understanding of data governance, security, and compliance requirements.
Benefits
- Work on challenging, large-scale engineering and data problems.
- Build modern platforms using cutting-edge cloud and data technologies.
- Work closely with experienced engineering, product, and technology leaders.
- Opportunity to take ownership of architecture and key technical decisions.
- Remote-first and collaborative work environment.
- Strong opportunities for learning, leadership, and career growth.
Similar Jobs
Information Technology
Build and maintain scalable data pipelines for a global fintech engagement using Azure Databricks, PySpark, SQL, and Delta Lake. Develop Bronze, Silver, and Gold data layers, optimize data models, implement validation and monitoring, troubleshoot data quality issues, and follow governance, security, cataloging, and lineage standards while collaborating with data and engineering teams.
Top Skills:
AzureAzure DatabricksCi/CdDelta LakeGitPysparkSQL
AdTech • Digital Media • Marketing Tech • Mobile
Designs and develops scalable data architectures, cloud data solutions, data warehouses, business analytics tools, and complex data pipelines. The role involves data wrangling, exploration, and discovery across heterogeneous sources, using AWS, SQL, Python, and relational database technologies. The engineer also contributes to data engineering innovation, knowledge sharing, and project planning while enabling data-driven organizational decision-making.
Top Skills:
Amazon Web Services (Aws)Data WarehousingDaxPythonRelational DatabasesSQL
Information Technology • Consulting
Develop and maintain Oracle APEX applications, Oracle Analytics Server/OBIEE reporting solutions, BI Publisher reports, and Oracle database objects. Build dashboards, workflows, integrations, REST APIs, and data models; write complex SQL and PL/SQL; troubleshoot and tune application and database performance; support deployments, testing, production issues, documentation, and stakeholder collaboration.
Top Skills:
Agile/ScrumBi PublisherCi/CdCSSHTMLJavaScriptLinux/UnixObieeOracle Analytics ServerOracle ApexOracle Autonomous DatabaseOracle Cloud InfrastructureOracle Data IntegratorOracle DatabaseOracle Rest Data ServicesPl/SqlRest ApisSource ControlSQL
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
