Build and maintain scalable data pipelines for a global fintech engagement using Azure Databricks, PySpark, SQL, and Delta Lake. Develop Bronze, Silver, and Gold data layers, optimize data models, implement validation and monitoring, troubleshoot data quality issues, and follow governance, security, cataloging, and lineage standards while collaborating with data and engineering teams.
This is a remote position.
Shuru is an AI-native technology and engineering company that partners with businesses to build and scale high-impact digital products, platforms, and AI-driven solutions. We work with fast-growing organizations across industries, helping them solve complex technology challenges through strong engineering, product, data, and AI capabilities.
Shuru is looking for a Senior Data Engineer to build scalable and reliable data pipelines for a global fintech engagement. This is a hands-on role focused on Azure Databricks, PySpark, SQL, and Delta Lake.
- Build and maintain data pipelines using Azure Databricks, PySpark, and SQL.
- Develop Bronze, Silver, and Gold data layers using Delta Lake.
- Build and optimize data models for analytics and business use cases.
- Implement data validation, testing, monitoring, and quality checks.
- Troubleshoot pipeline and data quality issues.
- Work closely with data leads, analysts, and engineering teams to deliver production-ready solutions.
- Follow data governance, security, cataloging, and lineage standards.
Requirements
- 5–8 years of Data Engineering experience.
- Strong hands-on experience with Azure Databricks, PySpark, and SQL.
- Experience with Delta Lake and Lakehouse architecture.
- Strong understanding of data modelling and dimensional modelling.
- Experience with data quality, testing, and pipeline monitoring.
- Familiarity with Git and CI/CD.
Benefits
- Work on challenging, large-scale engineering and data problems.
- Build modern platforms using cutting-edge cloud and data technologies.
- Work closely with experienced engineering, product, and technology leaders.
- Opportunity to take ownership of architecture and key technical decisions.
- Remote-first and collaborative work environment.
- Strong opportunities for learning, leadership, and career growth.
Similar Jobs
AdTech • Digital Media • Marketing Tech • Mobile
Designs and develops scalable data architectures, cloud data solutions, data warehouses, business analytics tools, and complex data pipelines. The role involves data wrangling, exploration, and discovery across heterogeneous sources, using AWS, SQL, Python, and relational database technologies. The engineer also contributes to data engineering innovation, knowledge sharing, and project planning while enabling data-driven organizational decision-making.
Top Skills:
Amazon Web Services (Aws)Data WarehousingDaxPythonRelational DatabasesSQL
Information Technology • Consulting
Develop and maintain Oracle APEX applications, Oracle Analytics Server/OBIEE reporting solutions, BI Publisher reports, and Oracle database objects. Build dashboards, workflows, integrations, REST APIs, and data models; write complex SQL and PL/SQL; troubleshoot and tune application and database performance; support deployments, testing, production issues, documentation, and stakeholder collaboration.
Top Skills:
Agile/ScrumBi PublisherCi/CdCSSHTMLJavaScriptLinux/UnixObieeOracle Analytics ServerOracle ApexOracle Autonomous DatabaseOracle Cloud InfrastructureOracle Data IntegratorOracle DatabaseOracle Rest Data ServicesPl/SqlRest ApisSource ControlSQL
Information Technology
Designs and operates scalable multi-cloud data platforms, real-time and batch pipelines, lakehouse architectures, and distributed processing systems. The role focuses on Kafka, Spark, BigQuery, Airflow, Terraform, Kubernetes, data reliability, governance, security, and warehouse performance. It also leads technical architecture reviews, mentors engineers, and drives engineering best practices.
Top Skills:
Apache AirflowApache IcebergSparkBigQueryDbtDebeziumDelta LakeGCPGrafanaKafkaKubernetesPrometheusRedpandaTerraform
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
