Design and implement scalable Lakehouse architectures and ETL/ELT pipelines using Databricks, PySpark, SparkSQL, Delta Lake, and DBT. Optimize SQL and data performance, model data, integrate ERP systems, and support governance, lineage, security, CI/CD, and automated deployments.
- Expert in Databricks, PySpark, SparkSQL, and Delta Lake – mandatory
- Strong SQL and performance optimization skills – mandatory
- Experience designing and implementing scalable Lakehouse architectures – mandatory
- Development of ETL/ELT pipelines using DBT – mandatory
- Integration experience with SAP S/4HANA, ECC, MDG, and other ERP systems – strong plus
- Experience with Unity Catalog, data governance, lineage, and security concepts – plus
- Data modelling and architecture expertise – mandatory
- GitHub, CI/CD, and deployment automation experience – mandatory
Benefits
- Competitive salary and performance-based bonuses.
- Comprehensive insurance plans.
- Collaborative and supportive work environment.
- Chance to learn and grow with a talented team.
- A positive and fun work environment.
Similar Jobs
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Designs and optimizes scalable data ingestion pipelines for product telemetry and enterprise business data. Builds automated pipelines using Fivetran, Python, APIs, S3 lakehouse architectures, Kafka, Spark, and Snowflake. Applies advanced SQL, incremental loading, CDC, micro-batching, and rate-limit handling to support reliable, analytics-ready datasets. Implements CI/CD and DevOps practices, monitors pipeline performance, and partners with analysts and platform teams to rapidly deliver data solutions.
Top Skills:
Amazon S3SparkBulk ApisCdcCi/CdDevOpsFivetranKafkaPythonSnowflakeSQLVersion Control
Gaming • Information Technology • Mobile • Software
Leads the architecture and implementation of scalable batch and streaming data pipelines using distributed computing. Improves data quality, reliability, monitoring, alerting, and enterprise data governance. Integrates diverse data sources and storage systems, develops fault-tolerant solutions, and oversees data infrastructure operations. The role also leads projects, mentors engineers, collaborates globally, and drives software development and coding best practices.
Top Skills:
CcpaCdpCi/CdDatabricksDmpDroneGdprGithub ActionsHadoopHiveJenkinsPysparkPythonSparkSQL
Cloud • Information Technology • Security • Software • Cybersecurity
Leads cybersecurity data-source onboarding and integration for Zscaler’s security platform. Builds and automates Python/API-based data transformations, maps and normalizes security data, manages pipeline lifecycle activities, troubleshoots data quality, and identifies security gaps. Partners with cybersecurity SMEs and cross-functional teams to create implementation plans, communicate technical findings, and provide product improvement feedback. The role requires expertise in security platforms, diverse security-tool integrations, data modeling, SQL, and Python.
Top Skills:
Ai/MlAPIsCloud LogsCmdbCnappCspmEdrPythonSIEMSQLUnified Vulnerability Management
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
