Design and maintain scalable data pipelines on Azure, transform data across layers, implement CI/CD, and collaborate with teams for analytics and reporting.
Mindera is seeking a Lead Data Engineer with deep hands-on expertise and strong leadership capabilities to design, build, and scale modern data platforms. This role requires a technical leader who codes daily, mentors teams, and collaborates closely with US (Pacific Time) and UK stakeholders.
The ideal candidate is comfortable working in US PT overlap hours, can independently drive technical decisions, and has a strong background in Databricks, PySpark, and SQL on cloud platforms.
RequirementsRequired Skills & QualificationsMandatory Technical Skills
- 10+ years of experience in Data Engineering or related roles
- Strong, hands-on experience with Databricks in production environments
- Advanced proficiency in PySpark
- Excellent SQL skills (query optimization, complex joins, CTEs, window functions)
- Experience with any major cloud platform (AWS, Azure, or GCP)
- Strong understanding of data modeling, data warehousing, and analytics patterns
- Experience leading production-grade data pipelines
- Proven experience as a Lead Data Engineer / Technical Lead
- Ability to balance team leadership with individual contribution
- Strong ownership mindset with excellent problem-solving skills
- Experience working with global teams across time zones
- Mandatory availability to support meetings and calls in US Pacific Time (PT)
- Experience with Delta Lake and Lakehouse architecture
- Streaming technologies (Kafka, Spark Structured Streaming)
- CI/CD pipelines for data platforms
- Data governance, lineage, and security best practices
- Experience working in Agile / Scrum teams
BenefitsWhat We Offer
- Opportunity to work on modern cloud data platforms
- Challenging, high-impact data projects
- Collaborative and engineering-driven culture
Top Skills
Adls
Azure
Azure Data Factory
Azure Databricks
Azure Devops
Ci/Cd
Dbt
Git
Git
Jenkins
Pyspark
Python
SQL
Terraform
Mindera Bengaluru, Karnataka, IND Office
Hosur Road, Adugodi, IndiQube HM Vibha Towers, 5th FLoor, Bengaluru, Karnataka, India, 560029
Similar Jobs
Information Technology
Lead the design and development of data pipelines for structured and unstructured data in Azure using services like Synapse and Data Factory. Collaborate with business stakeholders and ensure data modeling and ETL fundamentals are implemented effectively.
Top Skills:
Azure Data FactoryAzure SynapseDatabricksPlsqlPysparkPythonSQLT-Sql
Fintech • Software • Financial Services
The Lead Data Engineer will develop and manage data pipelines, ETL processes, and collaborate with Data Analysts to support reporting and analysis, ensuring data quality and architecture efficiency.
Top Skills:
AirflowAWSDbtFivetranGCPLookerSnowflakeSQL
Software
The Lead Data Engineer designs and maintains data pipeline architectures, optimizes data delivery, collaborates on analytics, and supports existing products/services.
Top Skills:
AWSFlinkHadoopJavaKafkaKsqlMySQLPostgresPythonScalaSparkSpark-Streaming
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
